2019-12-09T10:43:30.300 INFO:root:teuthology version: 1.0.0-8b630f9 2019-12-09T10:43:30.301 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.cHyBlY.tmp -- --verbose --lock --description rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} --name ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi --block --owner scheduled_ofriedma@teuthology --archive /home/teuthworker/archive/ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4584280 2019-12-09T10:43:30.350 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-09T10:43:30.407 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4584280 branch: wip-ofriedma-dynamic-disable description: rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} email: ofriedma@redhat.com first_in_suite: false job_id: '4584280' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos overrides: admin_socket: branch: wip-ofriedma-dynamic-disable ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 1351c819e1a9518cde4c8b12d645782009028360 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: notcmalloc sha1: 1351c819e1a9518cde4c8b12d645782009028360 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true rgw.client.1: ca: root client: client.1 embed-key: true root: client: client.0 cn: teuthology install: - client.0 - client.1 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 client.1: ssl certificate: rgw.client.1 compression type: random ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast storage classes: LUKEWARM, FROZEN s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-ofriedma-dynamic-disable sha1: 1351c819e1a9518cde4c8b12d645782009028360 owner: scheduled_ofriedma@teuthology priority: 60 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 1351c819e1a9518cde4c8b12d645782009028360 suite: rgw suite_branch: wip-ofriedma-dynamic-disable suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 1351c819e1a9518cde4c8b12d645782009028360 tasks: - install: flavor: notcmalloc - ceph: null - openssl_keys: null - rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 - swift: client.0: rgw_server: client.0 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.13056 2019-12-09T10:43:30.407 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa; will attempt to use it 2019-12-09T10:43:30.408 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa/tasks 2019-12-09T10:43:30.408 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-12-09T10:43:30.410 INFO:teuthology.task.internal:Checking packages... 2019-12-09T10:43:30.422 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'notcmalloc' and ceph hash '1351c819e1a9518cde4c8b12d645782009028360' 2019-12-09T10:43:30.423 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-09T10:43:30.423 INFO:teuthology.packaging:ref: None 2019-12-09T10:43:30.423 INFO:teuthology.packaging:tag: None 2019-12-09T10:43:30.423 INFO:teuthology.packaging:branch: wip-ofriedma-dynamic-disable 2019-12-09T10:43:30.423 INFO:teuthology.packaging:sha1: 1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T10:43:30.424 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&ref=wip-ofriedma-dynamic-disable 2019-12-09T10:43:30.585 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-7900.g1351c81 2019-12-09T10:43:30.585 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-12-09T10:43:30.602 INFO:teuthology.task.internal:no buildpackages task found 2019-12-09T10:43:30.602 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-12-09T10:43:30.622 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-12-09T10:43:30.622 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-09T10:43:30.668 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:43:40.688 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:43:50.706 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:44:00.722 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:44:10.736 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:44:20.752 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:44:30.769 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:44:40.786 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:44:50.802 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:45:00.816 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:45:10.838 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:45:20.855 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:45:30.873 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:45:40.887 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:45:50.905 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:46:00.923 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:46:10.937 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:46:20.955 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:46:30.972 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:46:40.990 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:46:51.008 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:47:01.024 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:47:11.041 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:47:21.057 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:47:31.073 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:47:41.091 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T10:47:51.105 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_ofriedma@teuthology', 'description': '/home/teuthworker/archive/ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4584280', 'machine_type': 'smithi'} 2019-12-09T10:47:51.120 DEBUG:teuthology.lock.ops:locked ubuntu@smithi194.front.sepia.ceph.com, ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T10:47:51.183 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-09T10:47:51.396 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 7.6 2019-12-09T10:47:51.413 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 7.6 2019-12-09T10:47:51.711 INFO:teuthology.orchestra.console:Power off smithi146 2019-12-09T10:47:51.711 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-09T10:47:51.731 INFO:teuthology.orchestra.console:Power off smithi194 2019-12-09T10:47:51.731 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-09T10:47:51.742 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T10:47:51.755 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T10:47:55.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T10:47:55.778 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T10:47:59.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T10:47:59.890 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T10:48:00.101 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2019-12-09T10:48:00.103 INFO:teuthology.orchestra.console:Power off for smithi194 completed 2019-12-09T10:48:00.202 INFO:teuthology.orchestra.console:Power on smithi146 2019-12-09T10:48:00.203 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-09T10:48:00.212 INFO:teuthology.orchestra.console:Power on smithi194 2019-12-09T10:48:00.213 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-09T10:48:00.224 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T10:48:00.234 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T10:48:04.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T10:48:04.259 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T10:48:08.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T10:48:08.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T10:48:08.574 INFO:teuthology.orchestra.console:Power on for smithi146 completed 2019-12-09T10:48:08.653 INFO:teuthology.orchestra.console:Power on for smithi194 completed 2019-12-09T10:48:08.675 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2019-12-09T10:48:08.754 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2019-12-09T10:50:39.789 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:50:39.792 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:50:48.847 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:50:48.873 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:50:57.903 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:50:57.929 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:51:06.959 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:51:06.985 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:51:16.015 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:51:16.045 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:51:25.071 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:51:25.097 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:51:34.126 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:51:43.182 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:52:31.141 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:52:31.325 INFO:teuthology.orchestra.run.smithi194:> hostname 2019-12-09T10:52:31.927 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194 2019-12-09T10:52:31.927 INFO:teuthology.orchestra.run.smithi194:> grep smithi194 /etc/hosts 2019-12-09T10:52:32.011 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2019-12-09T10:52:32.012 INFO:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2019-12-09T10:52:32.162 INFO:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194/smithi194/g' /etc/hosts 2019-12-09T10:52:32.265 INFO:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2019-12-09T10:52:32.335 INFO:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194/smithi194/g' /etc/hostname 2019-12-09T10:52:32.401 INFO:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2019-12-09T10:52:32.459 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2019-12-09T10:52:32.461 DEBUG:teuthology.parallel:result is None 2019-12-09T10:52:49.195 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:52:49.378 INFO:teuthology.orchestra.run.smithi146:> hostname 2019-12-09T10:52:49.915 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146 2019-12-09T10:52:49.915 INFO:teuthology.orchestra.run.smithi146:> grep smithi146 /etc/hosts 2019-12-09T10:52:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2019-12-09T10:52:49.999 INFO:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2019-12-09T10:52:50.155 INFO:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146/smithi146/g' /etc/hosts 2019-12-09T10:52:50.270 INFO:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2019-12-09T10:52:50.366 INFO:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146/smithi146/g' /etc/hostname 2019-12-09T10:52:50.450 INFO:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2019-12-09T10:52:50.520 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2019-12-09T10:52:50.522 DEBUG:teuthology.parallel:result is None 2019-12-09T10:52:50.680 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2019-12-09T10:52:50.680 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-09T10:52:50.702 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2019-12-09T10:52:50.703 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-09T10:52:50.716 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2019-12-09T10:52:50.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T10:52:50.717 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:52:50.804 INFO:teuthology.orchestra.run.smithi146:> true 2019-12-09T10:52:51.204 INFO:teuthology.orchestra.run.smithi146:> uname -m 2019-12-09T10:52:51.275 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2019-12-09T10:52:51.275 INFO:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2019-12-09T10:52:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Linux" 2019-12-09T10:52:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="7 (Core)" 2019-12-09T10:52:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2019-12-09T10:52:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2019-12-09T10:52:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="7" 2019-12-09T10:52:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-09T10:52:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2019-12-09T10:52:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-09T10:52:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.centos.org/" 2019-12-09T10:52:51.339 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-09T10:52:51.340 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:52:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-09T10:52:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-09T10:52:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-09T10:52:51.340 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-09T10:52:51.340 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:52:51.341 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2019-12-09T10:52:51.353 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2019-12-09T10:52:51.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T10:52:51.354 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:52:51.442 INFO:teuthology.orchestra.run.smithi194:> true 2019-12-09T10:52:51.798 INFO:teuthology.orchestra.run.smithi194:> uname -m 2019-12-09T10:52:51.858 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2019-12-09T10:52:51.859 INFO:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2019-12-09T10:52:51.916 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Linux" 2019-12-09T10:52:51.916 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="7 (Core)" 2019-12-09T10:52:51.916 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2019-12-09T10:52:51.916 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2019-12-09T10:52:51.917 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="7" 2019-12-09T10:52:51.917 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-09T10:52:51.917 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2019-12-09T10:52:51.917 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-09T10:52:51.917 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.centos.org/" 2019-12-09T10:52:51.917 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-09T10:52:51.917 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:52:51.918 INFO:teuthology.orchestra.run.smithi194.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-09T10:52:51.918 INFO:teuthology.orchestra.run.smithi194.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-09T10:52:51.918 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-09T10:52:51.918 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-09T10:52:51.918 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:52:51.918 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2019-12-09T10:52:51.933 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-12-09T10:52:51.958 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDtaDrN3mqKUeO17/nPMpfCLNrb+ja08MoRWrzSEOyZpcm0C8DDyKtfLu/MwZ065gKVzsks5iuXZbys1k629yU+4kXQj3FWsfrdm15u+t7oXfRvA/rk3AAOGwRQMbByqkGE+rJ37mnB311HdiEJSzGHLHTdJGZV4MGNjyPz1vd5e3OH004mQmsSK8eKNP6NaUVj7iwudDilGqhfUUiGFkO60ZcIXfFfBam6r/BqmlXnih/amAQsflDfONYhSDucy1GHLTCmudstHns/KVDnPHyPZhiGPt5xLmM5ZYz/cPdaTqbb3sr9/Ew18HGaKqKBukVE+s/0i+4KXkbLCUqTGaVB smithi194.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKkk8KkZMySBRapKco1VibaGG4KM7UDqg5ILU7Ny+KrmtjxttCDS1hqJZEbk+r0q8uqjJDGTb3mfEOx3d8vU6myJOZuqhg+kt41M7ADQnvZr7woIGQskdeCAUMFblQWe1K9jHpBsrVzqumNpxQ4gNULFATZ2s0EMuMW5tf0pZNV5Ic2Z1bd23CZXjsHmE8LSE6dbsV7tDflKGutT338MqohkVj+4DDgt04bxKfUdp700kYg3HZQ2CV3/Ga3+Cjyr8DBTCUYB2jsTXqUzrfTXhmz5yDB8MR/wNRIxdOaDGyRIjqVduqw2eOjrtAvphTu0hXqiUnAFnGQGjjIzncy0/B 2019-12-09T10:52:51.958 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-09T10:52:52.000 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-12-09T10:52:52.126 INFO:teuthology.task.internal:Saving configuration 2019-12-09T10:52:52.146 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-12-09T10:52:52.348 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-12-09T10:52:52.362 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-09 10:47:51.111502', u'locked_by': u'scheduled_ofriedma@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi146.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBIY5CxCMkhGDSWP/IQciIIQgUuENJIJINl6793S3oBvYZ6TltawTJN6UTmKrrt8/i3N33fUUyORpc63j1cfuxg=', u'description': u'/home/teuthworker/archive/ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4584280'} 2019-12-09T10:52:52.374 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-09 10:47:51.111522', u'locked_by': u'scheduled_ofriedma@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi194.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCtEWJqwU9c6xVgBDLmISd2WHSRmbZYzZ4wuLZbeMkEgcuT/TwcAXNk32vmZnTxC8g40UeG+Gesva6kwuh7vmFQ=', u'description': u'/home/teuthworker/archive/ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4584280'} 2019-12-09T10:52:52.375 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-12-09T10:52:52.550 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-09T10:52:52.550 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-12-09T10:52:52.551 INFO:teuthology.run_tasks:Running task console_log... 2019-12-09T10:52:52.778 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-09T10:52:52.778 INFO:teuthology.run_tasks:Running task internal.connect... 2019-12-09T10:52:52.900 INFO:teuthology.task.internal:Opening connections... 2019-12-09T10:52:52.901 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T10:52:52.902 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:52:52.996 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2019-12-09T10:52:52.996 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:52:53.091 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-12-09T10:52:53.186 INFO:teuthology.orchestra.run.smithi146:> uname -m 2019-12-09T10:52:53.322 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2019-12-09T10:52:53.323 INFO:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2019-12-09T10:52:53.383 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Linux" 2019-12-09T10:52:53.384 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="7 (Core)" 2019-12-09T10:52:53.384 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2019-12-09T10:52:53.384 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2019-12-09T10:52:53.384 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="7" 2019-12-09T10:52:53.384 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-09T10:52:53.385 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2019-12-09T10:52:53.385 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-09T10:52:53.385 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.centos.org/" 2019-12-09T10:52:53.385 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-09T10:52:53.385 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:52:53.385 INFO:teuthology.orchestra.run.smithi146.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-09T10:52:53.385 INFO:teuthology.orchestra.run.smithi146.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-09T10:52:53.386 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-09T10:52:53.386 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-09T10:52:53.386 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:52:53.386 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2019-12-09T10:52:53.402 INFO:teuthology.orchestra.run.smithi194:> uname -m 2019-12-09T10:52:53.524 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2019-12-09T10:52:53.525 INFO:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2019-12-09T10:52:53.592 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Linux" 2019-12-09T10:52:53.593 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="7 (Core)" 2019-12-09T10:52:53.593 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2019-12-09T10:52:53.593 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2019-12-09T10:52:53.593 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="7" 2019-12-09T10:52:53.593 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-09T10:52:53.593 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2019-12-09T10:52:53.594 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-09T10:52:53.594 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.centos.org/" 2019-12-09T10:52:53.594 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-09T10:52:53.594 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:52:53.594 INFO:teuthology.orchestra.run.smithi194.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-09T10:52:53.594 INFO:teuthology.orchestra.run.smithi194.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-09T10:52:53.594 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-09T10:52:53.595 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-09T10:52:53.595 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:52:53.595 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2019-12-09T10:52:53.615 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-12-09T10:52:53.702 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-12-09T10:52:53.761 INFO:teuthology.task.internal:Checking for old test directory... 2019-12-09T10:52:53.761 INFO:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2019-12-09T10:52:53.765 INFO:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2019-12-09T10:52:53.852 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-12-09T10:52:53.920 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-12-09T10:52:53.921 INFO:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2019-12-09T10:52:53.924 INFO:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2019-12-09T10:52:54.031 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-12-09T10:52:54.157 INFO:teuthology.run_tasks:Running task kernel... 2019-12-09T10:52:54.266 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2019-12-09T10:52:54.266 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-12-09T10:52:54.266 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T10:52:54.267 INFO:teuthology.orchestra.run.smithi146:> sudo package-cleanup -y --oldkernels 2019-12-09T10:52:55.113 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T10:52:55.988 INFO:teuthology.orchestra.run.smithi146.stdout:http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T10:52:55.988 INFO:teuthology.orchestra.run.smithi146.stdout:Trying other mirror. 2019-12-09T10:52:55.988 INFO:teuthology.orchestra.run.smithi146.stdout:To address this issue please refer to the below wiki article 2019-12-09T10:52:55.988 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:52:55.988 INFO:teuthology.orchestra.run.smithi146.stdout:https://wiki.centos.org/yum-errors 2019-12-09T10:52:55.989 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:52:55.989 INFO:teuthology.orchestra.run.smithi146.stdout:If above article doesn't help to resolve this issue please use https://bugs.centos.org/. 2019-12-09T10:52:55.989 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:52:56.137 INFO:teuthology.orchestra.run.smithi146.stdout:http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T10:52:56.137 INFO:teuthology.orchestra.run.smithi146.stdout:Trying other mirror. 2019-12-09T10:52:56.229 INFO:teuthology.orchestra.run.smithi146.stdout:http://mirror.oss.ou.edu/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T10:52:56.229 INFO:teuthology.orchestra.run.smithi146.stdout:Trying other mirror. 2019-12-09T10:52:56.373 INFO:teuthology.orchestra.run.smithi146.stdout:http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T10:52:56.373 INFO:teuthology.orchestra.run.smithi146.stdout:Trying other mirror. 2019-12-09T10:52:56.525 INFO:teuthology.orchestra.run.smithi146.stdout:http://mirror.pnl.gov/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T10:52:56.526 INFO:teuthology.orchestra.run.smithi146.stdout:Trying other mirror. 2019-12-09T10:52:56.995 INFO:teuthology.orchestra.run.smithi146.stdout:No old kernels to remove 2019-12-09T10:52:57.011 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi194.front.sepia.ceph.com 2019-12-09T10:52:57.011 INFO:teuthology.orchestra.run.smithi194:> sudo package-cleanup -y --oldkernels 2019-12-09T10:52:57.934 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T10:52:58.948 INFO:teuthology.orchestra.run.smithi194.stdout:http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T10:52:58.948 INFO:teuthology.orchestra.run.smithi194.stdout:Trying other mirror. 2019-12-09T10:52:58.948 INFO:teuthology.orchestra.run.smithi194.stdout:To address this issue please refer to the below wiki article 2019-12-09T10:52:58.948 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:52:58.949 INFO:teuthology.orchestra.run.smithi194.stdout:https://wiki.centos.org/yum-errors 2019-12-09T10:52:58.949 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:52:58.949 INFO:teuthology.orchestra.run.smithi194.stdout:If above article doesn't help to resolve this issue please use https://bugs.centos.org/. 2019-12-09T10:52:58.949 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:52:59.094 INFO:teuthology.orchestra.run.smithi194.stdout:http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T10:52:59.094 INFO:teuthology.orchestra.run.smithi194.stdout:Trying other mirror. 2019-12-09T10:52:59.186 INFO:teuthology.orchestra.run.smithi194.stdout:http://mirror.oss.ou.edu/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T10:52:59.186 INFO:teuthology.orchestra.run.smithi194.stdout:Trying other mirror. 2019-12-09T10:52:59.329 INFO:teuthology.orchestra.run.smithi194.stdout:http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T10:52:59.329 INFO:teuthology.orchestra.run.smithi194.stdout:Trying other mirror. 2019-12-09T10:52:59.482 INFO:teuthology.orchestra.run.smithi194.stdout:http://mirror.pnl.gov/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T10:52:59.482 INFO:teuthology.orchestra.run.smithi194.stdout:Trying other mirror. 2019-12-09T10:53:00.046 INFO:teuthology.orchestra.run.smithi194.stdout:No old kernels to remove 2019-12-09T10:53:00.062 INFO:teuthology.orchestra.run.smithi146:> uname -r 2019-12-09T10:53:00.158 INFO:teuthology.orchestra.run.smithi146.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-09T10:53:00.159 INFO:teuthology.task.kernel:Running kernel on smithi146: 3.10.0-1062.4.1.el7.x86_64 2019-12-09T10:53:00.159 INFO:teuthology.orchestra.run.smithi146:> sudo yum install -y kernel 2019-12-09T10:53:00.392 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T10:53:00.433 INFO:teuthology.orchestra.run.smithi146.stdout:Determining fastest mirrors 2019-12-09T10:53:00.565 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T10:53:00.565 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T10:53:00.566 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T10:53:00.566 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T10:53:02.048 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T10:53:02.049 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T10:53:02.049 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-09T10:53:03.551 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T10:53:04.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:53:04.338 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T10:53:04.340 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:53:04.340 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T10:53:04.340 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2019-12-09T10:53:04.340 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T10:53:04.340 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T10:53:04.341 INFO:teuthology.orchestra.run.smithi146.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-09T10:53:04.341 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:53:04.341 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T10:53:04.341 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T10:53:04.341 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2019-12-09T10:53:04.341 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:53:04.341 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 50 M 2019-12-09T10:53:04.342 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 64 M 2019-12-09T10:53:04.342 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T10:53:04.362 INFO:teuthology.orchestra.run.smithi146.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-09T10:53:05.303 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T10:53:05.493 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T10:53:06.413 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T10:53:06.413 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T10:53:41.337 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-09T10:53:41.805 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-09T10:53:41.806 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:53:41.806 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T10:53:41.806 INFO:teuthology.orchestra.run.smithi146.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-09T10:53:41.806 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:53:41.806 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T10:53:41.861 INFO:teuthology.orchestra.run.smithi146:> rpm -q kernel --last | head -n 1 2019-12-09T10:53:42.262 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Mon 09 Dec 2019 10:53:09 AM UTC 2019-12-09T10:53:42.264 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:53:42.265 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:53:42.265 INFO:teuthology.orchestra.run.smithi194:> uname -r 2019-12-09T10:53:42.361 INFO:teuthology.orchestra.run.smithi194.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-09T10:53:42.362 INFO:teuthology.task.kernel:Running kernel on smithi194: 3.10.0-1062.4.1.el7.x86_64 2019-12-09T10:53:42.362 INFO:teuthology.orchestra.run.smithi194:> sudo yum install -y kernel 2019-12-09T10:53:42.640 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T10:53:42.685 INFO:teuthology.orchestra.run.smithi194.stdout:Determining fastest mirrors 2019-12-09T10:53:42.818 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.ash.fastserv.com 2019-12-09T10:53:42.819 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T10:53:42.819 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T10:53:42.820 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T10:53:44.507 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T10:53:44.507 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T10:53:44.507 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-09T10:53:45.813 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T10:53:46.712 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:53:46.712 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T10:53:46.723 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:53:46.723 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T10:53:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2019-12-09T10:53:46.724 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T10:53:46.724 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T10:53:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-09T10:53:46.724 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:53:46.724 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T10:53:46.724 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T10:53:46.725 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2019-12-09T10:53:46.725 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:53:46.725 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 50 M 2019-12-09T10:53:46.725 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 64 M 2019-12-09T10:53:46.725 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T10:53:46.733 INFO:teuthology.orchestra.run.smithi194.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-09T10:53:47.640 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T10:53:47.839 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T10:53:48.764 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T10:53:48.764 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T10:54:24.011 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-09T10:54:24.479 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-09T10:54:24.479 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:54:24.480 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T10:54:24.480 INFO:teuthology.orchestra.run.smithi194.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-09T10:54:24.480 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:54:24.480 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T10:54:24.568 INFO:teuthology.orchestra.run.smithi194:> rpm -q kernel --last | head -n 1 2019-12-09T10:54:24.974 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Mon 09 Dec 2019 10:53:51 AM UTC 2019-12-09T10:54:24.977 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:54:24.977 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:54:24.978 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-12-09T10:54:24.978 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-09T10:54:24.978 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-09T10:54:24.978 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-12-09T10:54:24.978 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=None, version=distro) 2019-12-09T10:54:24.978 INFO:teuthology.orchestra.run.smithi146:> rpm -q kernel --last | head -n 1 2019-12-09T10:54:25.344 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Mon 09 Dec 2019 10:53:09 AM UTC 2019-12-09T10:54:25.347 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:54:25.347 INFO:teuthology.orchestra.run.smithi146:> sudo rpm -qi grub2 2019-12-09T10:54:25.492 INFO:teuthology.orchestra.run.smithi146.stdout:Name : grub2 2019-12-09T10:54:25.493 INFO:teuthology.orchestra.run.smithi146.stdout:Epoch : 1 2019-12-09T10:54:25.493 INFO:teuthology.orchestra.run.smithi146.stdout:Version : 2.02 2019-12-09T10:54:25.493 INFO:teuthology.orchestra.run.smithi146.stdout:Release : 0.76.el7.centos 2019-12-09T10:54:25.493 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: x86_64 2019-12-09T10:54:25.493 INFO:teuthology.orchestra.run.smithi146.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-12-09T10:54:25.493 INFO:teuthology.orchestra.run.smithi146.stdout:Group : System Environment/Base 2019-12-09T10:54:25.494 INFO:teuthology.orchestra.run.smithi146.stdout:Size : 0 2019-12-09T10:54:25.494 INFO:teuthology.orchestra.run.smithi146.stdout:License : GPLv3+ 2019-12-09T10:54:25.494 INFO:teuthology.orchestra.run.smithi146.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-09T10:54:25.494 INFO:teuthology.orchestra.run.smithi146.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-09T10:54:25.494 INFO:teuthology.orchestra.run.smithi146.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-09T10:54:25.494 INFO:teuthology.orchestra.run.smithi146.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-09T10:54:25.495 INFO:teuthology.orchestra.run.smithi146.stdout:Relocations : (not relocatable) 2019-12-09T10:54:25.495 INFO:teuthology.orchestra.run.smithi146.stdout:Packager : CentOS BuildSystem 2019-12-09T10:54:25.495 INFO:teuthology.orchestra.run.smithi146.stdout:Vendor : CentOS 2019-12-09T10:54:25.495 INFO:teuthology.orchestra.run.smithi146.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-09T10:54:25.495 INFO:teuthology.orchestra.run.smithi146.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-12-09T10:54:25.495 INFO:teuthology.orchestra.run.smithi146.stdout:Description : 2019-12-09T10:54:25.495 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T10:54:25.496 INFO:teuthology.orchestra.run.smithi146.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-09T10:54:25.496 INFO:teuthology.orchestra.run.smithi146.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-09T10:54:25.496 INFO:teuthology.orchestra.run.smithi146.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-09T10:54:25.496 INFO:teuthology.orchestra.run.smithi146.stdout:hardware devices. 2019-12-09T10:54:25.497 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-09T10:54:25.498 INFO:teuthology.task.kernel:Updating grub on smithi146 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:54:25.498 INFO:teuthology.orchestra.run.smithi146:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-09T10:54:25.941 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2019-12-09T10:54:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:54:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-09T10:54:26.413 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-09T10:54:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-09T10:54:26.480 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-09T10:54:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-09T10:54:26.533 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-09T10:54:26.543 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-09T10:54:27.630 INFO:teuthology.orchestra.run.smithi146.stderr:done 2019-12-09T10:54:27.631 INFO:teuthology.orchestra.run.smithi146:> mktemp 2019-12-09T10:54:27.688 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.OFlhy5MGzJ 2019-12-09T10:54:27.688 INFO:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OFlhy5MGzJ 2019-12-09T10:54:27.755 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.OFlhy5MGzJ 2019-12-09T10:54:27.890 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.OFlhy5MGzJ is 6KB 2019-12-09T10:54:27.945 INFO:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.OFlhy5MGzJ 2019-12-09T10:54:27.992 INFO:teuthology.orchestra.run.smithi146:> sudo grub2-set-default 0 2019-12-09T10:54:28.194 INFO:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2019-12-09T10:54:28.197 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-12-09T10:54:28.197 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2019-12-09T10:54:28.197 INFO:teuthology.orchestra.run.smithi194:> rpm -q kernel --last | head -n 1 2019-12-09T10:54:28.560 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Mon 09 Dec 2019 10:53:51 AM UTC 2019-12-09T10:54:28.562 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:54:28.563 INFO:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2 2019-12-09T10:54:28.705 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2 2019-12-09T10:54:28.705 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2019-12-09T10:54:28.706 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.02 2019-12-09T10:54:28.706 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 0.76.el7.centos 2019-12-09T10:54:28.706 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2019-12-09T10:54:28.706 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-12-09T10:54:28.706 INFO:teuthology.orchestra.run.smithi194.stdout:Group : System Environment/Base 2019-12-09T10:54:28.706 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 0 2019-12-09T10:54:28.706 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2019-12-09T10:54:28.707 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-09T10:54:28.707 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-09T10:54:28.707 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-09T10:54:28.707 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-09T10:54:28.707 INFO:teuthology.orchestra.run.smithi194.stdout:Relocations : (not relocatable) 2019-12-09T10:54:28.707 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : CentOS BuildSystem 2019-12-09T10:54:28.708 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2019-12-09T10:54:28.708 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-09T10:54:28.708 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-12-09T10:54:28.708 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2019-12-09T10:54:28.708 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T10:54:28.708 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-09T10:54:28.708 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-09T10:54:28.709 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-09T10:54:28.709 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2019-12-09T10:54:28.709 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-09T10:54:28.709 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:54:28.709 INFO:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-09T10:54:29.156 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2019-12-09T10:54:29.296 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:54:29.312 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-09T10:54:29.562 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-09T10:54:29.582 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-09T10:54:29.614 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-09T10:54:29.628 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-09T10:54:29.654 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-09T10:54:29.663 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-09T10:54:30.650 INFO:teuthology.orchestra.run.smithi194.stderr:done 2019-12-09T10:54:30.651 INFO:teuthology.orchestra.run.smithi194:> mktemp 2019-12-09T10:54:30.715 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.wfcXs4T2i5 2019-12-09T10:54:30.716 INFO:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wfcXs4T2i5 2019-12-09T10:54:30.784 INFO:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.wfcXs4T2i5 2019-12-09T10:54:30.923 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.wfcXs4T2i5 is 6KB 2019-12-09T10:54:30.976 INFO:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.wfcXs4T2i5 2019-12-09T10:54:31.025 INFO:teuthology.orchestra.run.smithi194:> sudo grub2-set-default 0 2019-12-09T10:54:31.265 INFO:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2019-12-09T10:54:31.269 INFO:teuthology.misc:Re-opening connections... 2019-12-09T10:54:31.269 INFO:teuthology.misc:trying to connect to ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T10:54:31.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T10:54:31.270 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:55:31.272 DEBUG:teuthology.orchestra.remote:timed out 2019-12-09T10:55:31.272 INFO:teuthology.misc:trying to connect to ubuntu@smithi194.front.sepia.ceph.com 2019-12-09T10:55:31.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T10:55:31.273 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:56:02.745 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2019-12-09T10:56:02.745 DEBUG:teuthology.misc:waited 91.4754858017 2019-12-09T10:56:03.745 INFO:teuthology.misc:trying to connect to ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T10:56:03.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T10:56:03.746 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:56:06.808 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2019-12-09T10:56:06.809 INFO:teuthology.misc:trying to connect to ubuntu@smithi194.front.sepia.ceph.com 2019-12-09T10:56:06.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T10:56:06.809 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:56:06.810 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2019-12-09T10:56:06.811 DEBUG:teuthology.misc:waited 95.5411589146 2019-12-09T10:56:07.811 INFO:teuthology.misc:trying to connect to ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T10:56:07.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T10:56:07.812 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:56:09.884 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2019-12-09T10:56:09.885 INFO:teuthology.misc:trying to connect to ubuntu@smithi194.front.sepia.ceph.com 2019-12-09T10:56:09.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T10:56:09.885 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:56:09.974 INFO:teuthology.orchestra.run.smithi194:> true 2019-12-09T10:56:10.303 DEBUG:teuthology.misc:waited 99.0339019299 2019-12-09T10:56:11.304 INFO:teuthology.misc:trying to connect to ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T10:56:11.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T10:56:11.305 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:56:12.952 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2019-12-09T10:56:12.953 DEBUG:teuthology.misc:waited 101.683311939 2019-12-09T10:56:13.953 INFO:teuthology.misc:trying to connect to ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T10:56:13.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T10:56:13.954 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T10:56:14.027 INFO:teuthology.orchestra.run.smithi146:> true 2019-12-09T10:56:14.316 DEBUG:teuthology.misc:waited 103.046194792 2019-12-09T10:56:15.317 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-12-09T10:56:15.317 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-09T10:56:15.317 INFO:teuthology.orchestra.run.smithi146:> uname -r 2019-12-09T10:56:15.389 INFO:teuthology.orchestra.run.smithi146.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:56:15.390 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:56:15.390 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-09T10:56:15.390 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-12-09T10:56:15.390 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-09T10:56:15.390 INFO:teuthology.orchestra.run.smithi194:> uname -r 2019-12-09T10:56:15.455 INFO:teuthology.orchestra.run.smithi194.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:56:15.455 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 2019-12-09T10:56:15.455 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-09T10:56:16.456 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-12-09T10:56:16.456 INFO:teuthology.orchestra.run.smithi146:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-09T10:56:16.574 INFO:teuthology.orchestra.run.smithi146.stdout:ttyS1 2019-12-09T10:56:16.590 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-12-09T10:56:16.591 INFO:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-09T10:56:16.707 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2019-12-09T10:56:16.723 INFO:teuthology.run_tasks:Running task internal.base... 2019-12-09T10:56:16.746 INFO:teuthology.task.internal:Creating test directory... 2019-12-09T10:56:16.746 INFO:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-09T10:56:16.749 INFO:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-09T10:56:16.799 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-12-09T10:56:16.817 INFO:teuthology.run_tasks:Running task internal.archive... 2019-12-09T10:56:16.842 INFO:teuthology.task.internal:Creating archive directory... 2019-12-09T10:56:16.843 INFO:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-09T10:56:16.845 INFO:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-09T10:56:16.901 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-12-09T10:56:16.911 INFO:teuthology.task.internal:Enabling coredump saving... 2019-12-09T10:56:16.912 INFO:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-09T10:56:16.914 INFO:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-09T10:56:16.973 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-09T10:56:16.977 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-09T10:56:16.978 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-12-09T10:56:16.988 INFO:teuthology.task.internal:Configuring sudo... 2019-12-09T10:56:16.988 INFO:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-09T10:56:16.991 INFO:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-09T10:56:17.052 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-12-09T10:56:17.066 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-12-09T10:56:17.066 INFO:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-09T10:56:17.069 INFO:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-09T10:56:17.111 INFO:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-09T10:56:17.214 INFO:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-09T10:56:17.282 INFO:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-09T10:56:17.338 INFO:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-09T10:56:17.417 INFO:teuthology.orchestra.run.smithi146:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-09T10:56:17.474 INFO:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-09T10:56:17.572 INFO:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-09T10:56:17.669 INFO:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-09T10:56:17.731 INFO:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-09T10:56:17.785 INFO:teuthology.orchestra.run.smithi194:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-09T10:56:17.836 INFO:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2019-12-09T10:56:17.839 INFO:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2019-12-09T10:56:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-09T10:56:17.968 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-09T10:56:17.993 INFO:teuthology.run_tasks:Running task internal.timer... 2019-12-09T10:56:18.002 INFO:teuthology.task.internal:Starting timer... 2019-12-09T10:56:18.003 INFO:teuthology.run_tasks:Running task pcp... 2019-12-09T10:56:18.037 INFO:teuthology.run_tasks:Running task selinux... 2019-12-09T10:56:18.055 INFO:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2019-12-09T10:56:18.142 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: [ OK ] 2019-12-09T10:56:18.144 INFO:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2019-12-09T10:56:18.271 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: [ OK ] 2019-12-09T10:56:18.273 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-12-09T10:56:18.274 INFO:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2019-12-09T10:56:18.318 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2019-12-09T10:56:18.318 INFO:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2019-12-09T10:56:18.379 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2019-12-09T10:56:18.379 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi194.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi146.front.sepia.ceph.com': 'permissive'} 2019-12-09T10:56:18.380 INFO:teuthology.orchestra.run.smithi146:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-09T10:56:18.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-09T10:56:18.445 INFO:teuthology.orchestra.run.smithi194:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-09T10:56:18.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-09T10:56:18.532 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-12-09T10:56:18.533 INFO:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2019-12-09T10:56:18.594 INFO:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2019-12-09T10:56:18.705 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-12-09T10:56:18.715 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2019-12-09T10:56:18.716 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-12-09T10:56:18.732 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-12-09T10:56:18.736 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi146.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-12-09T10:56:19.152 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-12-09T10:56:20.339 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2019-12-09T10:56:23.115 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-12-09T10:56:23.143 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:23 +0000 (0:00:00.082) 0:00:00.082 ******* 2019-12-09T10:56:23.154 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:23 +0000 (0:00:00.011) 0:00:00.094 ******* 2019-12-09T10:56:26.025 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-12-09T10:56:26.026 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] 2019-12-09T10:56:26.109 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:26 +0000 (0:00:02.954) 0:00:03.048 ******* 2019-12-09T10:56:26.449 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-12-09T10:56:26.450 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-09T10:56:26.489 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:26 +0000 (0:00:00.380) 0:00:03.428 ******* 2019-12-09T10:56:26.498 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi194.front.sepia.ceph.com] 2019-12-09T10:56:26.583 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:26 +0000 (0:00:00.093) 0:00:03.522 ******* 2019-12-09T10:56:26.920 INFO:teuthology.task.ansible.out: 2019-12-09T10:56:26.921 INFO:teuthology.task.ansible.out:TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-09T10:56:26.963 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:26 +0000 (0:00:00.380) 0:00:03.902 ******* 2019-12-09T10:56:27.062 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-12-09T10:56:27.063 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-09T10:56:27.104 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:27 +0000 (0:00:00.140) 0:00:04.043 ******* 2019-12-09T10:56:27.130 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-12-09T10:56:27.132 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:56:27.169 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:27 +0000 (0:00:00.065) 0:00:04.108 ******* 2019-12-09T10:56:27.381 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-12-09T10:56:27.383 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-09T10:56:27.422 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:27 +0000 (0:00:00.253) 0:00:04.361 ******* 2019-12-09T10:56:27.454 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:56:27.497 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:27 +0000 (0:00:00.074) 0:00:04.436 ******* 2019-12-09T10:56:27.605 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-12-09T10:56:27.606 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T10:56:27.650 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:27 +0000 (0:00:00.153) 0:00:04.589 ******* 2019-12-09T10:56:27.822 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T10:56:27.860 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:27 +0000 (0:00:00.210) 0:00:04.800 ******* 2019-12-09T10:56:29.137 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-12-09T10:56:29.138 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575888987.88-58034239432794/source", "state": "file", "uid": 0} 2019-12-09T10:56:29.175 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:29 +0000 (0:00:01.314) 0:00:06.114 ******* 2019-12-09T10:56:29.181 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575888987.67-216461010643914/source", "state": "file", "uid": 0} 2019-12-09T10:56:29.220 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:29 +0000 (0:00:00.045) 0:00:06.159 ******* 2019-12-09T10:56:29.749 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi146.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:29.792 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0C 2019-12-09T10:56:29.793 INFO:teuthology.task.ansible.out:dXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:30.099 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:30.135 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:30.374 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:30.500 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:30.700 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:30.796 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:30.983 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:31.078 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:31.321 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:31.399 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:31.661 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:31.664 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T10:56:31.824 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** 2019-12-09T10:56:31.825 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2019-12-09T10:56:31.830 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-12-09T10:56:32.019 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:32 +0000 (0:00:02.798) 0:00:08.958 ******* 2019-12-09T10:56:32.053 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:32 +0000 (0:00:00.033) 0:00:08.992 ******* 2019-12-09T10:56:32.974 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi146.front.sepia.ceph.com] 2019-12-09T10:56:33.070 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-12-09T10:56:33.072 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:33 +0000 (0:00:01.017) 0:00:10.010 ******* 2019-12-09T10:56:33.083 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] 2019-12-09T10:56:33.178 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:33 +0000 (0:00:00.107) 0:00:10.117 ******* 2019-12-09T10:56:33.589 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-12-09T10:56:33.590 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.212705", "end": "2019-12-09 10:56:33.566082", "rc": 0, "start": "2019-12-09 10:56:33.353377", "stderr": "", "stderr_lines": [], "stdout": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "stdout_lines": ["2c3c6d863a854d6a1e155fc475e8273d88b91491"]} 2019-12-09T10:56:33.633 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:33 +0000 (0:00:00.454) 0:00:10.572 ******* 2019-12-09T10:56:33.640 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.228244", "end": "2019-12-09 10:56:33.597073", "rc": 0, "start": "2019-12-09 10:56:33.368829", "stderr": "", "stderr_lines": [], "stdout": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "stdout_lines": ["2c3c6d863a854d6a1e155fc475e8273d88b91491"]} 2019-12-09T10:56:33.682 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:33 +0000 (0:00:00.048) 0:00:10.621 ******* 2019-12-09T10:56:33.980 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-12-09T10:56:33.981 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016099", "end": "2019-12-09 10:56:33.947338", "failed_when_result": false, "rc": 0, "start": "2019-12-09 10:56:33.931239", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-09T10:56:34.027 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.345) 0:00:10.966 ******* 2019-12-09T10:56:34.034 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010403", "end": "2019-12-09 10:56:33.988595", "failed_when_result": false, "rc": 0, "start": "2019-12-09 10:56:33.978192", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-09T10:56:34.074 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.046) 0:00:11.013 ******* 2019-12-09T10:56:34.079 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-12-09T10:56:34.080 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:56:34.117 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.043) 0:00:11.056 ******* 2019-12-09T10:56:34.131 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:56:34.163 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.045) 0:00:11.102 ******* 2019-12-09T10:56:34.169 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-09T10:56:34.171 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:56:34.232 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.069) 0:00:11.171 ******* 2019-12-09T10:56:34.238 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:56:34.281 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.048) 0:00:11.220 ******* 2019-12-09T10:56:34.287 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-12-09T10:56:34.288 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:56:34.327 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.045) 0:00:11.266 ******* 2019-12-09T10:56:34.333 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:56:34.375 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.048) 0:00:11.314 ******* 2019-12-09T10:56:34.384 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-12-09T10:56:34.386 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:56:34.421 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.046) 0:00:11.361 ******* 2019-12-09T10:56:34.428 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:56:34.470 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.048) 0:00:11.409 ******* 2019-12-09T10:56:34.475 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-12-09T10:56:34.476 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:56:34.514 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.043) 0:00:11.453 ******* 2019-12-09T10:56:34.520 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:56:34.561 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.047) 0:00:11.500 ******* 2019-12-09T10:56:34.839 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-12-09T10:56:34.841 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T10:56:34.880 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.318) 0:00:11.819 ******* 2019-12-09T10:56:34.889 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T10:56:34.929 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:56:34 +0000 (0:00:00.048) 0:00:11.868 ******* 2019-12-09T10:56:35.301 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-09T10:56:35.303 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-09T10:56:35.314 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-09T10:56:35.580 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-09T10:56:35.641 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-09T10:56:35.920 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-09T10:56:35.974 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-09T10:56:36.240 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-09T10:56:36.306 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-09T10:56:36.552 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-09T10:56:36.610 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-09T10:56:36.908 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-09T10:56:36.963 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-09T10:56:37.252 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-09T10:56:37.317 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-09T10:56:37.597 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-09T10:56:37.599 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-09T10:56:37.909 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-09T10:56:37.911 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-09T10:56:38.190 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-09T10:56:38.255 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-09T10:56:38.530 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-09T10:56:38.573 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-09T10:56:38.863 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-09T10:56:38.920 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-09T10:56:39.181 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-09T10:56:39.224 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-09T10:56:39.526 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-09T10:56:39.560 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-09T10:56:39.869 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-09T10:56:39.890 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-09T10:56:40.207 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-09T10:56:40.219 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-09T10:56:40.498 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-09T10:56:40.565 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-09T10:56:40.847 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-09T10:56:40.922 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-09T10:56:41.173 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-09T10:56:41.248 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-09T10:56:41.448 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-09T10:56:41.532 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-09T10:56:41.701 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-09T10:56:41.837 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-09T10:56:42.036 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-09T10:56:42.204 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-09T10:56:42.301 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-09T10:56:42.526 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-09T10:56:42.645 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-09T10:56:42.823 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-09T10:56:42.983 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-09T10:56:43.099 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-09T10:56:43.351 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-09T10:56:43.393 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-09T10:56:43.656 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-09T10:56:43.733 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-09T10:56:44.008 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-09T10:56:44.031 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-09T10:56:44.362 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-09T10:56:44.374 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-09T10:56:44.697 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-09T10:56:44.710 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-09T10:56:45.035 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-09T10:56:45.067 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-09T10:56:45.320 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-09T10:56:45.395 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-09T10:56:45.628 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-09T10:56:45.715 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-09T10:56:45.966 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-09T10:56:46.050 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-09T10:56:46.302 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-09T10:56:46.367 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-09T10:56:46.642 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-09T10:56:46.720 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-09T10:56:46.949 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-09T10:56:47.081 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-09T10:56:47.261 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-09T10:56:47.386 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-09T10:56:47.616 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-09T10:56:47.680 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-09T10:56:47.964 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-09T10:56:48.283 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-09T10:56:48.305 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-09T10:56:48.632 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-09T10:56:48.644 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-09T10:56:48.963 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-09T10:56:48.985 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-09T10:56:49.297 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-09T10:56:49.351 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-09T10:56:49.649 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-09T10:56:49.692 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-09T10:56:50.006 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-09T10:56:50.007 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-09T10:56:50.328 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-09T10:56:50.350 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-09T10:56:50.684 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-09T10:56:50.685 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-09T10:56:51.014 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-09T10:56:51.025 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-09T10:56:51.310 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-09T10:56:51.332 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-09T10:56:51.634 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-09T10:56:51.656 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-09T10:56:51.947 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-09T10:56:52.000 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-09T10:56:52.253 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-09T10:56:52.344 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-09T10:56:52.572 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-09T10:56:52.667 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-09T10:56:52.908 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-09T10:56:53.003 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-09T10:56:53.253 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-09T10:56:53.348 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-09T10:56:53.598 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-09T10:56:53.693 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-09T10:56:53.904 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-09T10:56:54.042 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-09T10:56:54.262 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-09T10:56:54.381 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-09T10:56:54.569 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-09T10:56:54.705 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-09T10:56:54.928 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-09T10:56:55.032 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-09T10:56:55.232 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-09T10:56:55.380 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-09T10:56:55.568 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-09T10:56:55.698 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-09T10:56:55.908 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-09T10:56:56.046 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-09T10:56:56.244 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-09T10:56:56.389 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-09T10:56:56.570 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-09T10:56:56.696 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-09T10:56:56.894 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-09T10:56:57.061 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-09T10:56:57.182 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-09T10:56:57.412 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-09T10:56:57.508 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-09T10:56:57.753 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-09T10:56:57.858 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-09T10:56:57.860 INFO:teuthology.task.ansible.out: 2019-12-09T10:56:58.083 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-09T10:56:58.198 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-09T10:56:58.408 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-09T10:56:58.496 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-09T10:56:58.727 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-09T10:56:58.812 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-09T10:56:58.813 INFO:teuthology.task.ansible.out: 2019-12-09T10:56:59.078 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-09T10:56:59.080 INFO:teuthology.task.ansible.out: 2019-12-09T10:56:59.143 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-09T10:56:59.145 INFO:teuthology.task.ansible.out: 2019-12-09T10:56:59.399 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-09T10:56:59.472 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-09T10:56:59.712 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-09T10:56:59.817 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-09T10:57:00.048 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-09T10:57:00.153 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-09T10:57:00.383 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-09T10:57:00.500 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-09T10:57:00.724 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-09T10:57:00.850 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-09T10:57:01.072 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-09T10:57:01.188 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-09T10:57:01.421 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-09T10:57:01.563 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-09T10:57:01.773 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-09T10:57:01.878 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-09T10:57:02.098 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-09T10:57:02.225 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-09T10:57:02.433 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-09T10:57:02.569 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-09T10:57:02.759 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-09T10:57:02.907 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-09T10:57:03.115 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-09T10:57:03.223 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-09T10:57:03.478 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-09T10:57:03.558 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-09T10:57:03.817 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-09T10:57:03.912 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-09T10:57:04.145 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-09T10:57:04.273 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-09T10:57:04.505 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-09T10:57:04.620 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-09T10:57:04.854 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-09T10:57:04.939 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-09T10:57:05.183 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-09T10:57:05.186 INFO:teuthology.task.ansible.out: 2019-12-09T10:57:05.305 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-09T10:57:05.535 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-09T10:57:05.653 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-09T10:57:05.863 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-09T10:57:06.010 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-09T10:57:06.211 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-09T10:57:06.345 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-09T10:57:06.564 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-09T10:57:06.669 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-09T10:57:06.909 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-09T10:57:07.013 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-09T10:57:07.254 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-09T10:57:07.381 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-09T10:57:07.613 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-09T10:57:07.707 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-09T10:57:07.959 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-09T10:57:08.022 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-09T10:57:08.310 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-09T10:57:08.373 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-09T10:57:08.648 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-09T10:57:08.692 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-09T10:57:08.979 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-09T10:57:09.033 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-09T10:57:09.335 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-09T10:57:09.379 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-09T10:57:09.687 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-09T10:57:10.084 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-09T10:57:10.226 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:10 +0000 (0:00:35.297) 0:00:47.165 ******* 2019-12-09T10:57:10.257 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-09T10:57:10.295 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:10 +0000 (0:00:00.069) 0:00:47.235 ******* 2019-12-09T10:57:10.358 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-09T10:57:10.366 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-09T10:57:10.367 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-09T10:57:10.369 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-09T10:57:10.370 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-09T10:57:10.372 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-09T10:57:10.373 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa 2019-12-09T10:57:10.375 INFO:teuthology.task.ansible.out:8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f 2019-12-09T10:57:10.376 INFO:teuthology.task.ansible.out:826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7 2019-12-09T10:57:10.377 INFO:teuthology.task.ansible.out:fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "s 2019-12-09T10:57:10.379 INFO:teuthology.task.ansible.out:just", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G7 2019-12-09T10:57:10.380 INFO:teuthology.task.ansible.out:5M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-12-09T10:57:10.382 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ changed: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-09T10:57:10.450 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:10 +0000 (0:00:00.154) 0:00:47.389 ******* 2019-12-09T10:57:10.565 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:10 +0000 (0:00:00.115) 0:00:47.505 ******* 2019-12-09T10:57:10.593 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-09T10:57:10.630 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:10 +0000 (0:00:00.064) 0:00:47.569 ******* 2019-12-09T10:57:10.700 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-09T10:57:10.705 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-09T10:57:10.706 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-09T10:57:10.708 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-09T10:57:10.709 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-09T10:57:10.710 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-09T10:57:10.712 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6c 2019-12-09T10:57:10.713 INFO:teuthology.task.ansible.out:GN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq 2019-12-09T10:57:10.714 INFO:teuthology.task.ansible.out:1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7 2019-12-09T10:57:10.716 INFO:teuthology.task.ansible.out:ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif" 2019-12-09T10:57:10.717 INFO:teuthology.task.ansible.out:, "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "o 2019-12-09T10:57:10.719 INFO:teuthology.task.ansible.out:vpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-12-09T10:57:10.755 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:10 +0000 (0:00:00.125) 0:00:47.694 ******* 2019-12-09T10:57:10.756 INFO:teuthology.task.ansible.out: 2019-12-09T10:57:11.425 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi146.front.sepia.ceph.com -> localhost] => {"after": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "attempts": 1, "before": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "changed": false, "remote_url_changed": false} ok: [smithi194.front.sepia.ceph.com -> localhost] => {"after": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "attempts": 1, "before": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "changed": false, "remote_url_changed": false} 2019-12-09T10:57:11.464 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:11 +0000 (0:00:00.708) 0:00:48.403 ******* 2019-12-09T10:57:11.466 INFO:teuthology.task.ansible.out: 2019-12-09T10:57:11.508 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:11 +0000 (0:00:00.044) 0:00:48.448 ******* 2019-12-09T10:57:11.510 INFO:teuthology.task.ansible.out: 2019-12-09T10:57:11.861 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-09T10:57:11.863 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-09T10:57:11.895 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-09T10:57:12.232 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-09T10:57:12.233 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-09T10:57:12.584 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-09T10:57:12.607 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-09T10:57:12.944 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-09T10:57:12.966 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-09T10:57:13.271 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-09T10:57:13.272 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-09T10:57:13.282 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-09T10:57:13.284 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-09T10:57:13.597 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-09T10:57:13.623 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-09T10:57:13.952 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-09T10:57:13.954 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-09T10:57:13.960 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-09T10:57:13.961 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-09T10:57:14.287 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-09T10:57:14.354 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-09T10:57:14.663 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-09T10:57:14.676 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:14.712 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-09T10:57:14.713 INFO:teuthology.task.ansible.out: 2019-12-09T10:57:14.724 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdm 2019-12-09T10:57:14.726 INFO:teuthology.task.ansible.out:QZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:15.029 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-09T10:57:15.031 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-09T10:57:15.040 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:15.051 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:15.062 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:15.094 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-09T10:57:15.096 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:15.127 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:15.128 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:15.422 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-09T10:57:15.500 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-09T10:57:15.809 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-09T10:57:15.811 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-09T10:57:15.834 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-09T10:57:15.835 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-09T10:57:16.160 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-09T10:57:16.171 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-09T10:57:16.518 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-09T10:57:16.530 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-09T10:57:16.857 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-09T10:57:16.875 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-09T10:57:17.208 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": 2019-12-09T10:57:17.209 INFO:teuthology.task.ansible.out: "ivancich", "validate_certs": true} 2019-12-09T10:57:17.513 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-09T10:57:17.524 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-09T10:57:17.863 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-09T10:57:17.885 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-09T10:57:18.223 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-09T10:57:18.224 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467 2019-12-09T10:57:18.226 INFO:teuthology.task.ansible.out:\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-09T10:57:18.548 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-09T10:57:18.549 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-09T10:57:18.591 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-09T10:57:18.593 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-09T10:57:18.886 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-09T10:57:18.950 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-09T10:57:19.228 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-09T10:57:19.277 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-09T10:57:19.593 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-09T10:57:19.595 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AA 2019-12-09T10:57:19.596 INFO:teuthology.task.ansible.out:AAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-09T10:57:19.936 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-09T10:57:19.937 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-09T10:57:20.269 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-09T10:57:20.280 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-09T10:57:20.633 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-09T10:57:20.655 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-09T10:57:20.952 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-09T10:57:21.028 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-09T10:57:21.318 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-09T10:57:21.380 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-09T10:57:21.662 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-09T10:57:21.664 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-09T10:57:21.707 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-09T10:57:21.708 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-09T10:57:22.034 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-09T10:57:22.045 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-09T10:57:22.361 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-09T10:57:22.373 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-09T10:57:22.689 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-09T10:57:22.744 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-09T10:57:23.032 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-09T10:57:23.106 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-09T10:57:23.366 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-09T10:57:23.472 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-09T10:57:23.717 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-09T10:57:23.804 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-09T10:57:24.054 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-09T10:57:24.134 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-09T10:57:24.393 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-09T10:57:24.478 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-09T10:57:24.734 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-09T10:57:24.840 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-09T10:57:25.074 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-09T10:57:25.075 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-09T10:57:25.193 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-09T10:57:25.194 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-09T10:57:25.391 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-09T10:57:25.393 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-09T10:57:25.552 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-09T10:57:25.553 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-09T10:57:25.717 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-09T10:57:25.911 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-09T10:57:26.029 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-09T10:57:26.280 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-09T10:57:26.365 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-09T10:57:26.612 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-09T10:57:26.759 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-09T10:57:26.761 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-09T10:57:26.981 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-09T10:57:26.983 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-09T10:57:27.137 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-09T10:57:27.139 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-09T10:57:27.140 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-09T10:57:27.322 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-09T10:57:27.323 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-09T10:57:27.325 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-09T10:57:27.468 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-09T10:57:27.671 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-09T10:57:27.834 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-09T10:57:28.011 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-09T10:57:28.181 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-09T10:57:28.348 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-09T10:57:28.526 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-09T10:57:28.701 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-09T10:57:28.892 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-09T10:57:29.037 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-09T10:57:29.261 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-09T10:57:29.384 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-09T10:57:29.639 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-09T10:57:29.735 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-09T10:57:29.966 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-09T10:57:30.086 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-09T10:57:30.330 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-09T10:57:30.331 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-09T10:57:30.425 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-09T10:57:30.427 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-09T10:57:30.658 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-09T10:57:30.787 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-09T10:57:30.990 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-09T10:57:31.180 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-09T10:57:31.327 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-09T10:57:31.329 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-09T10:57:31.521 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-09T10:57:31.523 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-09T10:57:31.677 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-09T10:57:31.857 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-09T10:57:32.017 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-09T10:57:32.178 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-09T10:57:32.350 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-09T10:57:32.508 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-09T10:57:32.689 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-09T10:57:32.828 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-09T10:57:33.029 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-09T10:57:33.155 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-09T10:57:33.361 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-09T10:57:33.503 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-09T10:57:33.723 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-09T10:57:33.832 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-09T10:57:34.053 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-09T10:57:34.169 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-09T10:57:34.382 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-09T10:57:34.488 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-09T10:57:34.729 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-09T10:57:34.829 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-09T10:57:35.088 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-09T10:57:35.148 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-09T10:57:35.399 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-09T10:57:35.503 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-09T10:57:35.722 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-09T10:57:35.857 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-09T10:57:36.088 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-09T10:57:36.193 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-09T10:57:36.447 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-09T10:57:36.541 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-09T10:57:36.783 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-09T10:57:36.898 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-09T10:57:37.151 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-09T10:57:37.239 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-09T10:57:37.514 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-09T10:57:37.569 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-09T10:57:37.860 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-09T10:57:37.923 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-09T10:57:38.159 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-09T10:57:38.288 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-09T10:57:38.514 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-09T10:57:38.629 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-09T10:57:38.858 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-09T10:57:38.963 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-09T10:57:39.215 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-09T10:57:39.278 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-09T10:57:39.550 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-09T10:57:39.640 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-09T10:57:39.879 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-09T10:57:39.948 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-09T10:57:40.213 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-09T10:57:40.244 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-09T10:57:40.297 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-09T10:57:40.298 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-09T10:57:40.519 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-09T10:57:40.521 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-09T10:57:40.644 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-09T10:57:40.645 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-09T10:57:40.862 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-09T10:57:40.988 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-09T10:57:41.206 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-09T10:57:41.334 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-09T10:57:41.544 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-09T10:57:41.661 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-09T10:57:41.891 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-09T10:57:41.987 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-09T10:57:42.232 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-09T10:57:42.353 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-09T10:57:42.567 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-09T10:57:42.711 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-09T10:57:42.901 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-09T10:57:43.069 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-09T10:57:43.249 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-09T10:57:43.377 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-09T10:57:43.576 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-09T10:57:43.738 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-09T10:57:43.905 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-09T10:57:44.085 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-09T10:57:44.285 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-09T10:57:44.426 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-09T10:57:44.638 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-09T10:57:44.800 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-09T10:57:44.953 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-09T10:57:45.166 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-09T10:57:45.294 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-09T10:57:45.528 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-09T10:57:45.637 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnF 2019-12-09T10:57:45.639 INFO:teuthology.task.ansible.out:eEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-09T10:57:45.880 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-09T10:57:45.881 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-09T10:57:45.995 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-09T10:57:46.235 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-09T10:57:46.339 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-09T10:57:46.453 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:46 +0000 (0:00:34.944) 0:01:23.392 ******* 2019-12-09T10:57:46.501 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-09T10:57:46.502 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.513 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.513 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.524 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.535 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.549 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.560 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.571 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.593 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.594 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-09T10:57:46.886 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:46 +0000 (0:00:00.432) 0:01:23.825 ******* 2019-12-09T10:57:46.890 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-09T10:57:46.891 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-09T10:57:46.895 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.930 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.952 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.953 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.963 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.974 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.975 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.986 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:46.997 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:47.009 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:47.208 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-09T10:57:47.367 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-09T10:57:47.378 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:47.567 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-09T10:57:47.703 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-09T10:57:47.914 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-09T10:57:47.936 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:47.938 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:47.960 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:47.974 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:47.983 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:47.995 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:47.996 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.007 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.019 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.031 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.046 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.047 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.062 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-09T10:57:48.067 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.068 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.069 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.079 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.101 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.113 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.125 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.126 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.137 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.148 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.149 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.160 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.171 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.183 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.185 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.198 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.210 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.211 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.222 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.233 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.244 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.245 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.256 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.267 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.279 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.290 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.303 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.312 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.324 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.336 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.346 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.357 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.369 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.370 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.382 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.394 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.395 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.407 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-09T10:57:48.410 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.410 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.412 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.423 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.435 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.435 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.437 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.448 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.462 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.470 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.471 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.473 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.483 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.485 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.496 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.496 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.507 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.508 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.510 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.520 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.521 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.532 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.533 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.534 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.545 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.546 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.548 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.558 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.569 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.570 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.572 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.587 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.588 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.589 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.600 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.600 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.612 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.613 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.634 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.635 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.637 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.638 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.639 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.641 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.655 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.656 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.658 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.675 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.684 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.696 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.708 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.709 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.711 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.727 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.728 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.739 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.740 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.742 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.743 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.756 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.765 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.766 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.767 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.769 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.778 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.779 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.810 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.811 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.812 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.863 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:48 +0000 (0:00:01.977) 0:01:25.802 ******* 2019-12-09T10:57:48.881 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.884 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.885 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.895 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSab 2019-12-09T10:57:48.897 INFO:teuthology.task.ansible.out:vEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.901 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.913 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.914 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.924 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.926 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.961 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:48 +0000 (0:00:00.098) 0:01:25.901 ******* 2019-12-09T10:57:48.967 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.968 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.970 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.973 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.973 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.985 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:48.996 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.007 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.022 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.036 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.044 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.045 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.066 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.066 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.077 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.092 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.093 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.104 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.115 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.126 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.147 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.148 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.158 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.169 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.184 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.192 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.192 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.204 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.215 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.226 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.344 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi146.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-09T10:57:49.353 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.364 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.385 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.396 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.397 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.408 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.420 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.481 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:49 +0000 (0:00:00.519) 0:01:26.420 ******* 2019-12-09T10:57:49.507 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-12-09T10:57:49.509 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:57:49.554 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:57:49 +0000 (0:00:00.073) 0:01:26.494 ******* 2019-12-09T10:57:49.696 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-09T10:57:49.698 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-09T10:57:49.934 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-09T10:57:50.009 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-09T10:57:50.253 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-09T10:57:50.320 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-09T10:57:50.573 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-09T10:57:50.650 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-09T10:57:50.888 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-09T10:57:50.974 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-09T10:57:50.976 INFO:teuthology.task.ansible.out: 2019-12-09T10:57:51.198 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-09T10:57:51.283 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-09T10:57:51.513 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-09T10:57:51.577 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-09T10:57:51.592 INFO:teuthology.task.ansible.out: 2019-12-09T10:57:51.866 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-09T10:57:51.941 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-09T10:57:52.179 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-09T10:57:52.282 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-09T10:57:52.502 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-09T10:57:52.618 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-09T10:57:52.818 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-09T10:57:52.965 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-09T10:57:53.155 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-09T10:57:53.296 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-09T10:57:53.475 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-09T10:57:53.632 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-09T10:57:53.792 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-09T10:57:53.978 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-09T10:57:54.131 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-09T10:57:54.267 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-09T10:57:54.477 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-09T10:57:54.586 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-09T10:57:54.786 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-09T10:57:54.873 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-09T10:57:55.137 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-09T10:57:55.201 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-09T10:57:55.447 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-09T10:57:55.532 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-09T10:57:55.773 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-09T10:57:55.868 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-09T10:57:56.091 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-09T10:57:56.458 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-09T10:57:56.470 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-09T10:57:57.061 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-09T10:57:57.094 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-09T10:57:57.655 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-09T10:57:57.657 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-09T10:57:58.166 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} changed: [smithi194.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-09T10:57:58.707 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-09T10:57:58.740 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-09T10:57:59.268 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-09T10:57:59.301 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-09T10:57:59.843 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-09T10:57:59.866 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-09T10:58:00.394 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-09T10:58:00.437 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-09T10:58:00.980 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-09T10:58:01.044 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-09T10:58:01.540 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-09T10:58:01.635 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-09T10:58:02.072 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-09T10:58:02.168 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-09T10:58:02.679 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-09T10:58:02.721 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-09T10:58:03.050 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-09T10:58:03.260 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-09T10:58:03.356 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-09T10:58:03.588 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-09T10:58:03.672 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-09T10:58:03.890 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-09T10:58:04.026 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-09T10:58:04.192 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-09T10:58:04.365 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-09T10:58:04.531 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-09T10:58:04.709 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-09T10:58:04.858 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-09T10:58:05.045 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-09T10:58:05.190 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-09T10:58:05.542 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-09T10:58:05.656 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-09T10:58:05.751 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:05 +0000 (0:00:16.196) 0:01:42.690 ******* 2019-12-09T10:58:06.144 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-09T10:58:06.216 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:06 +0000 (0:00:00.462) 0:01:43.152 ******* 2019-12-09T10:58:06.782 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-09T10:58:06.784 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "checksum": "8a303ebcf60c08d57f11c57c9682a02d84685d0b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "c2805c19b557daad4717860e2c7029bc", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575889085.78-256256152172703/source", "state": "file", "uid": 0} 2019-12-09T10:58:06.839 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:06 +0000 (0:00:00.620) 0:01:43.778 ******* 2019-12-09T10:58:06.875 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-09T10:58:06.877 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => { "msg": "Host smithi146.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-09T10:58:06.923 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:06 +0000 (0:00:00.084) 0:01:43.863 ******* 2019-12-09T10:58:06.962 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-09T10:58:06.964 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-09T10:58:07.016 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.092) 0:01:43.955 ******* 2019-12-09T10:58:07.042 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-09T10:58:07.043 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:07.080 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.063) 0:01:44.019 ******* 2019-12-09T10:58:07.280 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-09T10:58:07.281 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "checksum": "8a303ebcf60c08d57f11c57c9682a02d84685d0b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "c2805c19b557daad4717860e2c7029bc", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575889086.24-61108354348456/source", "state": "file", "uid": 0} 2019-12-09T10:58:07.321 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.241) 0:01:44.260 ******* 2019-12-09T10:58:07.353 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-09T10:58:07.355 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => { "msg": "Host smithi194.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-09T10:58:07.395 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.074) 0:01:44.335 ******* 2019-12-09T10:58:07.433 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-09T10:58:07.434 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-09T10:58:07.474 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.078) 0:01:44.413 ******* 2019-12-09T10:58:07.498 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-09T10:58:07.498 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.107406", "end": "2019-12-09 10:58:07.452179", "rc": 0, "start": "2019-12-09 10:58:07.344773", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-09T10:58:07.500 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:07.536 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.062) 0:01:44.475 ******* 2019-12-09T10:58:07.571 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.034) 0:01:44.510 ******* 2019-12-09T10:58:07.575 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-09T10:58:07.576 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:07.616 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.045) 0:01:44.555 ******* 2019-12-09T10:58:07.653 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:07.695 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.078) 0:01:44.634 ******* 2019-12-09T10:58:07.723 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-09T10:58:07.724 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:07.763 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.068) 0:01:44.702 ******* 2019-12-09T10:58:07.793 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-09T10:58:07.794 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:07.833 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.069) 0:01:44.772 ******* 2019-12-09T10:58:07.860 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-09T10:58:07.861 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:07.904 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.070) 0:01:44.843 ******* 2019-12-09T10:58:07.942 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-09T10:58:07.943 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:07.987 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:07 +0000 (0:00:00.082) 0:01:44.926 ******* 2019-12-09T10:58:08.014 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-09T10:58:08.016 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.102616", "end": "2019-12-09 10:58:07.981410", "rc": 0, "start": "2019-12-09 10:58:07.878794", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-09T10:58:08.052 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.065) 0:01:44.991 ******* 2019-12-09T10:58:08.058 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-09T10:58:08.059 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T10:58:08.060 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T10:58:08.096 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.044) 0:01:45.035 ******* 2019-12-09T10:58:08.103 INFO:teuthology.task.ansible.out: 2019-12-09T10:58:08.104 INFO:teuthology.task.ansible.out:TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.141 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.044) 0:01:45.080 ******* 2019-12-09T10:58:08.146 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-09T10:58:08.150 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.192 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.051) 0:01:45.132 ******* 2019-12-09T10:58:08.198 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-09T10:58:08.200 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.237 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.044) 0:01:45.176 ******* 2019-12-09T10:58:08.244 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.281 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.044) 0:01:45.221 ******* 2019-12-09T10:58:08.287 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-09T10:58:08.289 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.329 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.047) 0:01:45.268 ******* 2019-12-09T10:58:08.334 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-09T10:58:08.335 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T10:58:08.373 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.043) 0:01:45.312 ******* 2019-12-09T10:58:08.380 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-09T10:58:08.382 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.419 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.046) 0:01:45.359 ******* 2019-12-09T10:58:08.427 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-12-09T10:58:08.428 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.466 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.046) 0:01:45.405 ******* 2019-12-09T10:58:08.472 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-09T10:58:08.474 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.517 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.050) 0:01:45.456 ******* 2019-12-09T10:58:08.522 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-09T10:58:08.528 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T10:58:08.569 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.052) 0:01:45.508 ******* 2019-12-09T10:58:08.576 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.614 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.044) 0:01:45.553 ******* 2019-12-09T10:58:08.619 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-09T10:58:08.622 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.667 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.053) 0:01:45.606 ******* 2019-12-09T10:58:08.673 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-09T10:58:08.674 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T10:58:08.675 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T10:58:08.712 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.045) 0:01:45.652 ******* 2019-12-09T10:58:08.723 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-09T10:58:08.725 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.764 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.051) 0:01:45.703 ******* 2019-12-09T10:58:08.773 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.815 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.050) 0:01:45.754 ******* 2019-12-09T10:58:08.821 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-09T10:58:08.823 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.861 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.046) 0:01:45.800 ******* 2019-12-09T10:58:08.870 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-09T10:58:08.871 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.911 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.050) 0:01:45.850 ******* 2019-12-09T10:58:08.917 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-09T10:58:08.919 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:08.958 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:08 +0000 (0:00:00.046) 0:01:45.897 ******* 2019-12-09T10:58:08.964 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi194.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T10:58:09.005 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.047) 0:01:45.944 ******* 2019-12-09T10:58:09.011 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-09T10:58:09.011 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T10:58:09.051 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.045) 0:01:45.990 ******* 2019-12-09T10:58:09.057 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.095 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.044) 0:01:46.034 ******* 2019-12-09T10:58:09.100 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-09T10:58:09.103 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.140 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.045) 0:01:46.080 ******* 2019-12-09T10:58:09.146 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-09T10:58:09.148 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T10:58:09.188 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.046) 0:01:46.126 ******* 2019-12-09T10:58:09.196 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.232 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.045) 0:01:46.172 ******* 2019-12-09T10:58:09.238 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-09T10:58:09.240 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.279 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.047) 0:01:46.219 ******* 2019-12-09T10:58:09.288 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.327 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.047) 0:01:46.266 ******* 2019-12-09T10:58:09.335 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-09T10:58:09.337 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.374 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.047) 0:01:46.313 ******* 2019-12-09T10:58:09.380 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-09T10:58:09.382 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.421 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.047) 0:01:46.360 ******* 2019-12-09T10:58:09.428 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-09T10:58:09.429 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.469 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.047) 0:01:46.408 ******* 2019-12-09T10:58:09.475 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-09T10:58:09.477 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.516 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.046) 0:01:46.454 ******* 2019-12-09T10:58:09.524 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-09T10:58:09.525 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.572 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.056) 0:01:46.511 ******* 2019-12-09T10:58:09.582 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.619 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.047) 0:01:46.559 ******* 2019-12-09T10:58:09.626 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-09T10:58:09.627 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T10:58:09.665 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.045) 0:01:46.604 ******* 2019-12-09T10:58:09.670 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-09T10:58:09.673 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T10:58:09.711 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.046) 0:01:46.650 ******* 2019-12-09T10:58:09.718 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-09T10:58:09.720 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.758 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.046) 0:01:46.697 ******* 2019-12-09T10:58:09.764 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-09T10:58:09.804 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.046) 0:01:46.743 ******* 2019-12-09T10:58:09.812 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-09T10:58:09.814 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.857 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.052) 0:01:46.796 ******* 2019-12-09T10:58:09.863 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-09T10:58:09.864 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.908 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.050) 0:01:46.847 ******* 2019-12-09T10:58:09.916 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:09.963 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:09 +0000 (0:00:00.055) 0:01:46.902 ******* 2019-12-09T10:58:10.000 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-09T10:58:10.002 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:10.041 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:10 +0000 (0:00:00.077) 0:01:46.980 ******* 2019-12-09T10:58:10.088 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-09T10:58:10.089 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:10.126 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:10 +0000 (0:00:00.085) 0:01:47.065 ******* 2019-12-09T10:58:10.164 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:10.201 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:10 +0000 (0:00:00.075) 0:01:47.141 ******* 2019-12-09T10:58:10.242 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-09T10:58:10.244 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T10:58:10.282 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:10 +0000 (0:00:00.080) 0:01:47.221 ******* 2019-12-09T10:58:10.289 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T10:58:10.335 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:10 +0000 (0:00:00.052) 0:01:47.274 ******* 2019-12-09T10:58:10.342 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-09T10:58:10.381 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:10 +0000 (0:00:00.046) 0:01:47.320 ******* 2019-12-09T10:58:10.429 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-09T10:58:10.431 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:10.467 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:10 +0000 (0:00:00.085) 0:01:47.406 ******* 2019-12-09T10:58:10.837 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-09T10:58:10.839 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T10:58:10.877 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:10 +0000 (0:00:00.409) 0:01:47.816 ******* 2019-12-09T10:58:11.685 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-09T10:58:11.686 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-09T10:58:11.878 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-09T10:58:11.880 INFO:teuthology.task.ansible.out: 2019-12-09T10:58:12.615 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-09T10:58:12.657 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:12 +0000 (0:00:01.780) 0:01:49.597 ******* 2019-12-09T10:58:12.806 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-09T10:58:12.858 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:12 +0000 (0:00:00.200) 0:01:49.797 ******* 2019-12-09T10:58:13.821 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-09T10:58:13.822 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575889092.7-83675538447861/source", "state": "file", "uid": 0} 2019-12-09T10:58:14.034 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575889092.9-149096892372848/source", "state": "file", "uid": 0} 2019-12-09T10:58:15.012 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575889093.84-151989610320996/source", "state": "file", "uid": 0} 2019-12-09T10:58:15.059 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:15 +0000 (0:00:02.201) 0:01:51.998 ******* 2019-12-09T10:58:15.181 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575889094.05-135578837359427/source", "state": "file", "uid": 0} 2019-12-09T10:58:15.222 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:15 +0000 (0:00:00.162) 0:01:52.161 ******* 2019-12-09T10:58:15.724 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-09T10:58:15.738 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-09T10:58:16.027 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-09T10:58:16.029 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-09T10:58:16.030 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-12-09T10:58:16.068 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:16 +0000 (0:00:00.846) 0:01:53.008 ******* 2019-12-09T10:58:16.100 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:16 +0000 (0:00:00.031) 0:01:53.040 ******* 2019-12-09T10:58:28.656 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-09T10:58:28.659 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:12.217946", "end": "2019-12-09 10:58:28.627394", "rc": 0, "start": "2019-12-09 10:58:16.409448", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.ash.fastserv.com\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.ash.fastserv.com", " * extras: mirrors.tripadvisor.com", " * updates: mirror.cogentco.com", "Metadata Cache Created"]} 2019-12-09T10:58:28.703 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:28 +0000 (0:00:12.602) 0:02:05.642 ******* 2019-12-09T10:58:29.043 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-09T10:58:29.043 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-09T10:58:29.365 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-09T10:58:29.413 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:29 +0000 (0:00:00.709) 0:02:06.351 ******* 2019-12-09T10:58:29.434 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-09T10:58:29.435 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:13.010880", "end": "2019-12-09 10:58:29.391942", "rc": 0, "start": "2019-12-09 10:58:16.381062", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.fileplanet.com\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.fileplanet.com", " * extras: mirrors.tripadvisor.com", " * updates: mirror.cogentco.com", "Metadata Cache Created"]} 2019-12-09T10:58:29.483 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:29 +0000 (0:00:00.070) 0:02:06.422 ******* 2019-12-09T10:58:29.489 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-09T10:58:29.491 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:29.528 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:29 +0000 (0:00:00.044) 0:02:06.467 ******* 2019-12-09T10:58:29.565 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-12-09T10:58:29.567 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:29.604 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:29 +0000 (0:00:00.076) 0:02:06.543 ******* 2019-12-09T10:58:29.645 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:29.684 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:29 +0000 (0:00:00.079) 0:02:06.623 ******* 2019-12-09T10:58:29.713 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:29.750 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:29 +0000 (0:00:00.065) 0:02:06.688 ******* 2019-12-09T10:58:29.776 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-09T10:58:29.778 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:29.819 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:29 +0000 (0:00:00.070) 0:02:06.759 ******* 2019-12-09T10:58:29.839 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-09T10:58:29.840 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-09T10:58:29.851 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-09T10:58:29.853 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:29.888 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:29 +0000 (0:00:00.068) 0:02:06.827 ******* 2019-12-09T10:58:29.916 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-09T10:58:29.921 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:29.954 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:29 +0000 (0:00:00.065) 0:02:06.893 ******* 2019-12-09T10:58:29.988 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-09T10:58:29.990 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:30.042 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:30 +0000 (0:00:00.087) 0:02:06.981 ******* 2019-12-09T10:58:30.176 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-09T10:58:30.341 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:30 +0000 (0:00:00.299) 0:02:07.281 ******* 2019-12-09T10:58:30.369 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-09T10:58:30.371 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:30.408 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:30 +0000 (0:00:00.066) 0:02:07.347 ******* 2019-12-09T10:58:30.435 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:30.473 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:30 +0000 (0:00:00.065) 0:02:07.413 ******* 2019-12-09T10:58:30.502 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-09T10:58:30.503 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:30.539 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:30 +0000 (0:00:00.065) 0:02:07.478 ******* 2019-12-09T10:58:30.566 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-09T10:58:30.567 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:30.604 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:30 +0000 (0:00:00.065) 0:02:07.543 ******* 2019-12-09T10:58:30.631 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-09T10:58:30.633 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:30.668 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:30 +0000 (0:00:00.064) 0:02:07.608 ******* 2019-12-09T10:58:30.695 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-09T10:58:30.697 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:30.735 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:30 +0000 (0:00:00.066) 0:02:07.674 ******* 2019-12-09T10:58:30.772 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:30.812 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:30 +0000 (0:00:00.077) 0:02:07.751 ******* 2019-12-09T10:58:30.849 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-09T10:58:30.851 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:30.888 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:30 +0000 (0:00:00.074) 0:02:07.826 ******* 2019-12-09T10:58:31.534 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-09T10:58:31.536 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.167399", "end": "2019-12-09 10:58:31.500450", "rc": 0, "start": "2019-12-09 10:58:30.333051", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T10:58:31.574 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:31 +0000 (0:00:00.686) 0:02:08.513 ******* 2019-12-09T10:58:32.315 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-09T10:58:32.317 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-09T10:58:32.354 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:32 +0000 (0:00:00.779) 0:02:09.293 ******* 2019-12-09T10:58:32.380 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-09T10:58:32.382 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:32.421 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:32 +0000 (0:00:00.067) 0:02:09.361 ******* 2019-12-09T10:58:32.448 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-09T10:58:32.450 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:32.488 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:32 +0000 (0:00:00.066) 0:02:09.427 ******* 2019-12-09T10:58:32.514 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-09T10:58:32.516 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:32.559 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:32 +0000 (0:00:00.070) 0:02:09.498 ******* 2019-12-09T10:58:32.572 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.335410", "end": "2019-12-09 10:58:32.500461", "rc": 0, "start": "2019-12-09 10:58:31.165051", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T10:58:32.617 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:32 +0000 (0:00:00.054) 0:02:09.552 ******* 2019-12-09T10:58:32.624 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:32.659 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:32 +0000 (0:00:00.046) 0:02:09.599 ******* 2019-12-09T10:58:33.114 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-09T10:58:33.114 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-09T10:58:33.156 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:33 +0000 (0:00:00.497) 0:02:10.096 ******* 2019-12-09T10:58:33.188 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-09T10:58:33.189 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:33.228 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:33 +0000 (0:00:00.071) 0:02:10.167 ******* 2019-12-09T10:58:33.254 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-09T10:58:33.256 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:33.290 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:33 +0000 (0:00:00.062) 0:02:10.230 ******* 2019-12-09T10:58:33.316 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-09T10:58:33.318 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:33.362 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:33 +0000 (0:00:00.071) 0:02:10.302 ******* 2019-12-09T10:58:33.392 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-09T10:58:33.394 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:33.431 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:33 +0000 (0:00:00.069) 0:02:10.371 ******* 2019-12-09T10:58:33.562 INFO:teuthology.task.ansible.out: 2019-12-09T10:58:33.566 INFO:teuthology.task.ansible.out:TASK [common : Add krb5 config file] ******************************************* ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-09T10:58:33.626 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:33 +0000 (0:00:00.194) 0:02:10.565 ******* 2019-12-09T10:58:34.405 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-09T10:58:34.442 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:34 +0000 (0:00:00.816) 0:02:11.381 ******* 2019-12-09T10:58:37.513 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-09T10:58:37.513 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-09T10:58:37.552 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:37 +0000 (0:00:03.109) 0:02:14.491 ******* 2019-12-09T10:58:38.285 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-09T10:58:38.332 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:38 +0000 (0:00:00.774) 0:02:15.266 ******* 2019-12-09T10:58:38.470 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-09T10:58:38.470 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-09T10:58:39.289 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-09T10:58:39.291 INFO:teuthology.task.ansible.out: 2019-12-09T10:58:39.320 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-09T10:58:40.168 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-09T10:58:40.219 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:40 +0000 (0:00:01.891) 0:02:17.158 ******* 2019-12-09T10:58:40.226 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-09T10:58:40.550 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-09T10:58:40.599 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:40 +0000 (0:00:00.380) 0:02:17.538 ******* 2019-12-09T10:58:41.168 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-09T10:58:41.169 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-09T10:58:41.214 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:41 +0000 (0:00:00.614) 0:02:18.153 ******* 2019-12-09T10:58:41.523 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-09T10:58:41.524 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-09T10:58:41.536 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-09T10:58:41.538 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-09T10:58:41.576 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:41 +0000 (0:00:00.361) 0:02:18.515 ******* 2019-12-09T10:58:42.398 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-09T10:58:42.398 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-09T10:58:42.575 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-09T10:58:43.250 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-09T10:58:43.292 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:43 +0000 (0:00:01.716) 0:02:20.231 ******* 2019-12-09T10:58:43.319 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-09T10:58:43.321 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:43.362 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:43 +0000 (0:00:00.069) 0:02:20.301 ******* 2019-12-09T10:58:43.401 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-09T10:58:43.402 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-09T10:58:43.449 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:43 +0000 (0:00:00.086) 0:02:20.388 ******* 2019-12-09T10:58:43.479 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-09T10:58:43.480 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-09T10:58:43.768 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-12-09T10:58:43.770 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-09T10:58:43.807 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:43 +0000 (0:00:00.358) 0:02:20.746 ******* 2019-12-09T10:58:43.854 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-09T10:58:43.856 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T10:58:43.866 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T10:58:43.877 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T10:58:43.888 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T10:58:43.927 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:43 +0000 (0:00:00.120) 0:02:20.867 ******* 2019-12-09T10:58:44.379 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi146.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-09T10:58:44.420 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:44 +0000 (0:00:00.492) 0:02:21.359 ******* 2019-12-09T10:58:44.447 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-09T10:58:44.449 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:44.485 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:44 +0000 (0:00:00.065) 0:02:21.425 ******* 2019-12-09T10:58:44.522 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-09T10:58:44.523 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-09T10:58:44.559 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:44 +0000 (0:00:00.073) 0:02:21.498 ******* 2019-12-09T10:58:44.902 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-12-09T10:58:44.903 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-09T10:58:44.953 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:44 +0000 (0:00:00.394) 0:02:21.892 ******* 2019-12-09T10:58:44.994 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-09T10:58:44.995 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T10:58:45.006 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T10:58:45.028 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T10:58:45.039 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T10:58:45.080 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:45 +0000 (0:00:00.127) 0:02:22.020 ******* 2019-12-09T10:58:47.346 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-09T10:58:47.347 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-09T10:58:47.384 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:47 +0000 (0:00:02.303) 0:02:24.324 ******* 2019-12-09T10:58:47.416 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-09T10:58:47.418 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:47.454 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:47 +0000 (0:00:00.068) 0:02:24.392 ******* 2019-12-09T10:58:48.380 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-09T10:58:48.381 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-09T10:58:48.419 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:48 +0000 (0:00:00.966) 0:02:25.359 ******* 2019-12-09T10:58:48.463 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-09T10:58:48.464 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-09T10:58:48.502 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:48 +0000 (0:00:00.082) 0:02:25.441 ******* 2019-12-09T10:58:48.528 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-09T10:58:48.530 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:48.566 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:48 +0000 (0:00:00.063) 0:02:25.505 ******* 2019-12-09T10:58:49.294 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-09T10:58:49.295 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-09T10:58:49.335 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:49 +0000 (0:00:00.768) 0:02:26.274 ******* 2019-12-09T10:58:49.361 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-09T10:58:49.362 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:49.400 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:49 +0000 (0:00:00.065) 0:02:26.339 ******* 2019-12-09T10:58:49.521 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-09T10:58:49.524 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-09T10:58:49.561 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:49 +0000 (0:00:00.161) 0:02:26.501 ******* 2019-12-09T10:58:49.735 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-09T10:58:49.736 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T10:58:49.773 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:49 +0000 (0:00:00.211) 0:02:26.713 ******* 2019-12-09T10:58:50.135 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-09T10:58:50.137 INFO:teuthology.task.ansible.out:fatal: [smithi194.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-09T10:58:50.176 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:50 +0000 (0:00:00.402) 0:02:27.115 ******* 2019-12-09T10:58:50.203 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-09T10:58:50.204 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:50.241 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:50 +0000 (0:00:00.064) 0:02:27.180 ******* 2019-12-09T10:58:50.515 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-09T10:58:50.516 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-09T10:58:50.560 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:50 +0000 (0:00:00.319) 0:02:27.499 ******* 2019-12-09T10:58:50.587 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-09T10:58:50.588 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:50.625 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:50 +0000 (0:00:00.065) 0:02:27.565 ******* 2019-12-09T10:58:50.962 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-09T10:58:50.964 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T10:58:51.003 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:50 +0000 (0:00:00.376) 0:02:27.941 ******* 2019-12-09T10:58:51.165 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-09T10:58:51.167 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-09T10:58:51.203 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:51 +0000 (0:00:00.200) 0:02:28.142 ******* 2019-12-09T10:58:51.381 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-09T10:58:51.382 INFO:teuthology.task.ansible.out:fatal: [smithi146.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-09T10:58:51.418 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:51 +0000 (0:00:00.215) 0:02:28.357 ******* 2019-12-09T10:58:51.455 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-09T10:58:51.457 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:58:51.493 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:51 +0000 (0:00:00.074) 0:02:28.432 ******* 2019-12-09T10:58:52.240 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-09T10:58:52.242 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-12-09 10:56:08 UTC", "ActiveEnterTimestampMonotonic": "19177728", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket local-fs.target time-sync.target basic.target nss-lookup.target network.target var-run.mount system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-12-09 10:56:08 UTC", "AssertTimestampMonotonic": "19176904", "Before": "shutdown.target multi-user.target xdm.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-12-09 10:56:08 UTC", "ConditionTimestampMonotonic": "19176904", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8950", "ExecMainStartTimestamp": "Mon 2019-12-09 10:56:08 UTC", "ExecMainStartTimestampMonotonic": "19177665", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-09T10:58:52.243 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Mon 2019-12-09 10:56:08 UTC] ; stop_time=[n/a] ; pid=8950 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-12-09 10:56:08 UTC", "InactiveExitTimestampMonotonic": "19177728", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8950", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-09T10:58:52.245 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Mon 2019-12-09 10:56:08 UTC", "WatchdogTimestampMonotonic": "19177704", "WatchdogUSec": "0"}} 2019-12-09T10:58:52.283 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:52 +0000 (0:00:00.790) 0:02:29.223 ******* 2019-12-09T10:58:52.414 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-09T10:58:52.415 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-09T10:58:52.455 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:52 +0000 (0:00:00.171) 0:02:29.394 ******* 2019-12-09T10:58:52.608 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-09T10:58:52.609 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004249", "end": "2019-12-09 10:58:52.585026", "rc": 0, "start": "2019-12-09 10:58:52.580777", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-09T10:58:52.649 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:52 +0000 (0:00:00.194) 0:02:29.589 ******* 2019-12-09T10:58:52.906 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-09T10:58:52.909 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-12-09 10:56:13 UTC", "ActiveEnterTimestampMonotonic": "21217496", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target system.slice systemd-journald.socket time-sync.target basic.target nss-lookup.target local-fs.target var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-12-09 10:56:13 UTC", "AssertTimestampMonotonic": "21216790", "Before": "shutdown.target multi-user.target getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-12-09 10:56:13 UTC", "ConditionTimestampMonotonic": "21216790", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8958", "ExecMainStartTimestamp": "Mon 2019-12-09 10:56:13 UTC", "ExecMainStartTimestampMonotonic": "21217447", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-09T10:58:52.910 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Mon 2019-12-09 10:56:13 UTC] ; stop_time=[n/a] ; pid=8958 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-12-09 10:56:13 UTC", "InactiveExitTimestampMonotonic": "21217496", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8958", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-09T10:58:52.912 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Mon 2019-12-09 10:56:13 UTC", "WatchdogTimestampMonotonic": "21217478", "WatchdogUSec": "0"}} 2019-12-09T10:58:52.946 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:52 +0000 (0:00:00.296) 0:02:29.885 ******* 2019-12-09T10:58:53.097 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-09T10:58:53.099 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-09T10:58:53.137 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:53 +0000 (0:00:00.190) 0:02:30.076 ******* 2019-12-09T10:58:53.270 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-09T10:58:53.270 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004520", "end": "2019-12-09 10:58:53.248276", "rc": 0, "start": "2019-12-09 10:58:53.243756", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-09T10:58:53.312 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:53 +0000 (0:00:00.172) 0:02:30.248 ******* 2019-12-09T10:58:53.805 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-09T10:58:53.806 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-09T10:58:53.846 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:58:53 +0000 (0:00:00.537) 0:02:30.786 ******* 2019-12-09T10:59:20.194 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-09T10:59:20.195 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.ash.fastserv.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-12-09T10:59:20.196 INFO:teuthology.task.ansible.out: 26 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-09T10:59:20.235 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:20 +0000 (0:00:26.388) 0:02:57.174 ******* 2019-12-09T10:59:20.899 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-09T10:59:20.900 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-09T10:59:20.937 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:20 +0000 (0:00:00.702) 0:02:57.877 ******* 2019-12-09T10:59:22.983 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-09T10:59:22.985 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.fileplanet.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-12-09T10:59:22.986 INFO:teuthology.task.ansible.out: 13 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-09T10:59:23.029 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:23 +0000 (0:00:02.090) 0:02:59.967 ******* 2019-12-09T10:59:23.601 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-09T10:59:23.603 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-09T10:59:23.647 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:23 +0000 (0:00:00.618) 0:03:00.586 ******* 2019-12-09T10:59:29.028 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-12-09T10:59:29.030 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.767896", "end": "2019-12-09 10:59:28.999421", "failed_when_result": false, "rc": 0, "start": "2019-12-09 10:59:21.231525", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-09T10:59:29.066 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:29 +0000 (0:00:05.419) 0:03:06.006 ******* 2019-12-09T10:59:29.979 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-09T10:59:29.981 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-09T10:59:30.016 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:30 +0000 (0:00:00.949) 0:03:06.955 ******* 2019-12-09T10:59:30.347 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-09T10:59:30.349 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.021614", "end": "2019-12-09 10:59:30.320142", "rc": 0, "start": "2019-12-09 10:59:30.298528", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-09T10:59:30.385 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:30 +0000 (0:00:00.368) 0:03:07.324 ******* 2019-12-09T10:59:30.724 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-09T10:59:30.726 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.017264", "end": "2019-12-09 10:59:30.702791", "rc": 0, "start": "2019-12-09 10:59:30.685527", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T10:59:30.766 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:30 +0000 (0:00:00.381) 0:03:07.705 ******* 2019-12-09T10:59:31.710 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-12-09T10:59:31.712 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.728098", "end": "2019-12-09 10:59:31.682568", "failed_when_result": false, "rc": 0, "start": "2019-12-09 10:59:23.954470", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-09T10:59:31.751 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:31 +0000 (0:00:00.985) 0:03:08.691 ******* 2019-12-09T10:59:32.633 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-09T10:59:32.635 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-09T10:59:32.682 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:32 +0000 (0:00:00.930) 0:03:09.621 ******* 2019-12-09T10:59:33.016 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-09T10:59:33.017 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.012965", "end": "2019-12-09 10:59:32.992037", "rc": 0, "start": "2019-12-09 10:59:32.979072", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-09T10:59:33.059 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:33 +0000 (0:00:00.376) 0:03:09.998 ******* 2019-12-09T10:59:33.408 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-09T10:59:33.410 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.021826", "end": "2019-12-09 10:59:33.378867", "rc": 0, "start": "2019-12-09 10:59:33.357041", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T10:59:33.449 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:33 +0000 (0:00:00.389) 0:03:10.388 ******* 2019-12-09T10:59:38.966 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.863905", "end": "2019-12-09 10:59:38.925901", "rc": 0, "start": "2019-12-09 10:59:31.061996", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T10:59:39.006 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:39 +0000 (0:00:05.557) 0:03:15.945 ******* 2019-12-09T10:59:39.390 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-09T10:59:39.391 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-09T10:59:39.431 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:39 +0000 (0:00:00.424) 0:03:16.370 ******* 2019-12-09T10:59:39.478 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-09T10:59:39.479 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-09T10:59:39.537 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:39 +0000 (0:00:00.097) 0:03:16.468 ******* 2019-12-09T10:59:39.567 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-09T10:59:39.569 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-09T10:59:39.608 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:39 +0000 (0:00:00.079) 0:03:16.547 ******* 2019-12-09T10:59:39.656 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-09T10:59:39.657 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-09T10:59:39.707 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:39 +0000 (0:00:00.099) 0:03:16.646 ******* 2019-12-09T10:59:39.747 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-09T10:59:39.749 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-09T10:59:39.795 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:39 +0000 (0:00:00.087) 0:03:16.734 ******* 2019-12-09T10:59:40.118 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-09T10:59:40.119 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-09T10:59:40.156 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:40 +0000 (0:00:00.361) 0:03:17.096 ******* 2019-12-09T10:59:40.461 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-09T10:59:40.463 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-09T10:59:40.500 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:40 +0000 (0:00:00.343) 0:03:17.440 ******* 2019-12-09T10:59:40.529 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-09T10:59:40.529 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:59:40.569 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:40 +0000 (0:00:00.068) 0:03:17.508 ******* 2019-12-09T10:59:40.597 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-09T10:59:40.599 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:59:40.640 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:40 +0000 (0:00:00.070) 0:03:17.579 ******* 2019-12-09T10:59:41.001 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-09T10:59:41.003 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-09T10:59:41.043 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:41 +0000 (0:00:00.402) 0:03:17.982 ******* 2019-12-09T10:59:41.466 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-09T10:59:41.467 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.673255", "end": "2019-12-09 10:59:41.438120", "rc": 0, "start": "2019-12-09 10:59:33.764865", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T10:59:41.509 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:41 +0000 (0:00:00.465) 0:03:18.448 ******* 2019-12-09T10:59:41.860 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-09T10:59:41.862 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-09T10:59:41.903 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:41 +0000 (0:00:00.393) 0:03:18.842 ******* 2019-12-09T10:59:41.940 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-09T10:59:41.941 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-09T10:59:41.982 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:41 +0000 (0:00:00.079) 0:03:18.921 ******* 2019-12-09T10:59:42.025 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-09T10:59:42.073 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:42 +0000 (0:00:00.091) 0:03:19.013 ******* 2019-12-09T10:59:42.111 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:42 +0000 (0:00:00.037) 0:03:19.050 ******* 2019-12-09T10:59:42.119 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-09T10:59:42.120 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-09T10:59:42.161 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:42 +0000 (0:00:00.050) 0:03:19.100 ******* 2019-12-09T10:59:42.168 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-09T10:59:42.169 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi194"}, "changed": false} 2019-12-09T10:59:42.215 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:42 +0000 (0:00:00.053) 0:03:19.154 ******* 2019-12-09T10:59:42.221 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-09T10:59:42.221 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-09T10:59:42.264 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:42 +0000 (0:00:00.048) 0:03:19.203 ******* 2019-12-09T10:59:42.611 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-09T10:59:42.612 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-09T10:59:42.650 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:42 +0000 (0:00:00.385) 0:03:19.589 ******* 2019-12-09T10:59:42.979 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-09T10:59:43.016 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:43 +0000 (0:00:00.365) 0:03:19.955 ******* 2019-12-09T10:59:43.043 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-09T10:59:43.044 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:59:43.078 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:43 +0000 (0:00:00.062) 0:03:20.018 ******* 2019-12-09T10:59:43.105 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-09T10:59:43.107 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:59:43.142 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:43 +0000 (0:00:00.063) 0:03:20.081 ******* 2019-12-09T10:59:43.225 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi194.front.sepia.ceph.com", "ansible_hostname": "smithi194", "ansible_nodename": "smithi194"}, "changed": true, "name": "smithi194"} 2019-12-09T10:59:43.262 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:43 +0000 (0:00:00.120) 0:03:20.201 ******* 2019-12-09T10:59:43.507 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-09T10:59:43.509 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-09T10:59:43.545 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:43 +0000 (0:00:00.283) 0:03:20.485 ******* 2019-12-09T10:59:44.130 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-09T10:59:44.131 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-09T10:59:44.171 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:44 +0000 (0:00:00.625) 0:03:21.110 ******* 2019-12-09T10:59:44.541 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-09T10:59:44.541 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-09T10:59:44.582 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:44 +0000 (0:00:00.411) 0:03:21.521 ******* 2019-12-09T10:59:44.621 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-09T10:59:44.622 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi146"}, "changed": false} 2019-12-09T10:59:44.666 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:44 +0000 (0:00:00.084) 0:03:21.605 ******* 2019-12-09T10:59:45.154 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-12-09T10:59:45.155 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-09T10:59:45.201 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:45 +0000 (0:00:00.534) 0:03:22.140 ******* 2019-12-09T10:59:45.207 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-09T10:59:45.208 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi146.front.sepia.ceph.com", "ansible_hostname": "smithi146", "ansible_nodename": "smithi146"}, "changed": true, "name": "smithi146"} 2019-12-09T10:59:45.249 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:45 +0000 (0:00:00.047) 0:03:22.188 ******* 2019-12-09T10:59:46.072 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-09T10:59:46.073 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-09T10:59:46.117 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:46 +0000 (0:00:00.868) 0:03:23.056 ******* 2019-12-09T10:59:46.176 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-09T10:59:46.177 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-09T10:59:46.216 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:46 +0000 (0:00:00.099) 0:03:23.156 ******* 2019-12-09T10:59:47.053 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-09T10:59:47.054 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-09T10:59:47.093 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:47 +0000 (0:00:00.876) 0:03:24.032 ******* 2019-12-09T10:59:47.099 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-12-09T10:59:47.099 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-09T10:59:47.140 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:47 +0000 (0:00:00.047) 0:03:24.080 ******* 2019-12-09T10:59:47.418 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-09T10:59:47.419 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-09T10:59:47.462 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:47 +0000 (0:00:00.321) 0:03:24.401 ******* 2019-12-09T10:59:47.795 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-09T10:59:47.797 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-09T10:59:47.851 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:47 +0000 (0:00:00.388) 0:03:24.790 ******* 2019-12-09T10:59:48.014 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-09T10:59:48.015 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-09T10:59:48.054 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:48 +0000 (0:00:00.203) 0:03:24.993 ******* 2019-12-09T10:59:48.229 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-09T10:59:48.230 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-09T10:59:48.279 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:48 +0000 (0:00:00.224) 0:03:25.218 ******* 2019-12-09T10:59:48.933 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-09T10:59:48.934 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-09T10:59:48.974 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:48 +0000 (0:00:00.695) 0:03:25.913 ******* 2019-12-09T10:59:49.181 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-09T10:59:49.182 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-09T10:59:49.223 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:49 +0000 (0:00:00.249) 0:03:26.163 ******* 2019-12-09T10:59:49.295 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-09T10:59:49.296 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-09T10:59:49.342 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:49 +0000 (0:00:00.119) 0:03:26.282 ******* 2019-12-09T10:59:49.670 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-09T10:59:49.671 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-09T10:59:49.709 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:49 +0000 (0:00:00.366) 0:03:26.648 ******* 2019-12-09T10:59:50.058 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-09T10:59:50.059 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-09T10:59:50.103 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:50 +0000 (0:00:00.394) 0:03:27.042 ******* 2019-12-09T10:59:50.120 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-09T10:59:50.121 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-09T10:59:50.160 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:50 +0000 (0:00:00.056) 0:03:27.099 ******* 2019-12-09T10:59:51.034 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-09T10:59:51.034 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-09T10:59:51.077 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:51 +0000 (0:00:00.916) 0:03:28.016 ******* 2019-12-09T10:59:52.004 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-09T10:59:52.005 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-09T10:59:52.044 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:52 +0000 (0:00:00.967) 0:03:28.983 ******* 2019-12-09T10:59:52.584 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-09T10:59:52.585 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.088909", "end": "2019-12-09 10:59:52.552249", "rc": 0, "start": "2019-12-09 10:59:50.463340", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T10:59:52.623 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:52 +0000 (0:00:00.578) 0:03:29.562 ******* 2019-12-09T10:59:52.653 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-09T10:59:52.688 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:52 +0000 (0:00:00.065) 0:03:29.628 ******* 2019-12-09T10:59:53.596 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-09T10:59:53.597 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-09T10:59:54.459 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-09T10:59:54.502 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:54 +0000 (0:00:01.813) 0:03:31.441 ******* 2019-12-09T10:59:54.508 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-09T10:59:54.509 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.122070", "end": "2019-12-09 10:59:54.450977", "rc": 0, "start": "2019-12-09 10:59:52.328907", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T10:59:54.547 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:54 +0000 (0:00:00.045) 0:03:31.487 ******* 2019-12-09T10:59:54.553 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-09T10:59:54.555 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:59:54.592 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:54 +0000 (0:00:00.044) 0:03:31.531 ******* 2019-12-09T10:59:54.598 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-09T10:59:54.638 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:54 +0000 (0:00:00.045) 0:03:31.577 ******* 2019-12-09T10:59:54.646 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-09T10:59:54.648 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-09T10:59:54.688 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:54 +0000 (0:00:00.049) 0:03:31.627 ******* 2019-12-09T10:59:54.717 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-09T10:59:54.718 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:59:54.755 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:54 +0000 (0:00:00.066) 0:03:31.694 ******* 2019-12-09T10:59:54.756 INFO:teuthology.task.ansible.out: 2019-12-09T10:59:54.792 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T10:59:54.793 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-09T10:59:54.831 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:54 +0000 (0:00:00.075) 0:03:31.770 ******* 2019-12-09T10:59:55.317 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-09T10:59:55.318 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-09T10:59:55.356 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:55 +0000 (0:00:00.525) 0:03:32.295 ******* 2019-12-09T10:59:55.514 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-09T10:59:55.515 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-09T10:59:56.019 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-09T10:59:56.020 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.338925", "end": "2019-12-09 10:59:55.991318", "rc": 0, "start": "2019-12-09 10:59:55.652393", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.ash.fastserv.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.ash.fastserv.com", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirrors.tripadvisor.com", " * updates: mirror.cogentco.com", "No unfinished transactions left."]} 2019-12-09T10:59:56.064 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:56 +0000 (0:00:00.707) 0:03:33.003 ******* 2019-12-09T10:59:56.366 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-09T10:59:56.368 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-09T10:59:56.418 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:56 +0000 (0:00:00.354) 0:03:33.357 ******* 2019-12-09T10:59:56.446 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-09T10:59:56.447 INFO:teuthology.task.ansible.out:fatal: [smithi194.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.052909", "end": "2019-12-09 10:59:56.413579", "msg": "non-zero return code", "rc": 1, "start": "2019-12-09 10:59:56.360670", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-12-09T10:59:56.449 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:59:56.487 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:56 +0000 (0:00:00.068) 0:03:33.426 ******* 2019-12-09T10:59:56.537 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:56 +0000 (0:00:00.050) 0:03:33.476 ******* 2019-12-09T10:59:56.545 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-09T10:59:56.546 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-09T10:59:56.548 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-09T10:59:56.588 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:56 +0000 (0:00:00.051) 0:03:33.527 ******* 2019-12-09T10:59:56.595 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-09T10:59:56.596 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:59:56.634 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:56 +0000 (0:00:00.046) 0:03:33.574 ******* 2019-12-09T10:59:56.644 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-09T10:59:56.644 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:59:56.682 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:56 +0000 (0:00:00.047) 0:03:33.622 ******* 2019-12-09T10:59:56.720 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T10:59:56.721 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-09T10:59:56.758 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:56 +0000 (0:00:00.075) 0:03:33.697 ******* 2019-12-09T10:59:57.258 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-09T10:59:57.295 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:57 +0000 (0:00:00.537) 0:03:34.235 ******* 2019-12-09T10:59:57.941 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-09T10:59:57.942 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.317674", "end": "2019-12-09 10:59:57.905707", "rc": 0, "start": "2019-12-09 10:59:57.588033", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.fileplanet.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.fileplanet.com", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirrors.tripadvisor.com", " * updates: mirror.cogentco.com", "No unfinished transactions left."]} 2019-12-09T10:59:57.987 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:57 +0000 (0:00:00.691) 0:03:34.926 ******* 2019-12-09T10:59:58.373 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-09T10:59:58.374 INFO:teuthology.task.ansible.out:fatal: [smithi146.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.056615", "end": "2019-12-09 10:59:58.347924", "msg": "non-zero return code", "rc": 1, "start": "2019-12-09 10:59:58.291309", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-12-09T10:59:58.413 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:58 +0000 (0:00:00.425) 0:03:35.352 ******* 2019-12-09T10:59:58.451 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-09T10:59:58.452 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T10:59:58.490 INFO:teuthology.task.ansible.out:Monday 09 December 2019 10:59:58 +0000 (0:00:00.077) 0:03:35.430 ******* 2019-12-09T11:00:04.890 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-09T11:00:04.892 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-12-09T11:00:04.893 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-12-09T11:00:04.895 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-09T11:00:04.932 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:04 +0000 (0:00:06.441) 0:03:41.871 ******* 2019-12-09T11:00:06.788 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependen 2019-12-09T11:00:06.795 INFO:teuthology.task.ansible.out:cy: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing 2019-12-09T11:00:06.796 INFO:teuthology.task.ansible.out:: 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-09T11:00:06.838 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:06 +0000 (0:00:01.905) 0:03:43.777 ******* 2019-12-09T11:00:08.270 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-09T11:00:08.271 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-09T11:00:08.316 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:08 +0000 (0:00:01.477) 0:03:45.255 ******* 2019-12-09T11:00:10.175 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-09T11:00:10.218 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:10 +0000 (0:00:01.902) 0:03:47.157 ******* 2019-12-09T11:00:28.479 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-09T11:00:28.480 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-12-09T11:00:28.482 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-12-09T11:00:28.483 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.ash.fastserv.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies 2019-12-09T11:00:28.485 INFO:teuthology.task.ansible.out:Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 3.0 MB/s | 8.1 MB 00:02 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-12-09T11:00:28.486 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.e 2019-12-09T11:00:28.487 INFO:teuthology.task.ansible.out:l7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-09T11:00:28.527 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:28 +0000 (0:00:18.309) 0:04:05.466 ******* 2019-12-09T11:00:28.969 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-12-09T11:00:28.970 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-12-09T11:00:28.972 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.fileplanet.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Re 2019-12-09T11:00:28.974 INFO:teuthology.task.ansible.out:solved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 9.7 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-12-09T11:00:28.975 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-09T11:00:29.017 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:29 +0000 (0:00:00.490) 0:04:05.956 ******* 2019-12-09T11:00:29.332 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-09T11:00:29.334 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-09T11:00:29.371 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:29 +0000 (0:00:00.353) 0:04:06.310 ******* 2019-12-09T11:00:29.784 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-09T11:00:29.819 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:29 +0000 (0:00:00.448) 0:04:06.759 ******* 2019-12-09T11:00:29.910 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-09T11:00:29.911 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-09T11:00:29.951 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:29 +0000 (0:00:00.131) 0:04:06.891 ******* 2019-12-09T11:00:29.990 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:30.034 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:30 +0000 (0:00:00.082) 0:04:06.973 ******* 2019-12-09T11:00:30.344 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-09T11:00:30.345 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-09T11:00:30.389 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:30 +0000 (0:00:00.347) 0:04:07.321 ******* 2019-12-09T11:00:30.409 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-09T11:00:30.411 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:30.447 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:30 +0000 (0:00:00.065) 0:04:07.387 ******* 2019-12-09T11:00:30.467 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-09T11:00:30.469 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target system.slice dbus.service polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ip6tables.service ipset.service iptables.service ebtables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-09T11:00:30.470 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-09T11:00:30.472 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "system.slice network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-09T11:00:30.508 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:30 +0000 (0:00:00.060) 0:04:07.447 ******* 2019-12-09T11:00:30.865 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice polkit.service dbus.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ipset.service shutdown.target ip6tables.service iptables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-09T11:00:30.867 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-09T11:00:30.868 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "system.slice network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-09T11:00:30.922 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:30 +0000 (0:00:00.414) 0:04:07.861 ******* 2019-12-09T11:00:30.928 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-12-09T11:00:30.929 INFO:teuthology.task.ansible.out:fatal: [smithi194.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-09T11:00:30.972 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:30 +0000 (0:00:00.050) 0:04:07.911 ******* 2019-12-09T11:00:31.340 INFO:teuthology.task.ansible.out:fatal: [smithi146.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-09T11:00:31.423 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:31 +0000 (0:00:00.451) 0:04:08.363 ******* 2019-12-09T11:00:31.785 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-12-09T11:00:31.787 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-09T11:00:31.826 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:31 +0000 (0:00:00.400) 0:04:08.763 ******* 2019-12-09T11:00:31.832 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-09T11:00:31.879 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:31 +0000 (0:00:00.054) 0:04:08.818 ******* 2019-12-09T11:00:31.886 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-09T11:00:31.888 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:31.929 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:31 +0000 (0:00:00.049) 0:04:08.868 ******* 2019-12-09T11:00:31.936 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:31.982 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:31 +0000 (0:00:00.052) 0:04:08.921 ******* 2019-12-09T11:00:31.987 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-09T11:00:32.026 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.044) 0:04:08.966 ******* 2019-12-09T11:00:32.073 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.046) 0:04:09.012 ******* 2019-12-09T11:00:32.080 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-12-09T11:00:32.082 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.125 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.046) 0:04:09.058 ******* 2019-12-09T11:00:32.127 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.169 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.050) 0:04:09.109 ******* 2019-12-09T11:00:32.176 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-12-09T11:00:32.177 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.216 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.046) 0:04:09.155 ******* 2019-12-09T11:00:32.227 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.268 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.051) 0:04:09.207 ******* 2019-12-09T11:00:32.274 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-09T11:00:32.274 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.276 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.320 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.052) 0:04:09.260 ******* 2019-12-09T11:00:32.328 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.329 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.369 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.048) 0:04:09.308 ******* 2019-12-09T11:00:32.375 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-09T11:00:32.377 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.414 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.045) 0:04:09.353 ******* 2019-12-09T11:00:32.421 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.461 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.046) 0:04:09.400 ******* 2019-12-09T11:00:32.467 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-09T11:00:32.505 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.043) 0:04:09.444 ******* 2019-12-09T11:00:32.548 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.042) 0:04:09.487 ******* 2019-12-09T11:00:32.556 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.603 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.055) 0:04:09.542 ******* 2019-12-09T11:00:32.609 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.647 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.043) 0:04:09.586 ******* 2019-12-09T11:00:32.653 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-12-09T11:00:32.657 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.701 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.053) 0:04:09.640 ******* 2019-12-09T11:00:32.708 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.748 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.047) 0:04:09.687 ******* 2019-12-09T11:00:32.754 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-12-09T11:00:32.756 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.800 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.052) 0:04:09.740 ******* 2019-12-09T11:00:32.808 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.847 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.046) 0:04:09.787 ******* 2019-12-09T11:00:32.854 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-09T11:00:32.855 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.893 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.045) 0:04:09.832 ******* 2019-12-09T11:00:32.901 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:32.939 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.046) 0:04:09.879 ******* 2019-12-09T11:00:32.946 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-09T11:00:32.946 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.002 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:32 +0000 (0:00:00.062) 0:04:09.941 ******* 2019-12-09T11:00:33.008 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.052 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.049) 0:04:09.991 ******* 2019-12-09T11:00:33.059 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-09T11:00:33.059 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.105 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.052) 0:04:10.044 ******* 2019-12-09T11:00:33.106 INFO:teuthology.task.ansible.out: 2019-12-09T11:00:33.111 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.152 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.046) 0:04:10.091 ******* 2019-12-09T11:00:33.153 INFO:teuthology.task.ansible.out: 2019-12-09T11:00:33.161 INFO:teuthology.task.ansible.out: 2019-12-09T11:00:33.163 INFO:teuthology.task.ansible.out:TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.211 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.059) 0:04:10.150 ******* 2019-12-09T11:00:33.221 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.269 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.057) 0:04:10.208 ******* 2019-12-09T11:00:33.275 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-12-09T11:00:33.277 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.319 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.050) 0:04:10.258 ******* 2019-12-09T11:00:33.327 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.367 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.047) 0:04:10.306 ******* 2019-12-09T11:00:33.374 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-12-09T11:00:33.375 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.417 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.049) 0:04:10.356 ******* 2019-12-09T11:00:33.428 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.468 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.051) 0:04:10.407 ******* 2019-12-09T11:00:33.475 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-09T11:00:33.476 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.517 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.048) 0:04:10.456 ******* 2019-12-09T11:00:33.523 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.563 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.046) 0:04:10.502 ******* 2019-12-09T11:00:33.573 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.608 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.045) 0:04:10.548 ******* 2019-12-09T11:00:33.616 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.657 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.048) 0:04:10.596 ******* 2019-12-09T11:00:33.666 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-12-09T11:00:33.668 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.708 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.051) 0:04:10.647 ******* 2019-12-09T11:00:33.715 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.754 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.045) 0:04:10.693 ******* 2019-12-09T11:00:33.760 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-12-09T11:00:33.762 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.803 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.048) 0:04:10.742 ******* 2019-12-09T11:00:33.816 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.853 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.050) 0:04:10.792 ******* 2019-12-09T11:00:33.861 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-09T11:00:33.863 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.908 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.052) 0:04:10.845 ******* 2019-12-09T11:00:33.916 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:33.969 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:33 +0000 (0:00:00.063) 0:04:10.909 ******* 2019-12-09T11:00:33.977 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-09T11:00:33.979 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.017 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.047) 0:04:10.956 ******* 2019-12-09T11:00:34.023 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.063 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.045) 0:04:11.002 ******* 2019-12-09T11:00:34.069 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-09T11:00:34.071 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.116 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.053) 0:04:11.055 ******* 2019-12-09T11:00:34.129 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.168 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.052) 0:04:11.107 ******* 2019-12-09T11:00:34.176 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-09T11:00:34.179 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.216 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.047) 0:04:11.155 ******* 2019-12-09T11:00:34.223 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.265 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.046) 0:04:11.202 ******* 2019-12-09T11:00:34.269 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-09T11:00:34.270 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.309 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.045) 0:04:11.248 ******* 2019-12-09T11:00:34.315 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.354 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.045) 0:04:11.293 ******* 2019-12-09T11:00:34.360 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-09T11:00:34.362 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.398 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.044) 0:04:11.337 ******* 2019-12-09T11:00:34.407 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.453 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.054) 0:04:11.392 ******* 2019-12-09T11:00:34.462 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-09T11:00:34.463 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.503 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.050) 0:04:11.442 ******* 2019-12-09T11:00:34.509 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.560 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.056) 0:04:11.499 ******* 2019-12-09T11:00:34.570 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-09T11:00:34.571 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.611 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.050) 0:04:11.550 ******* 2019-12-09T11:00:34.617 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.660 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.046) 0:04:11.596 ******* 2019-12-09T11:00:34.667 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-09T11:00:34.668 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.705 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.047) 0:04:11.644 ******* 2019-12-09T11:00:34.712 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.750 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.044) 0:04:11.689 ******* 2019-12-09T11:00:34.760 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.800 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.049) 0:04:11.739 ******* 2019-12-09T11:00:34.808 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.849 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.049) 0:04:11.788 ******* 2019-12-09T11:00:34.855 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-09T11:00:34.856 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.906 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.056) 0:04:11.845 ******* 2019-12-09T11:00:34.915 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:34.954 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.047) 0:04:11.893 ******* 2019-12-09T11:00:34.961 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-09T11:00:34.962 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:35.001 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:34 +0000 (0:00:00.046) 0:04:11.940 ******* 2019-12-09T11:00:35.005 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:35.055 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:35 +0000 (0:00:00.054) 0:04:11.994 ******* 2019-12-09T11:00:35.063 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-09T11:00:35.064 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:35.116 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:35 +0000 (0:00:00.060) 0:04:12.055 ******* 2019-12-09T11:00:35.122 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:35.162 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:35 +0000 (0:00:00.045) 0:04:12.101 ******* 2019-12-09T11:00:35.455 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-09T11:00:35.456 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-09T11:00:35.494 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:35 +0000 (0:00:00.331) 0:04:12.433 ******* 2019-12-09T11:00:35.512 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-09T11:00:35.550 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:35 +0000 (0:00:00.056) 0:04:12.489 ******* 2019-12-09T11:00:35.807 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-09T11:00:35.808 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-09T11:00:35.845 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:35 +0000 (0:00:00.295) 0:04:12.785 ******* 2019-12-09T11:00:35.906 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-09T11:00:35.943 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:35 +0000 (0:00:00.097) 0:04:12.882 ******* 2019-12-09T11:00:36.174 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-09T11:00:36.176 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-09T11:00:36.235 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.291) 0:04:13.174 ******* 2019-12-09T11:00:36.271 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.306 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.071) 0:04:13.245 ******* 2019-12-09T11:00:36.313 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-09T11:00:36.314 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-09T11:00:36.374 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.068) 0:04:13.313 ******* 2019-12-09T11:00:36.380 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-09T11:00:36.382 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.421 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.046) 0:04:13.360 ******* 2019-12-09T11:00:36.431 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.466 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.045) 0:04:13.405 ******* 2019-12-09T11:00:36.474 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.514 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.047) 0:04:13.453 ******* 2019-12-09T11:00:36.529 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.559 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.045) 0:04:13.499 ******* 2019-12-09T11:00:36.564 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-09T11:00:36.566 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.601 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.041) 0:04:13.540 ******* 2019-12-09T11:00:36.605 INFO:teuthology.task.ansible.out: 2019-12-09T11:00:36.607 INFO:teuthology.task.ansible.out:TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.645 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.043) 0:04:13.584 ******* 2019-12-09T11:00:36.651 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-09T11:00:36.653 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.689 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.044) 0:04:13.628 ******* 2019-12-09T11:00:36.695 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-09T11:00:36.696 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.740 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.044) 0:04:13.673 ******* 2019-12-09T11:00:36.742 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.778 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.043) 0:04:13.717 ******* 2019-12-09T11:00:36.782 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-09T11:00:36.783 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.829 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.051) 0:04:13.769 ******* 2019-12-09T11:00:36.845 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.880 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.050) 0:04:13.820 ******* 2019-12-09T11:00:36.886 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-09T11:00:36.888 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.926 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.045) 0:04:13.865 ******* 2019-12-09T11:00:36.931 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-09T11:00:36.933 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:36.971 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:36 +0000 (0:00:00.045) 0:04:13.910 ******* 2019-12-09T11:00:36.977 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.015 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.044) 0:04:13.954 ******* 2019-12-09T11:00:37.024 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.060 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.044) 0:04:13.999 ******* 2019-12-09T11:00:37.065 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-09T11:00:37.072 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.106 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.045) 0:04:14.044 ******* 2019-12-09T11:00:37.111 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-09T11:00:37.112 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.150 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.045) 0:04:14.089 ******* 2019-12-09T11:00:37.156 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.195 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.044) 0:04:14.134 ******* 2019-12-09T11:00:37.200 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-09T11:00:37.202 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.238 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.043) 0:04:14.177 ******* 2019-12-09T11:00:37.244 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-09T11:00:37.245 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.286 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.048) 0:04:14.226 ******* 2019-12-09T11:00:37.295 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.334 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.047) 0:04:14.273 ******* 2019-12-09T11:00:37.340 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-09T11:00:37.340 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.379 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.045) 0:04:14.319 ******* 2019-12-09T11:00:37.386 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-09T11:00:37.389 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.427 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.046) 0:04:14.365 ******* 2019-12-09T11:00:37.431 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-09T11:00:37.432 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.472 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.045) 0:04:14.411 ******* 2019-12-09T11:00:37.478 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-09T11:00:37.480 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.521 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.049) 0:04:14.460 ******* 2019-12-09T11:00:37.530 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-09T11:00:37.531 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.569 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.048) 0:04:14.509 ******* 2019-12-09T11:00:37.576 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-09T11:00:37.577 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.616 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.046) 0:04:14.555 ******* 2019-12-09T11:00:37.623 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.660 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.044) 0:04:14.600 ******* 2019-12-09T11:00:37.667 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-09T11:00:37.668 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.710 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.045) 0:04:14.646 ******* 2019-12-09T11:00:37.715 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-09T11:00:37.716 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.752 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.045) 0:04:14.692 ******* 2019-12-09T11:00:37.759 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-09T11:00:37.761 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.798 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.045) 0:04:14.738 ******* 2019-12-09T11:00:37.805 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.847 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.048) 0:04:14.786 ******* 2019-12-09T11:00:37.853 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-09T11:00:37.855 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.894 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.046) 0:04:14.833 ******* 2019-12-09T11:00:37.899 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-09T11:00:37.901 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.940 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.045) 0:04:14.879 ******* 2019-12-09T11:00:37.948 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-09T11:00:37.953 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:37.992 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:37 +0000 (0:00:00.049) 0:04:14.928 ******* 2019-12-09T11:00:37.997 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.038 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.048) 0:04:14.977 ******* 2019-12-09T11:00:38.043 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-09T11:00:38.044 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.087 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.048) 0:04:15.026 ******* 2019-12-09T11:00:38.093 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-09T11:00:38.093 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.136 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.049) 0:04:15.075 ******* 2019-12-09T11:00:38.142 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-09T11:00:38.144 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.183 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.047) 0:04:15.123 ******* 2019-12-09T11:00:38.199 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-09T11:00:38.200 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.249 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.060) 0:04:15.183 ******* 2019-12-09T11:00:38.251 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-09T11:00:38.252 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.291 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.046) 0:04:15.230 ******* 2019-12-09T11:00:38.300 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.339 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.047) 0:04:15.278 ******* 2019-12-09T11:00:38.345 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T11:00:38.347 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-09T11:00:38.386 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.046) 0:04:15.325 ******* 2019-12-09T11:00:38.391 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-09T11:00:38.393 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.449 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.063) 0:04:15.388 ******* 2019-12-09T11:00:38.458 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-09T11:00:38.460 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi194.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-09T11:00:38.462 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.472 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.483 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.493 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi194.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.526 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.076) 0:04:15.465 ******* 2019-12-09T11:00:38.534 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.577 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.050) 0:04:15.516 ******* 2019-12-09T11:00:38.583 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.585 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-09T11:00:38.586 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.597 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.609 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.610 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.620 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.661 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.084) 0:04:15.600 ******* 2019-12-09T11:00:38.761 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-09T11:00:38.762 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003946", "end": "2019-12-09 11:00:38.737428", "rc": 0, "start": "2019-12-09 11:00:38.733482", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-09T11:00:38.803 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.142) 0:04:15.742 ******* 2019-12-09T11:00:38.820 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004720", "end": "2019-12-09 11:00:38.785785", "rc": 0, "start": "2019-12-09 11:00:38.781065", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-09T11:00:38.863 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.059) 0:04:15.802 ******* 2019-12-09T11:00:38.869 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-09T11:00:38.870 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.912 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.048) 0:04:15.851 ******* 2019-12-09T11:00:38.919 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:38.963 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:38 +0000 (0:00:00.050) 0:04:15.902 ******* 2019-12-09T11:00:38.969 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-09T11:00:38.969 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:39.016 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:39 +0000 (0:00:00.052) 0:04:15.955 ******* 2019-12-09T11:00:39.023 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:39.079 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:39 +0000 (0:00:00.062) 0:04:16.018 ******* 2019-12-09T11:00:39.085 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-09T11:00:39.087 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:39.126 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:39 +0000 (0:00:00.047) 0:04:16.065 ******* 2019-12-09T11:00:39.135 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:39.178 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:39 +0000 (0:00:00.051) 0:04:16.117 ******* 2019-12-09T11:00:39.185 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-09T11:00:39.186 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:39.227 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:39 +0000 (0:00:00.049) 0:04:16.167 ******* 2019-12-09T11:00:39.233 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:39.273 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:39 +0000 (0:00:00.045) 0:04:16.212 ******* 2019-12-09T11:00:39.728 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-09T11:00:39.729 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-09T11:00:39.770 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:39 +0000 (0:00:00.496) 0:04:16.709 ******* 2019-12-09T11:00:39.777 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-09T11:00:39.818 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:39 +0000 (0:00:00.048) 0:04:16.758 ******* 2019-12-09T11:00:39.825 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-09T11:00:39.827 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item={u'block_used': 13040446, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284038, u'size_available': 930955419648, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284038, "block_size": 4096, "block_total": 240324484, "block_used": 13040446, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955419648, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-09T11:00:39.867 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:39 +0000 (0:00:00.048) 0:04:16.806 ******* 2019-12-09T11:00:39.874 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={u'block_used': 13040459, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284025, u'size_available': 930955366400, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966950, u'device': u'/dev/sda1', u'inode_used': 88026, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284025, "block_size": 4096, "block_total": 240324484, "block_used": 13040459, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966950, "inode_total": 61054976, "inode_used": 88026, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955366400, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-09T11:00:39.917 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:39 +0000 (0:00:00.049) 0:04:16.856 ******* 2019-12-09T11:00:40.187 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-09T11:00:40.187 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.011393", "end": "2019-12-09 11:00:40.161704", "rc": 0, "start": "2019-12-09 11:00:40.150311", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:40.224 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:40 +0000 (0:00:00.307) 0:04:17.163 ******* 2019-12-09T11:00:40.254 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.014673", "end": "2019-12-09 11:00:40.231874", "rc": 0, "start": "2019-12-09 11:00:40.217201", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:40.293 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:40 +0000 (0:00:00.068) 0:04:17.232 ******* 2019-12-09T11:00:40.303 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-09T11:00:40.304 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'block_used': 13040446, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284038, u'size_available': 930955419648, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284038, "block_size": 4096, "block_total": 240324484, "block_used": 13040446, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955419648, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:40.352 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:40 +0000 (0:00:00.059) 0:04:17.291 ******* 2019-12-09T11:00:40.359 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'block_used': 13040459, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284025, u'size_available': 930955366400, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966950, u'device': u'/dev/sda1', u'inode_used': 88026, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284025, "block_size": 4096, "block_total": 240324484, "block_used": 13040459, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966950, "inode_total": 61054976, "inode_used": 88026, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955366400, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:40.403 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:40 +0000 (0:00:00.046) 0:04:17.337 ******* TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-09T11:00:40.443 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:40 +0000 (0:00:00.043) 0:04:17.381 ******* 2019-12-09T11:00:40.497 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:40 +0000 (0:00:00.054) 0:04:17.436 ******* 2019-12-09T11:00:40.504 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-09T11:00:40.506 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XNHZ', u'wwn-0x5000c50092941eb0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XNHZ', u'wwn': u'0x5000c50092941eb0', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XNHZ-part1', u'wwn-0x5000c50092941eb0-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNHZ", "wwn-0x5000c50092941eb0"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNHZ-part1", "wwn-0x5000c50092941eb0-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNHZ", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-09T11:00:40.507 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092941eb0"}}, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:40.541 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFPH', u'wwn-0x5000c50092925063'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFPH', u'wwn': u'0x5000c50092925063', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFPH-part1', u'wwn-0x5000c50092925063-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPH", "wwn-0x5000c50092925063"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPH-part1", "wwn-0x5000c50092925063-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFPH", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-09T11:00:40.542 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092925063"}}, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:42.403 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-wKj9yN-9Y23-Qs5e-fhPn-ynUM-enDt-o1e2ju', u'nvme-INTEL_SSDPEDMD400G4_CVFT6240002A400BGN', u'nvme-nvme.8086-43564654363234303030324134303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT6240002A400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.607096", "end": "2019-12-09 11:00:42.371049", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-wKj9yN-9Y23-Qs5e-fhPn-ynUM-enDt-o1e2ju", "nvme-INTEL_SSDPEDMD400G4_CVFT6240002A400BGN", "nvme-nvme.8086-43564654363234303030324134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT6240002A400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:40.763 2019-12-09T11:00:42.405 INFO:teuthology.task.ansible.out:953", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T11:00:42.427 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-Wm4GOf-SQ5g-YQi6-L0rE-HAoP-OYkK-cLmYw8', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300GB400BGN', u'nvme-nvme.8086-43564654363233333030474234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT623300GB400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.574785", "end": "2019-12-09 11:00:42.388754", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Wm4GOf-SQ5g-YQi6-L0rE-HAoP-OYkK-cLmYw8", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GB400BGN", "nvme-nvme.8086-43564654363233333030474234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT623300GB400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:40.813 2019-12-09T11:00:42.428 INFO:teuthology.task.ansible.out:969", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T11:00:43.802 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbiIzPGAQ5MXE6ss9fySfjBfrmf09Ok0YqQ'], u'uuids': [u'ede91ee0-9879-4af2-bc98-63cb8073706a']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GB400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.076351", "end": "2019-12-09 11:00:43.762657", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbiIzPGAQ5MXE6ss9fySfjBfrmf09Ok0YqQ"], "labels": [], "masters": [], "uuids": ["ede91ee0-9879-4af2-bc98-63cb8073706a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GB400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:42.686306", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T11:00:43.804 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0YJBsFhfGx2N6YyXN5y9TAhm9uVI4uIZ7'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6240002A400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.064045", "end": "2019-12-09 11:00:43.770122", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0YJBsFhfGx2N6YyXN5y9TAhm9uVI4uIZ7"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6240002A400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:42.706077", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T11:00:45.153 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbiiVHaazuSaxo6GLVqnWGLH4jsjIFc3WIR'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GB400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.055881", "end": "2019-12-09 11:00:45.121029", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbiiVHaazuSaxo6GLVqnWGLH4jsjIFc3WIR"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GB400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:44.065148", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T11:00:45.190 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0s2PVYU9yRp2hj0k31XTJJDcZQJyOcxVW'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6240002A400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.070189", "end": "2019-12-09 11:00:45.145951", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0s2PVYU9yRp2hj0k31XTJJDcZQJyOcxVW"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6240002A400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:44.075762", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T11:00:46.528 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbibYZm7BPMa7wngnx1d5JtC1K4VWIdrSah'], u'uuids': [u'a3ded5f9-cdec-4881-8a66-b48381783ec1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GB400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.059490", "end": "2019-12-09 11:00:46.488315", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbibYZm7BPMa7wngnx1d5JtC1K4VWIdrSah"], "labels": [], "masters": [], "uuids": ["a3ded5f9-cdec-4881-8a66-b48381783ec1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GB400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:45.428825", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T11:00:46.581 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0sYs7JhTCQfer6qUgSn1ecW7loqEtGnp0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6240002A400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.072042", "end": "2019-12-09 11:00:46.546689", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0sYs7JhTCQfer6qUgSn1ecW7loqEtGnp0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6240002A400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:45.474647", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T11:00:47.895 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbivhRcYVC8Tg3auj96wS9Qs4BIhLjvcvav'], u'uuids': [u'85f9cf18-2049-43c2-92ca-835dd8378940']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GB400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.058126", "end": "2019-12-09 11:00:47.863532", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbivhRcYVC8Tg3auj96wS9Qs4BIhLjvcvav"], "labels": [], "masters": [], "uuids": ["85f9cf18-2049-43c2-92ca-835dd8378940"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT623300GB400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:46.805406", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T11:00:47.958 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0EvgPZw7ByUEwC2X15lY8Z3c7V8SYcJNH'], u'uuids': [u'fd4467c7-56e7-4514-9498-0dfeb1a7b35e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6240002A400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.065579", "end": "2019-12-09 11:00:47.929608", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0EvgPZw7ByUEwC2X15lY8Z3c7V8SYcJNH"], "labels": [], "masters": [], "uuids": ["fd4467c7-56e7-4514-9498-0dfeb1a7b35e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT6240002A400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:46.864029", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T11:00:49.294 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbifCRpuogi2gSU7I1e7Q3c93EnEsZohBBt'], u'uuids': [u'd84bf7d2-5a60-46be-b616-30451cdc9edb']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GB400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.063896", "end": "2019-12-09 11:00:49.256013", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbifCRpuogi2gSU7I1e7Q3c93EnEsZohBBt"], "labels": [], "masters": [], "uuids": ["d84bf7d2-5a60-46be-b616-30451cdc9edb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GB400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:48.192117", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T11:00:49.343 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:49 +0000 (0:00:08.846) 0:04:26.282 ******* 2019-12-09T11:00:49.353 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0JGQOX0QNikK0o2I1WXexol5hpke7z8Ad'], u'uuids': [u'2bec25c8-3ec9-4971-9575-1f0efc7f1c81']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6240002A400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.059433", "end": "2019-12-09 11:00:49.304388", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0JGQOX0QNikK0o2I1WXexol5hpke7z8Ad"], "labels": [], "masters": [], "uuids": ["2bec25c8-3ec9-4971-9575-1f0efc7f1c81"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6240002A400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:48.244955", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T11:00:49.402 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:49 +0000 (0:00:00.058) 0:04:26.341 ******* 2019-12-09T11:00:49.408 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-09T11:00:49.410 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFPH', u'wwn-0x5000c50092925063'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFPH', u'wwn': u'0x5000c50092925063', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFPH-part1', u'wwn-0x5000c50092925063-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPH", "wwn-0x5000c50092925063"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPH-part1", "wwn-0x5000c50092925063-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFPH", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-09T11:00:49.411 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092925063"}}, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:49.445 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XNHZ', u'wwn-0x5000c50092941eb0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XNHZ', u'wwn': u'0x5000c50092941eb0', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XNHZ-part1', u'wwn-0x5000c50092941eb0-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNHZ", "wwn-0x5000c50092941eb0"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNHZ-part1", "wwn-0x5000c50092941eb0-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNHZ", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-09T11:00:49.447 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092941eb0"}}, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:49.801 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-Wm4GOf-SQ5g-YQi6-L0rE-HAoP-OYkK-cLmYw8', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300GB400BGN', u'nvme-nvme.8086-43564654363233333030474234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT623300GB400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.087682", "end": "2019-12-09 11:00:49.766471", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Wm4GOf-SQ5g-YQi6-L0rE-HAoP-OYkK-cLmYw8", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GB400BGN", "nvme-nvme.8086-43564654363233333030474234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT623300GB400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:49.678789", "stderr": 2019-12-09T11:00:49.803 INFO:teuthology.task.ansible.out: "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0814108 s, 1.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0814108 s, 1.4 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:49.834 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-wKj9yN-9Y23-Qs5e-fhPn-ynUM-enDt-o1e2ju', u'nvme-INTEL_SSDPEDMD400G4_CVFT6240002A400BGN', u'nvme-nvme.8086-43564654363234303030324134303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT6240002A400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.087648", "end": "2019-12-09 11:00:49.809031", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-wKj9yN-9Y23-Qs5e-fhPn-ynUM-enDt-o1e2ju", "nvme-INTEL_SSDPEDMD400G4_CVFT6240002A400BGN", "nvme-nvme.8086-43564654363234303030324134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT6240002A400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:49.721383", "stderr": 2019-12-09T11:00:49.835 INFO:teuthology.task.ansible.out: "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0814349 s, 1.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0814349 s, 1.4 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:50.283 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbiIzPGAQ5MXE6ss9fySfjBfrmf09Ok0YqQ'], u'uuids': [u'ede91ee0-9879-4af2-bc98-63cb8073706a']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GB400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.200230", "end": "2019-12-09 11:00:50.248639", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbiIzPGAQ5MXE6ss9fySfjBfrmf09Ok0YqQ"], "labels": [], "masters": [], "uuids": ["ede91ee0-9879-4af2-bc98-63cb8073706a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GB400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:50.048409", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.194552 s, 593 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.194552 s, 593 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:50.326 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0YJBsFhfGx2N6YyXN5y9TAhm9uVI4uIZ7'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6240002A400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.201942", "end": "2019-12-09 11:00:50.295411", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0YJBsFhfGx2N6YyXN5y9TAhm9uVI4uIZ7"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6240002A400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:50.093469", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.195476 s, 590 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.195476 s, 590 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:50.788 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbiiVHaazuSaxo6GLVqnWGLH4jsjIFc3WIR'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GB400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.199263", "end": "2019-12-09 11:00:50.748865", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbiiVHaazuSaxo6GLVqnWGLH4jsjIFc3WIR"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GB400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:50.549602", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.193385 s, 596 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.193385 s, 596 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:50.800 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0s2PVYU9yRp2hj0k31XTJJDcZQJyOcxVW'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6240002A400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.180552", "end": "2019-12-09 11:00:50.764192", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0s2PVYU9yRp2hj0k31XTJJDcZQJyOcxVW"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6240002A400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:50.583640", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.175085 s, 659 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.175085 s, 659 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:51.267 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbibYZm7BPMa7wngnx1d5JtC1K4VWIdrSah'], u'uuids': [u'a3ded5f9-cdec-4881-8a66-b48381783ec1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GB400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.197255", "end": "2019-12-09 11:00:51.233319", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbibYZm7BPMa7wngnx1d5JtC1K4VWIdrSah"], "labels": [], "masters": [], "uuids": ["a3ded5f9-cdec-4881-8a66-b48381783ec1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GB400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:51.036064", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.191331 s, 603 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.191331 s, 603 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:51.311 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0sYs7JhTCQfer6qUgSn1ecW7loqEtGnp0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6240002A400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.197078", "end": "2019-12-09 11:00:51.275357", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0sYs7JhTCQfer6qUgSn1ecW7loqEtGnp0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6240002A400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:51.078279", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.190438 s, 606 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.190438 s, 606 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:51.780 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbivhRcYVC8Tg3auj96wS9Qs4BIhLjvcvav'], u'uuids': [u'85f9cf18-2049-43c2-92ca-835dd8378940']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GB400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.203327", "end": "2019-12-09 11:00:51.751280", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbivhRcYVC8Tg3auj96wS9Qs4BIhLjvcvav"], "labels": [], "masters": [], "uuids": ["85f9cf18-2049-43c2-92ca-835dd8378940"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT623300GB400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:51.547953", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.196481 s, 587 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.196481 s, 587 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:51.803 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0EvgPZw7ByUEwC2X15lY8Z3c7V8SYcJNH'], u'uuids': [u'fd4467c7-56e7-4514-9498-0dfeb1a7b35e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6240002A400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.197730", "end": "2019-12-09 11:00:51.769421", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0EvgPZw7ByUEwC2X15lY8Z3c7V8SYcJNH"], "labels": [], "masters": [], "uuids": ["fd4467c7-56e7-4514-9498-0dfeb1a7b35e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT6240002A400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:51.571691", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.191172 s, 603 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.191172 s, 603 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:52.297 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0JGQOX0QNikK0o2I1WXexol5hpke7z8Ad'], u'uuids': [u'2bec25c8-3ec9-4971-9575-1f0efc7f1c81']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6240002A400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.178763", "end": "2019-12-09 11:00:52.269215", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-2kSYxvUKZmFyAcqd9C5ZONjvceW6d0M0JGQOX0QNikK0o2I1WXexol5hpke7z8Ad"], "labels": [], "masters": [], "uuids": ["2bec25c8-3ec9-4971-9575-1f0efc7f1c81"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6240002A400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:52.090452", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.172505 s, 669 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.172505 s, 669 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:52.317 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbifCRpuogi2gSU7I1e7Q3c93EnEsZohBBt'], u'uuids': [u'd84bf7d2-5a60-46be-b616-30451cdc9edb']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT623300GB400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.198762", "end": "2019-12-09 11:00:52.267585", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-NOaE5CcEYdfMpNhlYk5lgyWjUPoKdfbifCRpuogi2gSU7I1e7Q3c93EnEsZohBBt"], "labels": [], "masters": [], "uuids": ["d84bf7d2-5a60-46be-b616-30451cdc9edb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT623300GB400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 11:00:52.068823", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.191786 s, 601 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.191786 s, 601 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:52.361 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:52 +0000 (0:00:02.958) 0:04:29.300 ******* 2019-12-09T11:00:52.396 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:52 +0000 (0:00:00.034) 0:04:29.335 ******* 2019-12-09T11:00:52.770 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-09T11:00:52.771 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.086889", "end": "2019-12-09 11:00:52.738364", "rc": 0, "start": "2019-12-09 11:00:52.651475", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:52.808 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:52 +0000 (0:00:00.412) 0:04:29.747 ******* 2019-12-09T11:00:52.814 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.100227", "end": "2019-12-09 11:00:52.770694", "rc": 0, "start": "2019-12-09 11:00:52.670467", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:52.853 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:52 +0000 (0:00:00.045) 0:04:29.793 ******* 2019-12-09T11:00:53.182 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-09T11:00:53.184 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.053649", "end": "2019-12-09 11:00:53.151967", "rc": 0, "start": "2019-12-09 11:00:53.098318", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:53.223 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:53 +0000 (0:00:00.369) 0:04:30.162 ******* 2019-12-09T11:00:53.229 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.044610", "end": "2019-12-09 11:00:53.172237", "rc": 0, "start": "2019-12-09 11:00:53.127627", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T11:00:53.272 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:53 +0000 (0:00:00.048) 0:04:30.211 ******* 2019-12-09T11:00:53.278 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-09T11:00:53.322 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:53 +0000 (0:00:00.049) 0:04:30.260 ******* 2019-12-09T11:00:53.369 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:53 +0000 (0:00:00.047) 0:04:30.308 ******* 2019-12-09T11:00:53.375 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-09T11:00:53.375 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:53.417 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:53 +0000 (0:00:00.047) 0:04:30.356 ******* 2019-12-09T11:00:53.424 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:53.464 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:53 +0000 (0:00:00.047) 0:04:30.403 ******* 2019-12-09T11:00:53.470 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-09T11:00:53.470 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:53.508 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:53 +0000 (0:00:00.043) 0:04:30.447 ******* 2019-12-09T11:00:53.513 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:53.551 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:53 +0000 (0:00:00.043) 0:04:30.491 ******* 2019-12-09T11:00:53.556 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-09T11:00:53.556 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:53.595 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:53 +0000 (0:00:00.043) 0:04:30.534 ******* 2019-12-09T11:00:53.600 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:53.640 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:53 +0000 (0:00:00.044) 0:04:30.579 ******* 2019-12-09T11:00:53.644 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-09T11:00:53.645 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:53.682 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:53 +0000 (0:00:00.042) 0:04:30.622 ******* 2019-12-09T11:00:53.687 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:53.729 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:53 +0000 (0:00:00.046) 0:04:30.668 ******* 2019-12-09T11:00:54.007 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-09T11:00:54.008 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T11:00:54.044 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.315) 0:04:30.984 ******* 2019-12-09T11:00:54.050 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T11:00:54.100 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.055) 0:04:31.039 ******* 2019-12-09T11:00:54.105 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-09T11:00:54.106 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={u'block_used': 13040459, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284025, u'size_available': 930955366400, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966950, u'device': u'/dev/sda1', u'inode_used': 88026, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284025, "block_size": 4096, "block_total": 240324484, "block_used": 13040459, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966950, "inode_total": 61054976, "inode_used": 88026, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955366400, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.148 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.048) 0:04:31.087 ******* 2019-12-09T11:00:54.155 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={u'block_used': 13040446, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284038, u'size_available': 930955419648, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284038, "block_size": 4096, "block_total": 240324484, "block_used": 13040446, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955419648, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.196 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.047) 0:04:31.135 ******* 2019-12-09T11:00:54.201 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-09T11:00:54.204 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.242 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.046) 0:04:31.182 ******* 2019-12-09T11:00:54.248 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.288 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.045) 0:04:31.228 ******* 2019-12-09T11:00:54.294 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T11:00:54.295 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.334 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.045) 0:04:31.273 ******* 2019-12-09T11:00:54.340 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.379 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.045) 0:04:31.318 ******* 2019-12-09T11:00:54.384 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T11:00:54.385 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.424 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.044) 0:04:31.363 ******* 2019-12-09T11:00:54.432 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.472 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.045) 0:04:31.408 ******* 2019-12-09T11:00:54.475 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-09T11:00:54.476 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.514 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.044) 0:04:31.453 ******* 2019-12-09T11:00:54.519 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.556 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.042) 0:04:31.495 ******* 2019-12-09T11:00:54.560 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-09T11:00:54.560 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.599 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.042) 0:04:31.538 ******* 2019-12-09T11:00:54.604 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.641 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.042) 0:04:31.580 ******* 2019-12-09T11:00:54.648 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-09T11:00:54.649 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.684 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.043) 0:04:31.624 ******* 2019-12-09T11:00:54.690 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:54.728 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:54 +0000 (0:00:00.043) 0:04:31.667 ******* 2019-12-09T11:00:55.498 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-12-09T11:00:55.500 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-09T11:00:55.502 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-09T11:00:55.539 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:55 +0000 (0:00:00.811) 0:04:32.478 ******* 2019-12-09T11:00:55.572 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:55 +0000 (0:00:00.032) 0:04:32.511 ******* 2019-12-09T11:00:56.323 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-09T11:00:56.323 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T11:00:56.355 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T11:00:56.779 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T11:00:56.812 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T11:00:57.257 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T11:00:57.278 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T11:00:57.755 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T11:00:57.766 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T11:00:58.216 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T11:00:58.259 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:58 +0000 (0:00:02.687) 0:04:35.198 ******* 2019-12-09T11:00:58.266 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T11:00:58.308 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:58 +0000 (0:00:00.049) 0:04:35.247 ******* 2019-12-09T11:00:58.563 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-09T11:00:58.565 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-09T11:00:58.600 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:58 +0000 (0:00:00.291) 0:04:35.539 ******* 2019-12-09T11:00:58.640 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-09T11:00:58.641 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-09T11:00:58.643 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:58.684 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:58 +0000 (0:00:00.084) 0:04:35.624 ******* 2019-12-09T11:00:58.722 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-09T11:00:58.951 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T11:00:59.016 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T11:00:59.260 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T11:00:59.348 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T11:00:59.558 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T11:00:59.664 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T11:00:59.863 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T11:00:59.905 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:00:59 +0000 (0:00:01.220) 0:04:36.844 ******* 2019-12-09T11:00:59.975 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T11:01:00.022 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:00 +0000 (0:00:00.116) 0:04:36.961 ******* 2019-12-09T11:01:00.215 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-09T11:01:00.216 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-09T11:01:00.257 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:00 +0000 (0:00:00.235) 0:04:37.196 ******* 2019-12-09T11:01:00.295 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-12-09T11:01:00.296 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-09T11:01:00.336 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:00 +0000 (0:00:00.078) 0:04:37.275 ******* 2019-12-09T11:01:00.342 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-09T11:01:00.343 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-09T11:01:00.382 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:00 +0000 (0:00:00.046) 0:04:37.321 ******* 2019-12-09T11:01:00.430 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-12-09T11:01:00.432 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-09T11:01:00.467 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:00 +0000 (0:00:00.084) 0:04:37.406 ******* 2019-12-09T11:01:01.051 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-12-09T11:01:01.058 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true} 2019-12-09T11:01:01.097 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:01 +0000 (0:00:00.630) 0:04:38.037 ******* 2019-12-09T11:01:01.104 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true} 2019-12-09T11:01:01.145 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:01 +0000 (0:00:00.047) 0:04:38.084 ******* 2019-12-09T11:01:01.814 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-09T11:01:01.856 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:01 +0000 (0:00:00.710) 0:04:38.795 ******* 2019-12-09T11:01:01.863 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-09T11:01:01.904 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:01 +0000 (0:00:00.048) 0:04:38.843 ******* 2019-12-09T11:01:01.911 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-09T11:01:01.912 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:01.952 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:01 +0000 (0:00:00.047) 0:04:38.891 ******* 2019-12-09T11:01:01.962 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.001 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:01 +0000 (0:00:00.049) 0:04:38.941 ******* 2019-12-09T11:01:02.008 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-09T11:01:02.013 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.050 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:02 +0000 (0:00:00.048) 0:04:38.989 ******* 2019-12-09T11:01:02.057 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.098 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:02 +0000 (0:00:00.047) 0:04:39.037 ******* 2019-12-09T11:01:02.105 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-12-09T11:01:02.107 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.147 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:02 +0000 (0:00:00.049) 0:04:39.087 ******* 2019-12-09T11:01:02.153 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.195 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:02 +0000 (0:00:00.047) 0:04:39.134 ******* 2019-12-09T11:01:02.205 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-12-09T11:01:02.206 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.245 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:02 +0000 (0:00:00.050) 0:04:39.184 ******* 2019-12-09T11:01:02.251 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.294 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:02 +0000 (0:00:00.049) 0:04:39.233 ******* 2019-12-09T11:01:02.302 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-12-09T11:01:02.303 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.348 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:02 +0000 (0:00:00.054) 0:04:39.287 ******* 2019-12-09T11:01:02.354 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.394 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:02 +0000 (0:00:00.045) 0:04:39.333 ******* 2019-12-09T11:01:02.402 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-09T11:01:02.404 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.447 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:02 +0000 (0:00:00.051) 0:04:39.385 ******* 2019-12-09T11:01:02.456 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.495 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:02 +0000 (0:00:00.049) 0:04:39.434 ******* 2019-12-09T11:01:02.502 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-09T11:01:02.503 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.547 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:02 +0000 (0:00:00.051) 0:04:39.486 ******* 2019-12-09T11:01:02.553 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:02.598 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:02 +0000 (0:00:00.050) 0:04:39.537 ******* 2019-12-09T11:01:03.061 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-09T11:01:03.063 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-09T11:01:03.099 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:03 +0000 (0:00:00.501) 0:04:40.038 ******* 2019-12-09T11:01:03.105 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-09T11:01:03.146 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:03 +0000 (0:00:00.046) 0:04:40.085 ******* 2019-12-09T11:01:03.152 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-09T11:01:03.154 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:03.193 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:03 +0000 (0:00:00.046) 0:04:40.132 ******* 2019-12-09T11:01:03.199 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:03.239 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:03 +0000 (0:00:00.046) 0:04:40.178 ******* 2019-12-09T11:01:03.250 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-09T11:01:03.252 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:03.290 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:03 +0000 (0:00:00.051) 0:04:40.229 ******* 2019-12-09T11:01:03.296 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:03.336 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:03 +0000 (0:00:00.045) 0:04:40.275 ******* 2019-12-09T11:01:04.274 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-12-09T11:01:04.276 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-09T11:01:04.314 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:04 +0000 (0:00:00.978) 0:04:41.253 ******* 2019-12-09T11:01:04.348 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:04 +0000 (0:00:00.033) 0:04:41.287 ******* 2019-12-09T11:01:04.353 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-09T11:01:04.355 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:04.393 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:04 +0000 (0:00:00.044) 0:04:41.332 ******* 2019-12-09T11:01:04.398 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:04.438 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:04 +0000 (0:00:00.044) 0:04:41.376 ******* 2019-12-09T11:01:04.900 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-09T11:01:04.902 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "ntpdate.service basic.target -.mount system.slice sntp.service tmp.mount syslog.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "chronyd.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-09T11:01:04.903 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-09T11:01:04.905 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-09T11:01:04.942 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:04 +0000 (0:00:00.504) 0:04:41.881 ******* 2019-12-09T11:01:04.967 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "-.mount sntp.service ntpdate.service tmp.mount system.slice syslog.target systemd-journald.socket basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target multi-user.target chronyd.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-09T11:01:04.969 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-09T11:01:04.970 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-09T11:01:05.006 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:05 +0000 (0:00:00.063) 0:04:41.945 ******* 2019-12-09T11:01:05.860 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-09T11:01:05.861 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-09T11:01:05.900 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:05 +0000 (0:00:00.893) 0:04:42.839 ******* 2019-12-09T11:01:05.909 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-09T11:01:05.951 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:05 +0000 (0:00:00.051) 0:04:42.890 ******* 2019-12-09T11:01:05.957 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-09T11:01:05.959 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:06.003 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:05 +0000 (0:00:00.052) 0:04:42.942 ******* 2019-12-09T11:01:06.009 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:06.055 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:06 +0000 (0:00:00.051) 0:04:42.994 ******* 2019-12-09T11:01:06.062 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2019-12-09T11:01:06.063 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:06.101 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:06 +0000 (0:00:00.046) 0:04:43.040 ******* 2019-12-09T11:01:06.108 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:06.149 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:06 +0000 (0:00:00.047) 0:04:43.088 ******* 2019-12-09T11:01:06.446 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-09T11:01:06.448 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-09T11:01:06.487 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:06 +0000 (0:00:00.338) 0:04:43.426 ******* 2019-12-09T11:01:06.495 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-09T11:01:06.536 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:06 +0000 (0:00:00.049) 0:04:43.475 ******* 2019-12-09T11:01:07.417 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-09T11:01:07.418 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-09T11:01:07.456 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:07 +0000 (0:00:00.920) 0:04:44.395 ******* 2019-12-09T11:01:07.463 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-09T11:01:07.503 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:07 +0000 (0:00:00.046) 0:04:44.442 ******* 2019-12-09T11:01:09.209 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-09T11:01:09.210 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-09T11:01:09.248 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:09 +0000 (0:00:01.744) 0:04:46.187 ******* 2019-12-09T11:01:09.275 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-09T11:01:09.276 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:09.313 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:09 +0000 (0:00:00.065) 0:04:46.253 ******* 2019-12-09T11:01:09.350 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:09 +0000 (0:00:00.036) 0:04:46.289 ******* 2019-12-09T11:01:09.355 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:09.395 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:09 +0000 (0:00:00.045) 0:04:46.334 ******* 2019-12-09T11:01:09.401 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-12-09T11:01:09.403 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-09T11:01:09.440 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:09 +0000 (0:00:00.045) 0:04:46.379 ******* 2019-12-09T11:01:09.446 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-09T11:01:09.483 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:09 +0000 (0:00:00.043) 0:04:46.423 ******* 2019-12-09T11:01:09.745 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-09T11:01:09.746 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-09T11:01:09.794 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:09 +0000 (0:00:00.311) 0:04:46.734 ******* 2019-12-09T11:01:09.812 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-09T11:01:09.855 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:09 +0000 (0:00:00.060) 0:04:46.794 ******* 2019-12-09T11:01:09.863 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-09T11:01:09.864 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:09.906 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:09 +0000 (0:00:00.051) 0:04:46.846 ******* 2019-12-09T11:01:09.913 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:09.951 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:09 +0000 (0:00:00.044) 0:04:46.890 ******* 2019-12-09T11:01:09.957 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-09T11:01:09.959 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-09T11:01:09.997 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:09 +0000 (0:00:00.045) 0:04:46.936 ******* 2019-12-09T11:01:10.006 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-09T11:01:10.042 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:10 +0000 (0:00:00.045) 0:04:46.982 ******* 2019-12-09T11:01:10.049 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-12-09T11:01:10.051 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:10.090 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:10 +0000 (0:00:00.046) 0:04:47.028 ******* 2019-12-09T11:01:10.095 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:10.134 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:10 +0000 (0:00:00.044) 0:04:47.073 ******* 2019-12-09T11:01:10.411 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-09T11:01:10.411 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-09T11:01:10.456 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:10 +0000 (0:00:00.322) 0:04:47.395 ******* 2019-12-09T11:01:10.461 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-09T11:01:10.501 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:10 +0000 (0:00:00.045) 0:04:47.440 ******* 2019-12-09T11:01:10.771 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-09T11:01:10.772 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-09T11:01:10.834 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:10 +0000 (0:00:00.332) 0:04:47.773 ******* 2019-12-09T11:01:10.840 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-09T11:01:10.884 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:10 +0000 (0:00:00.050) 0:04:47.824 ******* 2019-12-09T11:01:10.891 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-12-09T11:01:10.891 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:10.944 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:10 +0000 (0:00:00.059) 0:04:47.883 ******* 2019-12-09T11:01:10.950 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.005 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.061) 0:04:47.944 ******* 2019-12-09T11:01:11.011 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-09T11:01:11.012 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.013 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.015 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.069 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.064) 0:04:48.008 ******* 2019-12-09T11:01:11.076 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.077 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.079 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.080 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.123 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.054) 0:04:48.063 ******* 2019-12-09T11:01:11.131 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-09T11:01:11.132 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.134 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.135 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.137 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi194.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.187 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.063) 0:04:48.126 ******* 2019-12-09T11:01:11.193 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.194 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.196 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.198 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.235 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.047) 0:04:48.174 ******* 2019-12-09T11:01:11.240 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T11:01:11.241 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.281 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.045) 0:04:48.220 ******* 2019-12-09T11:01:11.285 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.327 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.046) 0:04:48.266 ******* 2019-12-09T11:01:11.332 INFO:teuthology.task.ansible.out: 2019-12-09T11:01:11.334 INFO:teuthology.task.ansible.out:TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.370 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.043) 0:04:48.309 ******* 2019-12-09T11:01:11.375 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.413 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.042) 0:04:48.352 ******* 2019-12-09T11:01:11.418 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-09T11:01:11.418 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.459 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.046) 0:04:48.398 ******* 2019-12-09T11:01:11.464 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.504 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.044) 0:04:48.443 ******* 2019-12-09T11:01:11.509 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-12-09T11:01:11.509 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.546 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.042) 0:04:48.485 ******* 2019-12-09T11:01:11.552 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.589 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.043) 0:04:48.529 ******* 2019-12-09T11:01:11.594 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-09T11:01:11.595 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.635 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.045) 0:04:48.574 ******* 2019-12-09T11:01:11.641 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.682 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.047) 0:04:48.621 ******* 2019-12-09T11:01:11.689 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-09T11:01:11.690 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.730 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.047) 0:04:48.669 ******* 2019-12-09T11:01:11.737 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.778 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.047) 0:04:48.717 ******* 2019-12-09T11:01:11.784 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-09T11:01:11.785 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.826 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.047) 0:04:48.765 ******* 2019-12-09T11:01:11.832 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.873 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.047) 0:04:48.812 ******* 2019-12-09T11:01:11.879 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-09T11:01:11.881 INFO:teuthology.task.ansible.out:skipping: [smithi194.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.920 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.046) 0:04:48.859 ******* 2019-12-09T11:01:11.926 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T11:01:11.975 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:11 +0000 (0:00:00.054) 0:04:48.914 ******* 2019-12-09T11:01:12.263 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-09T11:01:12.264 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.013407", "end": "2019-12-09 11:01:12.224454", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-09 11:01:12.211047", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T11:01:12.348 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.016928", "end": "2019-12-09 11:01:12.308097", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-09 11:01:12.291169", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T11:01:12.349 INFO:teuthology.task.ansible.out: 2019-12-09T11:01:12.597 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007630", "end": "2019-12-09 11:01:12.559694", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-09 11:01:12.552064", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T11:01:12.599 INFO:teuthology.task.ansible.out: 2019-12-09T11:01:12.640 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007967", "end": "2019-12-09 11:01:12.600904", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-09 11:01:12.592937", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T11:01:12.883 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.007510", "end": "2019-12-09 11:01:12.848956", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-09 11:01:12.841446", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-09T11:01:12.946 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.007015", "end": "2019-12-09 11:01:12.909029", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-09 11:01:12.902014", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-09T11:01:13.184 INFO:teuthology.task.ansible.out:ok: [smithi194.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.008512", "end": "2019-12-09 11:01:13.144194", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-09 11:01:13.135682", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T11:01:13.226 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:13 +0000 (0:00:01.251) 0:04:50.165 ******* 2019-12-09T11:01:13.252 INFO:teuthology.task.ansible.out: 2019-12-09T11:01:13.254 INFO:teuthology.task.ansible.out:TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-09T11:01:13.293 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:13 +0000 (0:00:00.066) 0:04:50.232 ******* 2019-12-09T11:01:13.608 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-09T11:01:13.609 INFO:teuthology.task.ansible.out:changed: [smithi194.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-09T11:01:14.264 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-09T11:01:14.266 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:01.009877", "end": "2019-12-09 11:01:14.221748", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-09 11:01:13.211871", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T11:01:14.304 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:14 +0000 (0:00:01.011) 0:04:51.243 ******* 2019-12-09T11:01:14.331 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-09T11:01:14.371 INFO:teuthology.task.ansible.out:Monday 09 December 2019 11:01:14 +0000 (0:00:00.066) 0:04:51.310 ******* 2019-12-09T11:01:14.709 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-09T11:01:14.710 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-09T11:01:14.823 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-12-09T11:01:14.826 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-12-09T11:01:14.828 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2019-12-09T11:01:14.830 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi146.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=160 rescued=0 ignored=3 smithi194.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=160 rescued=0 ignored=3 Monday 09 December 2019 11:01:14 +0000 (0:00:00.457) 0:04:51.768 ******* =============================================================================== users : Create all admin users with sudo access. ----------------------- 35.30s users : Update authorized_keys using the keys repo --------------------- 34.94s common : nrpe - Ensure SELinux policy is up to date -------------------- 26.39s testnode : Install packages -------------------------------------------- 18.31s users : Remove revoked users ------------------------------------------- 16.20s common : Update yum cache ---------------------------------------------- 12.60s testnode : Zap all non-root disks --------------------------------------- 8.85s testnode : Ensure ceph packages are not present. ------------------------ 6.44s common : nrpe - Load SELinux policy package ----------------------------- 5.56s common : nrpe - Remove SELinux policy package --------------------------- 5.42s 2019-12-09T11:01:14.831 INFO:teuthology.task.ansible.out:common : Make sure smartmontools is installed --------------------------- 3.11s testnode : Blow away lingering OSD data and FSIDs ----------------------- 2.96s Gathering Facts --------------------------------------------------------- 2.95s ansible-managed : Add authorized keys for the ansible user. ------------- 2.80s testnode : Create logical volume(s) ------------------------------------- 2.69s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 2.30s common : Configure local epel mirrorlists ------------------------------- 2.20s users : Update authorized_keys for each user with literal keys ---------- 1.98s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.89s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 1.78s 2019-12-09T11:01:15.123 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2019-12-09T11:01:15.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T11:01:15.127 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi146.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T11:01:15.220 INFO:teuthology.orchestra.run.smithi146:> true 2019-12-09T11:01:15.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T11:01:15.613 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi194.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T11:01:15.712 INFO:teuthology.orchestra.run.smithi194:> true 2019-12-09T11:01:16.092 INFO:teuthology.run_tasks:Running task clock... 2019-12-09T11:01:16.124 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-12-09T11:01:16.124 INFO:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-09T11:01:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-09T11:01:26.347 INFO:teuthology.orchestra.run.smithi146.stdout:ntpd: time slew -0.000941s 2019-12-09T11:01:26.385 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit not found. 2019-12-09T11:01:26.463 INFO:teuthology.orchestra.run.smithi146.stdout: remote refid st t when poll reach delay offset jitter 2019-12-09T11:01:26.464 INFO:teuthology.orchestra.run.smithi146.stdout:============================================================================== 2019-12-09T11:01:26.464 INFO:teuthology.orchestra.run.smithi146.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T11:01:26.464 INFO:teuthology.orchestra.run.smithi146.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T11:01:26.464 INFO:teuthology.orchestra.run.smithi146.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T11:01:26.464 INFO:teuthology.orchestra.run.smithi146.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T11:01:26.465 INFO:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-09T11:01:26.600 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-09T11:01:36.693 INFO:teuthology.orchestra.run.smithi194.stdout:ntpd: time slew -0.001549s 2019-12-09T11:01:36.730 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit not found. 2019-12-09T11:01:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: remote refid st t when poll reach delay offset jitter 2019-12-09T11:01:36.807 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================== 2019-12-09T11:01:36.807 INFO:teuthology.orchestra.run.smithi194.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T11:01:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T11:01:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T11:01:36.808 INFO:teuthology.orchestra.run.smithi194.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T11:01:36.809 INFO:teuthology.run_tasks:Running task install... 2019-12-09T11:01:36.826 DEBUG:teuthology.task.install:project ceph 2019-12-09T11:01:36.826 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'notcmalloc', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'}} 2019-12-09T11:01:36.826 DEBUG:teuthology.task.install:config {'flavor': 'notcmalloc', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'} 2019-12-09T11:01:36.826 INFO:teuthology.task.install:Using flavor: notcmalloc 2019-12-09T11:01:36.831 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-12-09T11:01:36.832 INFO:teuthology.task.install:extra packages: [] 2019-12-09T11:01:36.832 INFO:teuthology.orchestra.run.smithi146:> sudo lsb_release -is 2019-12-09T11:01:36.990 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS 2019-12-09T11:01:36.992 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-09T11:01:36.992 INFO:teuthology.orchestra.run.smithi194:> sudo lsb_release -is 2019-12-09T11:01:36.993 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-12-09T11:01:36.993 INFO:teuthology.orchestra.run.smithi146:> sudo lsb_release -is 2019-12-09T11:01:37.126 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS 2019-12-09T11:01:37.128 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-09T11:01:37.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T11:01:37.146 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS 2019-12-09T11:01:37.147 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-09T11:01:37.147 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-12-09T11:01:37.148 INFO:teuthology.orchestra.run.smithi194:> sudo lsb_release -is 2019-12-09T11:01:37.268 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS 2019-12-09T11:01:37.269 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-09T11:01:37.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T11:01:37.293 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-ofriedma-dynamic-disable/1351c819e1a9518cde4c8b12d645782009028360/centos/7/flavors/notcmalloc/ 2019-12-09T11:01:37.294 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7900.g1351c81 2019-12-09T11:01:37.417 INFO:teuthology.orchestra.run.smithi146:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-09T11:01:37.429 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-ofriedma-dynamic-disable/1351c819e1a9518cde4c8b12d645782009028360/centos/7/flavors/notcmalloc/ 2019-12-09T11:01:37.429 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7900.g1351c81 2019-12-09T11:01:37.539 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-12-09T11:01:37.539 INFO:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1351c819e1a9518cde4c8b12d645782009028360/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-09T11:01:37.542 INFO:teuthology.orchestra.run.smithi194:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-09T11:01:37.649 INFO:teuthology.orchestra.run.smithi146:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-09T11:01:37.665 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-12-09T11:01:37.665 INFO:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1351c819e1a9518cde4c8b12d645782009028360/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-09T11:01:37.747 INFO:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-09T11:01:37.776 INFO:teuthology.orchestra.run.smithi194:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-09T11:01:37.825 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2019-12-09T11:01:37.827 INFO:teuthology.orchestra.run.smithi146:> sudo yum clean all 2019-12-09T11:01:37.866 INFO:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-09T11:01:37.945 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2019-12-09T11:01:37.947 INFO:teuthology.orchestra.run.smithi194:> sudo yum clean all 2019-12-09T11:01:38.000 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:01:38.038 INFO:teuthology.orchestra.run.smithi146.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-09T11:01:38.039 INFO:teuthology.orchestra.run.smithi146.stdout: : lab-extras updates 2019-12-09T11:01:38.085 INFO:teuthology.orchestra.run.smithi146.stdout:Cleaning up list of fastest mirrors 2019-12-09T11:01:38.085 INFO:teuthology.orchestra.run.smithi146.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-09T11:01:38.098 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw 2019-12-09T11:01:38.100 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:01:38.139 INFO:teuthology.orchestra.run.smithi194.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-09T11:01:38.139 INFO:teuthology.orchestra.run.smithi194.stdout: : lab-extras updates 2019-12-09T11:01:38.185 INFO:teuthology.orchestra.run.smithi194.stdout:Cleaning up list of fastest mirrors 2019-12-09T11:01:38.185 INFO:teuthology.orchestra.run.smithi194.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-09T11:01:38.200 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw 2019-12-09T11:01:38.254 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:01:38.291 INFO:teuthology.orchestra.run.smithi146.stdout:Determining fastest mirrors 2019-12-09T11:01:38.408 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:01:38.451 INFO:teuthology.orchestra.run.smithi194.stdout:Determining fastest mirrors 2019-12-09T11:01:40.030 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:01:40.030 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:01:40.031 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:01:40.031 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:01:41.027 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:01:41.028 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:01:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:01:41.029 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:02:01.686 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:02:02.045 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:02:02.056 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:02:02.057 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:02:02.057 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.070 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.179 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.180 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.181 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.183 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.183 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.185 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.186 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.187 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.188 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:02:02.189 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-base.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.197 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.198 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.199 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.201 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.202 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.203 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.205 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-12-09T11:02:02.206 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-12-09T11:02:02.206 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-09T11:02:02.207 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package librados2.x86_64 2:15.0.0-7900.g1351c81.el7 will be an update 2019-12-09T11:02:02.209 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-12-09T11:02:02.210 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package librgw2.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.210 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:02:02.211 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.215 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.216 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.217 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.218 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.219 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.220 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.221 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.222 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.223 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.223 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.225 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.225 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-09T11:02:02.225 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.226 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-09T11:02:02.226 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package librbd1.x86_64 2:15.0.0-7900.g1351c81.el7 will be an update 2019-12-09T11:02:02.226 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-09T11:02:02.227 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-09T11:02:02.228 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-09T11:02:02.228 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:02:02.229 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-09T11:02:02.229 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.231 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.231 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.231 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.232 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-12-09T11:02:02.232 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-rados.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.233 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-rbd.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.233 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-rgw.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.233 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-09T11:02:02.415 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:02:02.415 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:02:02.415 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.428 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.536 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.537 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.538 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.540 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.540 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.542 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.543 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.544 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.545 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:02:02.545 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-base.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.554 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.555 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.556 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.557 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.558 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.559 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.562 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-12-09T11:02:02.563 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-12-09T11:02:02.563 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-09T11:02:02.563 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package librados2.x86_64 2:15.0.0-7900.g1351c81.el7 will be an update 2019-12-09T11:02:02.565 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-12-09T11:02:02.566 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package librgw2.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.567 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:02:02.567 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.572 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.573 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.574 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.575 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.576 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.577 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.578 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.579 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.579 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.580 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.581 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:02.581 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-09T11:02:02.581 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.582 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-09T11:02:02.582 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package librbd1.x86_64 2:15.0.0-7900.g1351c81.el7 will be an update 2019-12-09T11:02:02.583 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-09T11:02:02.583 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-09T11:02:02.585 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-09T11:02:02.585 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:02:02.585 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-09T11:02:02.586 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.587 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.587 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.588 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.588 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-12-09T11:02:02.589 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-rados.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.589 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-rbd.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.589 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-rgw.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:02.590 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-09T11:02:03.113 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:02:03.201 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:02:03.201 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:02:03.204 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:02:03.204 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:02:03.204 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository 2019-12-09T11:02:03.204 INFO:teuthology.orchestra.run.smithi146.stdout: Size 2019-12-09T11:02:03.205 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:02:03.205 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:02:03.205 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:15.0.0-7900.g1351c81.el7 ceph 6.2 M 2019-12-09T11:02:03.205 INFO:teuthology.orchestra.run.smithi146.stdout:Installing for dependencies: 2019-12-09T11:02:03.205 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:15.0.0-7900.g1351c81.el7 ceph 5.6 M 2019-12-09T11:02:03.205 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:15.0.0-7900.g1351c81.el7 ceph 20 M 2019-12-09T11:02:03.205 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:15.0.0-7900.g1351c81.el7 ceph 20 k 2019-12-09T11:02:03.205 INFO:teuthology.orchestra.run.smithi146.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-09T11:02:03.206 INFO:teuthology.orchestra.run.smithi146.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-09T11:02:03.206 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 489 k 2019-12-09T11:02:03.206 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-12-09T11:02:03.206 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-12-09T11:02:03.206 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 374 k 2019-12-09T11:02:03.206 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-12-09T11:02:03.206 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 5.4 M 2019-12-09T11:02:03.206 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-09T11:02:03.207 INFO:teuthology.orchestra.run.smithi146.stdout: python-ceph-argparse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 35 k 2019-12-09T11:02:03.207 INFO:teuthology.orchestra.run.smithi146.stdout: python-ceph-common x86_64 2:15.0.0-7900.g1351c81.el7 ceph 42 k 2019-12-09T11:02:03.207 INFO:teuthology.orchestra.run.smithi146.stdout: python-cephfs x86_64 2:15.0.0-7900.g1351c81.el7 ceph 102 k 2019-12-09T11:02:03.207 INFO:teuthology.orchestra.run.smithi146.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-12-09T11:02:03.207 INFO:teuthology.orchestra.run.smithi146.stdout: python-rados x86_64 2:15.0.0-7900.g1351c81.el7 ceph 209 k 2019-12-09T11:02:03.207 INFO:teuthology.orchestra.run.smithi146.stdout: python-rbd x86_64 2:15.0.0-7900.g1351c81.el7 ceph 199 k 2019-12-09T11:02:03.207 INFO:teuthology.orchestra.run.smithi146.stdout: python-rgw x86_64 2:15.0.0-7900.g1351c81.el7 ceph 77 k 2019-12-09T11:02:03.207 INFO:teuthology.orchestra.run.smithi146.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-09T11:02:03.208 INFO:teuthology.orchestra.run.smithi146.stdout:Updating for dependencies: 2019-12-09T11:02:03.208 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 3.5 M 2019-12-09T11:02:03.208 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.8 M 2019-12-09T11:02:03.208 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:02:03.208 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:02:03.208 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:02:03.208 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package (+20 Dependent packages) 2019-12-09T11:02:03.209 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade ( 2 Dependent packages) 2019-12-09T11:02:03.209 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:02:03.209 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 45 M 2019-12-09T11:02:03.209 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:02:03.209 INFO:teuthology.orchestra.run.smithi146.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-09T11:02:03.456 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:02:03.543 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:02:03.543 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:02:03.546 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:02:03.546 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:02:03.546 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository 2019-12-09T11:02:03.547 INFO:teuthology.orchestra.run.smithi194.stdout: Size 2019-12-09T11:02:03.547 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:02:03.547 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:02:03.547 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:15.0.0-7900.g1351c81.el7 ceph 6.2 M 2019-12-09T11:02:03.547 INFO:teuthology.orchestra.run.smithi194.stdout:Installing for dependencies: 2019-12-09T11:02:03.547 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:15.0.0-7900.g1351c81.el7 ceph 5.6 M 2019-12-09T11:02:03.548 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:15.0.0-7900.g1351c81.el7 ceph 20 M 2019-12-09T11:02:03.548 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:15.0.0-7900.g1351c81.el7 ceph 20 k 2019-12-09T11:02:03.548 INFO:teuthology.orchestra.run.smithi194.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-09T11:02:03.548 INFO:teuthology.orchestra.run.smithi194.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-09T11:02:03.548 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 489 k 2019-12-09T11:02:03.548 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-12-09T11:02:03.548 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-12-09T11:02:03.548 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 374 k 2019-12-09T11:02:03.549 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-12-09T11:02:03.549 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 5.4 M 2019-12-09T11:02:03.549 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-09T11:02:03.549 INFO:teuthology.orchestra.run.smithi194.stdout: python-ceph-argparse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 35 k 2019-12-09T11:02:03.549 INFO:teuthology.orchestra.run.smithi194.stdout: python-ceph-common x86_64 2:15.0.0-7900.g1351c81.el7 ceph 42 k 2019-12-09T11:02:03.549 INFO:teuthology.orchestra.run.smithi194.stdout: python-cephfs x86_64 2:15.0.0-7900.g1351c81.el7 ceph 102 k 2019-12-09T11:02:03.549 INFO:teuthology.orchestra.run.smithi194.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-12-09T11:02:03.550 INFO:teuthology.orchestra.run.smithi194.stdout: python-rados x86_64 2:15.0.0-7900.g1351c81.el7 ceph 209 k 2019-12-09T11:02:03.550 INFO:teuthology.orchestra.run.smithi194.stdout: python-rbd x86_64 2:15.0.0-7900.g1351c81.el7 ceph 199 k 2019-12-09T11:02:03.550 INFO:teuthology.orchestra.run.smithi194.stdout: python-rgw x86_64 2:15.0.0-7900.g1351c81.el7 ceph 77 k 2019-12-09T11:02:03.550 INFO:teuthology.orchestra.run.smithi194.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-09T11:02:03.550 INFO:teuthology.orchestra.run.smithi194.stdout:Updating for dependencies: 2019-12-09T11:02:03.550 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 3.5 M 2019-12-09T11:02:03.550 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.8 M 2019-12-09T11:02:03.550 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:02:03.551 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:02:03.551 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:02:03.551 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package (+20 Dependent packages) 2019-12-09T11:02:03.551 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade ( 2 Dependent packages) 2019-12-09T11:02:03.551 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:02:03.551 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 45 M 2019-12-09T11:02:03.551 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:02:03.552 INFO:teuthology.orchestra.run.smithi194.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-09T11:02:31.057 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:02:31.057 INFO:teuthology.orchestra.run.smithi194.stdout:Total 1.6 MB/s | 45 MB 00:27 2019-12-09T11:02:31.064 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:02:31.064 INFO:teuthology.orchestra.run.smithi146.stdout:Total 1.6 MB/s | 45 MB 00:27 2019-12-09T11:02:31.074 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:02:31.081 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:02:31.148 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:02:31.156 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:02:31.379 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:02:31.380 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:02:31.397 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:02:31.397 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:02:32.043 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-12-09T11:02:32.066 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-12-09T11:02:32.375 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-12-09T11:02:32.387 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-12-09T11:02:32.668 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-12-09T11:02:32.780 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-12-09T11:02:32.978 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-09T11:02:33.081 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-09T11:02:33.235 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:python-ceph-argparse-15.0.0-7900.g1351c81.el7.x86_64 5/25 2019-12-09T11:02:33.381 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:python-ceph-argparse-15.0.0-7900.g1351c81.el7.x86_64 5/25 2019-12-09T11:02:33.597 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-12-09T11:02:33.846 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-12-09T11:02:34.389 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-12-09T11:02:34.636 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-12-09T11:02:34.792 INFO:teuthology.orchestra.run.smithi194.stdout: Updating : 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 8/25 2019-12-09T11:02:35.019 INFO:teuthology.orchestra.run.smithi146.stdout: Updating : 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 8/25 2019-12-09T11:02:35.629 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:python-rados-15.0.0-7900.g1351c81.el7.x86_64 9/25 2019-12-09T11:02:35.872 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:python-rados-15.0.0-7900.g1351c81.el7.x86_64 9/25 2019-12-09T11:02:35.960 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:librgw2-15.0.0-7900.g1351c81.el7.x86_64 10/25 2019-12-09T11:02:36.236 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:librgw2-15.0.0-7900.g1351c81.el7.x86_64 10/25 2019-12-09T11:02:36.475 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 11/25 2019-12-09T11:02:36.771 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 11/25 2019-12-09T11:02:36.776 INFO:teuthology.orchestra.run.smithi194.stdout: Updating : 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 12/25 2019-12-09T11:02:37.049 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:python-rbd-15.0.0-7900.g1351c81.el7.x86_64 13/25 2019-12-09T11:02:37.105 INFO:teuthology.orchestra.run.smithi146.stdout: Updating : 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 12/25 2019-12-09T11:02:37.298 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:python-cephfs-15.0.0-7900.g1351c81.el7.x86_64 14/25 2019-12-09T11:02:37.404 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:python-rbd-15.0.0-7900.g1351c81.el7.x86_64 13/25 2019-12-09T11:02:37.641 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:python-rgw-15.0.0-7900.g1351c81.el7.x86_64 15/25 2019-12-09T11:02:37.676 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:python-cephfs-15.0.0-7900.g1351c81.el7.x86_64 14/25 2019-12-09T11:02:37.911 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:libradosstriper1-15.0.0-7900.g1351c81.el7.x86_64 16/25 2019-12-09T11:02:37.966 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:python-rgw-15.0.0-7900.g1351c81.el7.x86_64 15/25 2019-12-09T11:02:38.169 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-12-09T11:02:38.258 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:libradosstriper1-15.0.0-7900.g1351c81.el7.x86_64 16/25 2019-12-09T11:02:38.532 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 18/25 2019-12-09T11:02:38.557 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-12-09T11:02:39.088 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 18/25 2019-12-09T11:02:40.889 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:python-ceph-common-15.0.0-7900.g1351c81.el7.x86_64 19/25 2019-12-09T11:02:41.511 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:python-ceph-common-15.0.0-7900.g1351c81.el7.x86_64 19/25 2019-12-09T11:02:42.065 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 20/25 2019-12-09T11:02:42.542 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 21/25 2019-12-09T11:02:42.684 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 20/25 2019-12-09T11:02:43.212 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 21/25 2019-12-09T11:02:52.078 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-selinux-15.0.0-7900.g1351c81.el7.x86_64 22/25 2019-12-09T11:02:52.474 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 23/25 2019-12-09T11:02:52.641 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-selinux-15.0.0-7900.g1351c81.el7.x86_64 22/25 2019-12-09T11:02:52.742 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-09T11:02:53.028 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-09T11:02:53.029 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 23/25 2019-12-09T11:02:53.146 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7900.g1351c81.el7.x86_64 1/25 2019-12-09T11:02:53.255 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 2/25 2019-12-09T11:02:53.314 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-09T11:02:53.389 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:libradosstriper1-15.0.0-7900.g1351c81.el7.x86_64 3/25 2019-12-09T11:02:53.472 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-09T11:02:53.600 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-09T11:02:53.606 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 5/25 2019-12-09T11:02:53.715 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:python-ceph-common-15.0.0-7900.g1351c81.el7.x86_64 6/25 2019-12-09T11:02:53.735 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7900.g1351c81.el7.x86_64 1/25 2019-12-09T11:02:53.815 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:librgw2-15.0.0-7900.g1351c81.el7.x86_64 7/25 2019-12-09T11:02:53.852 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 2/25 2019-12-09T11:02:53.933 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 8/25 2019-12-09T11:02:53.977 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:libradosstriper1-15.0.0-7900.g1351c81.el7.x86_64 3/25 2019-12-09T11:02:54.016 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 9/25 2019-12-09T11:02:54.069 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-09T11:02:54.134 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 10/25 2019-12-09T11:02:54.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 5/25 2019-12-09T11:02:54.251 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 11/25 2019-12-09T11:02:54.329 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:python-ceph-common-15.0.0-7900.g1351c81.el7.x86_64 6/25 2019-12-09T11:02:54.376 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:python-rgw-15.0.0-7900.g1351c81.el7.x86_64 12/25 2019-12-09T11:02:54.437 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:librgw2-15.0.0-7900.g1351c81.el7.x86_64 7/25 2019-12-09T11:02:54.510 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 13/25 2019-12-09T11:02:54.563 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 8/25 2019-12-09T11:02:54.619 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 14/25 2019-12-09T11:02:54.697 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 9/25 2019-12-09T11:02:54.719 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-selinux-15.0.0-7900.g1351c81.el7.x86_64 15/25 2019-12-09T11:02:54.814 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 10/25 2019-12-09T11:02:54.820 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 16/25 2019-12-09T11:02:54.915 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 11/25 2019-12-09T11:02:54.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 17/25 2019-12-09T11:02:55.016 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:python-rgw-15.0.0-7900.g1351c81.el7.x86_64 12/25 2019-12-09T11:02:55.062 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:python-rbd-15.0.0-7900.g1351c81.el7.x86_64 18/25 2019-12-09T11:02:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 13/25 2019-12-09T11:02:55.171 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 19/25 2019-12-09T11:02:55.233 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 14/25 2019-12-09T11:02:55.272 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 20/25 2019-12-09T11:02:55.326 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-selinux-15.0.0-7900.g1351c81.el7.x86_64 15/25 2019-12-09T11:02:55.398 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/25 2019-12-09T11:02:55.409 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 16/25 2019-12-09T11:02:55.489 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:python-rados-15.0.0-7900.g1351c81.el7.x86_64 22/25 2019-12-09T11:02:55.560 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 17/25 2019-12-09T11:02:55.590 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:python-cephfs-15.0.0-7900.g1351c81.el7.x86_64 23/25 2019-12-09T11:02:55.591 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-09T11:02:55.669 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:python-rbd-15.0.0-7900.g1351c81.el7.x86_64 18/25 2019-12-09T11:02:55.769 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 19/25 2019-12-09T11:02:55.895 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 20/25 2019-12-09T11:02:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-09T11:02:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:02:55.965 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:02:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.965 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:02:55.966 INFO:teuthology.orchestra.run.smithi194.stdout:Dependency Installed: 2019-12-09T11:02:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-12-09T11:02:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-09T11:02:55.966 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-12-09T11:02:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-12-09T11:02:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-12-09T11:02:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-09T11:02:55.967 INFO:teuthology.orchestra.run.smithi194.stdout: python-ceph-argparse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: python-ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: python-cephfs.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-12-09T11:02:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: python-rados.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: python-rbd.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: python-rgw.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.968 INFO:teuthology.orchestra.run.smithi194.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-09T11:02:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:02:55.969 INFO:teuthology.orchestra.run.smithi194.stdout:Dependency Updated: 2019-12-09T11:02:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: librados2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:55.969 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:02:55.969 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:02:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/25 2019-12-09T11:02:56.098 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-test 2019-12-09T11:02:56.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:python-rados-15.0.0-7900.g1351c81.el7.x86_64 22/25 2019-12-09T11:02:56.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:python-cephfs-15.0.0-7900.g1351c81.el7.x86_64 23/25 2019-12-09T11:02:56.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-09T11:02:56.353 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:02:56.391 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:02:56.392 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:02:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:02:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:02:56.393 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:02:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-09T11:02:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:02:56.669 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:02:56.669 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:02:56.670 INFO:teuthology.orchestra.run.smithi146.stdout:Dependency Installed: 2019-12-09T11:02:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-12-09T11:02:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-09T11:02:56.670 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-12-09T11:02:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-12-09T11:02:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-12-09T11:02:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-09T11:02:56.671 INFO:teuthology.orchestra.run.smithi146.stdout: python-ceph-argparse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: python-ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: python-cephfs.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-12-09T11:02:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: python-rados.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: python-rbd.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: python-rgw.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.672 INFO:teuthology.orchestra.run.smithi146.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-09T11:02:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:02:56.673 INFO:teuthology.orchestra.run.smithi146.stdout:Dependency Updated: 2019-12-09T11:02:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: librados2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:02:56.673 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:02:56.673 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:02:56.789 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-test 2019-12-09T11:02:57.015 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:02:57.095 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:02:57.140 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:02:57.141 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:02:57.141 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:02:57.142 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:02:57.142 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:02:57.345 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:02:57.346 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:02:57.346 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-test.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:57.363 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:57.393 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:57.394 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:57.395 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:02:57.395 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-12-09T11:02:57.396 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-12-09T11:02:57.397 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-12-09T11:02:57.399 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-09T11:02:57.401 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:02:57.401 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-12-09T11:02:57.759 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:02:57.821 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:02:57.981 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:02:57.981 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:02:57.982 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:02:57.982 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:02:57.982 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository 2019-12-09T11:02:57.982 INFO:teuthology.orchestra.run.smithi194.stdout: Size 2019-12-09T11:02:57.983 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:02:57.983 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:02:57.983 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:15.0.0-7900.g1351c81.el7 ceph 38 M 2019-12-09T11:02:57.983 INFO:teuthology.orchestra.run.smithi194.stdout:Installing for dependencies: 2019-12-09T11:02:57.983 INFO:teuthology.orchestra.run.smithi194.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-12-09T11:02:57.983 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-12-09T11:02:57.983 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-12-09T11:02:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-09T11:02:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:02:57.984 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:02:57.984 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:02:57.984 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package (+4 Dependent packages) 2019-12-09T11:02:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:02:57.984 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 38 M 2019-12-09T11:02:57.984 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 134 M 2019-12-09T11:02:57.985 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:02:58.174 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:02:58.174 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:02:58.174 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-test.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:02:58.192 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:58.222 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:58.223 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:02:58.224 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:02:58.224 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-12-09T11:02:58.225 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-12-09T11:02:58.226 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-12-09T11:02:58.228 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-09T11:02:58.230 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:02:58.231 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-12-09T11:02:58.593 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:02:58.820 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:02:58.820 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:02:58.821 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:02:58.821 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:02:58.821 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository 2019-12-09T11:02:58.821 INFO:teuthology.orchestra.run.smithi146.stdout: Size 2019-12-09T11:02:58.821 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:02:58.821 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:02:58.822 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:15.0.0-7900.g1351c81.el7 ceph 38 M 2019-12-09T11:02:58.822 INFO:teuthology.orchestra.run.smithi146.stdout:Installing for dependencies: 2019-12-09T11:02:58.822 INFO:teuthology.orchestra.run.smithi146.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-12-09T11:02:58.822 INFO:teuthology.orchestra.run.smithi146.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-12-09T11:02:58.822 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-12-09T11:02:58.822 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-09T11:02:58.822 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:02:58.822 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:02:58.823 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:02:58.823 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package (+4 Dependent packages) 2019-12-09T11:02:58.823 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:02:58.823 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 38 M 2019-12-09T11:02:58.824 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 134 M 2019-12-09T11:02:58.824 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:03:16.471 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:03:16.471 INFO:teuthology.orchestra.run.smithi146.stdout:Total 2.2 MB/s | 38 MB 00:17 2019-12-09T11:03:16.474 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:03:16.501 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:03:16.508 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:03:16.509 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.1 MB/s | 38 MB 00:18 2019-12-09T11:03:16.511 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:03:16.531 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:03:16.589 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:03:16.590 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:03:16.615 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:03:16.615 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:03:17.235 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-12-09T11:03:17.326 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-12-09T11:03:17.505 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-12-09T11:03:17.637 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-12-09T11:03:17.807 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-12-09T11:03:17.933 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-12-09T11:03:21.803 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-12-09T11:03:21.949 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-12-09T11:03:22.108 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 5/5 2019-12-09T11:03:22.254 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 1/5 2019-12-09T11:03:22.256 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 5/5 2019-12-09T11:03:22.365 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 1/5 2019-12-09T11:03:22.383 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-12-09T11:03:22.473 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-12-09T11:03:22.508 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-12-09T11:03:22.607 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-12-09T11:03:22.626 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-12-09T11:03:22.707 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-12-09T11:03:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-12-09T11:03:23.052 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:23.052 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:03:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:23.053 INFO:teuthology.orchestra.run.smithi194.stdout:Dependency Installed: 2019-12-09T11:03:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-12-09T11:03:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-09T11:03:23.053 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:23.053 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:03:23.182 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph 2019-12-09T11:03:23.184 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-12-09T11:03:23.184 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:23.184 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:03:23.184 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:23.184 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:23.185 INFO:teuthology.orchestra.run.smithi146.stdout:Dependency Installed: 2019-12-09T11:03:23.185 INFO:teuthology.orchestra.run.smithi146.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-12-09T11:03:23.185 INFO:teuthology.orchestra.run.smithi146.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-09T11:03:23.185 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:23.185 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:03:23.316 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph 2019-12-09T11:03:23.447 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:03:23.492 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:03:23.493 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:03:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:03:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:03:23.494 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:03:23.581 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:03:23.621 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:03:23.622 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:03:23.623 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:03:23.623 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:03:23.623 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:03:24.153 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:03:24.295 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:03:24.496 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:03:24.497 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:03:24.497 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:24.499 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.529 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.530 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.531 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.533 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:03:24.533 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:24.542 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:24.544 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.545 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.547 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.548 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.549 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.550 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.551 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:24.553 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:24.558 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:03:24.558 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-12-09T11:03:24.559 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-12-09T11:03:24.559 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-12-09T11:03:24.560 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T11:03:24.561 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T11:03:24.562 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T11:03:24.563 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T11:03:24.564 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T11:03:24.564 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-12-09T11:03:24.565 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-12-09T11:03:24.566 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-09T11:03:24.566 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-12-09T11:03:24.567 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-12-09T11:03:24.568 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:03:24.568 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-12-09T11:03:24.568 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-12-09T11:03:24.568 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-12-09T11:03:24.569 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-12-09T11:03:24.570 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-12-09T11:03:24.570 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-09T11:03:24.571 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-12-09T11:03:24.571 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-12-09T11:03:24.571 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-12-09T11:03:24.571 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:03:24.571 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-12-09T11:03:24.571 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-12-09T11:03:24.572 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-09T11:03:24.572 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:03:24.572 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-12-09T11:03:24.573 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-12-09T11:03:24.573 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:03:24.573 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-12-09T11:03:24.630 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:03:24.631 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:03:24.631 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:24.633 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.663 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.664 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.665 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.667 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:03:24.667 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:24.676 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:24.678 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.679 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.681 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.682 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.683 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.684 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:03:24.685 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:24.688 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:24.692 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:03:24.692 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-12-09T11:03:24.693 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-12-09T11:03:24.694 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-12-09T11:03:24.695 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T11:03:24.695 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T11:03:24.696 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T11:03:24.697 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T11:03:24.698 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T11:03:24.699 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-12-09T11:03:24.699 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-12-09T11:03:24.700 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-09T11:03:24.701 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-12-09T11:03:24.701 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-12-09T11:03:24.702 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:03:24.702 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-12-09T11:03:24.702 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-12-09T11:03:24.703 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-12-09T11:03:24.704 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-12-09T11:03:24.704 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-12-09T11:03:24.704 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-09T11:03:24.705 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-12-09T11:03:24.705 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-12-09T11:03:24.706 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-12-09T11:03:24.706 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:03:24.706 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-12-09T11:03:24.706 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-12-09T11:03:24.707 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-09T11:03:24.707 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:03:24.707 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-12-09T11:03:24.707 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-12-09T11:03:24.708 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:03:24.708 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-12-09T11:03:24.930 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:03:25.070 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:03:25.153 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:25.153 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:03:25.156 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:25.156 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:03:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository 2019-12-09T11:03:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: Size 2019-12-09T11:03:25.157 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:03:25.157 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:03:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:15.0.0-7900.g1351c81.el7 ceph 2.0 k 2019-12-09T11:03:25.157 INFO:teuthology.orchestra.run.smithi194.stdout:Installing for dependencies: 2019-12-09T11:03:25.157 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.9 M 2019-12-09T11:03:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.7 M 2019-12-09T11:03:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:15.0.0-7900.g1351c81.el7 ceph 4.4 M 2019-12-09T11:03:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:15.0.0-7900.g1351c81.el7 ceph 16 M 2019-12-09T11:03:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-12-09T11:03:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-12-09T11:03:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-12-09T11:03:25.158 INFO:teuthology.orchestra.run.smithi194.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-12-09T11:03:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-09T11:03:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-12-09T11:03:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-12-09T11:03:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-12-09T11:03:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-12-09T11:03:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-12-09T11:03:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-12-09T11:03:25.159 INFO:teuthology.orchestra.run.smithi194.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-09T11:03:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-12-09T11:03:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-12-09T11:03:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-09T11:03:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-12-09T11:03:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-12-09T11:03:25.160 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:25.160 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:03:25.161 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:03:25.161 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package (+21 Dependent packages) 2019-12-09T11:03:25.161 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:25.161 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 28 M 2019-12-09T11:03:25.162 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 87 M 2019-12-09T11:03:25.162 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:03:25.295 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:25.295 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:03:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:25.298 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:03:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository 2019-12-09T11:03:25.298 INFO:teuthology.orchestra.run.smithi146.stdout: Size 2019-12-09T11:03:25.299 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:03:25.299 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:03:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:15.0.0-7900.g1351c81.el7 ceph 2.0 k 2019-12-09T11:03:25.299 INFO:teuthology.orchestra.run.smithi146.stdout:Installing for dependencies: 2019-12-09T11:03:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.9 M 2019-12-09T11:03:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.7 M 2019-12-09T11:03:25.299 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:15.0.0-7900.g1351c81.el7 ceph 4.4 M 2019-12-09T11:03:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:15.0.0-7900.g1351c81.el7 ceph 16 M 2019-12-09T11:03:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-12-09T11:03:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-12-09T11:03:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-12-09T11:03:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-12-09T11:03:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-09T11:03:25.300 INFO:teuthology.orchestra.run.smithi146.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-12-09T11:03:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-12-09T11:03:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-12-09T11:03:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-12-09T11:03:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-12-09T11:03:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-12-09T11:03:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-09T11:03:25.301 INFO:teuthology.orchestra.run.smithi146.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-12-09T11:03:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-12-09T11:03:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-09T11:03:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-12-09T11:03:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-12-09T11:03:25.302 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:25.302 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:03:25.302 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:03:25.303 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package (+21 Dependent packages) 2019-12-09T11:03:25.303 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:25.303 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 28 M 2019-12-09T11:03:25.303 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 87 M 2019-12-09T11:03:25.304 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:03:34.298 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:03:34.298 INFO:teuthology.orchestra.run.smithi194.stdout:Total 3.0 MB/s | 28 MB 00:09 2019-12-09T11:03:34.316 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:03:34.352 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:03:34.614 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:03:34.618 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:03:35.417 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-12-09T11:03:35.693 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:03:35.693 INFO:teuthology.orchestra.run.smithi146.stdout:Total 2.7 MB/s | 28 MB 00:10 2019-12-09T11:03:35.717 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:03:35.717 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-12-09T11:03:35.761 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:03:35.968 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-12-09T11:03:36.035 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:03:36.035 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:03:36.445 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 4/22 2019-12-09T11:03:36.749 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-12-09T11:03:36.804 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 5/22 2019-12-09T11:03:37.058 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-12-09T11:03:37.207 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 6/22 2019-12-09T11:03:37.351 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-12-09T11:03:37.736 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 7/22 2019-12-09T11:03:37.830 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 4/22 2019-12-09T11:03:38.218 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 5/22 2019-12-09T11:03:38.659 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 6/22 2019-12-09T11:03:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 7/22 2019-12-09T11:03:39.615 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 8/22 2019-12-09T11:03:40.022 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-osd-15.0.0-7900.g1351c81.el7.x86_64 9/22 2019-12-09T11:03:40.431 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 10/22 2019-12-09T11:03:40.747 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-mako-0.8.1-2.el7.noarch 11/22 2019-12-09T11:03:41.043 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 8/22 2019-12-09T11:03:41.463 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-osd-15.0.0-7900.g1351c81.el7.x86_64 9/22 2019-12-09T11:03:41.480 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 12/22 2019-12-09T11:03:41.878 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 10/22 2019-12-09T11:03:41.911 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-mon-15.0.0-7900.g1351c81.el7.x86_64 13/22 2019-12-09T11:03:42.230 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-mako-0.8.1-2.el7.noarch 11/22 2019-12-09T11:03:42.268 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-12-09T11:03:42.826 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-12-09T11:03:42.977 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 12/22 2019-12-09T11:03:43.192 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-mds-15.0.0-7900.g1351c81.el7.x86_64 16/22 2019-12-09T11:03:43.387 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-12-09T11:03:43.474 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-mon-15.0.0-7900.g1351c81.el7.x86_64 13/22 2019-12-09T11:03:43.627 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-12-09T11:03:43.765 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-12-09T11:03:44.036 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-12-09T11:03:44.324 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-12-09T11:03:44.697 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-12-09T11:03:44.706 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-mds-15.0.0-7900.g1351c81.el7.x86_64 16/22 2019-12-09T11:03:44.951 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-12-09T11:03:45.090 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 21/22 2019-12-09T11:03:45.224 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-12-09T11:03:45.344 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 22/22 2019-12-09T11:03:45.447 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-12-09T11:03:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-12-09T11:03:45.640 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-12-09T11:03:45.656 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-12-09T11:03:45.757 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-12-09T11:03:45.849 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-mds-15.0.0-7900.g1351c81.el7.x86_64 5/22 2019-12-09T11:03:45.966 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-12-09T11:03:46.091 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-mon-15.0.0-7900.g1351c81.el7.x86_64 7/22 2019-12-09T11:03:46.192 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 8/22 2019-12-09T11:03:46.317 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-12-09T11:03:46.395 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-12-09T11:03:46.409 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-12-09T11:03:46.535 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-12-09T11:03:46.643 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-12-09T11:03:46.744 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-osd-15.0.0-7900.g1351c81.el7.x86_64 13/22 2019-12-09T11:03:46.796 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 21/22 2019-12-09T11:03:46.861 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 14/22 2019-12-09T11:03:46.986 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 15/22 2019-12-09T11:03:47.050 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 22/22 2019-12-09T11:03:47.095 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-12-09T11:03:47.203 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-12-09T11:03:47.229 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-12-09T11:03:47.312 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-12-09T11:03:47.360 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 18/22 2019-12-09T11:03:47.437 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-12-09T11:03:47.471 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 19/22 2019-12-09T11:03:47.555 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 20/22 2019-12-09T11:03:47.588 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-12-09T11:03:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 21/22 2019-12-09T11:03:47.688 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-mds-15.0.0-7900.g1351c81.el7.x86_64 5/22 2019-12-09T11:03:47.805 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-12-09T11:03:47.914 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-mon-15.0.0-7900.g1351c81.el7.x86_64 7/22 2019-12-09T11:03:48.048 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 8/22 2019-12-09T11:03:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-12-09T11:03:48.084 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:48.084 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:03:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: ceph.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:48.085 INFO:teuthology.orchestra.run.smithi194.stdout:Dependency Installed: 2019-12-09T11:03:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:48.085 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-12-09T11:03:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-12-09T11:03:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-12-09T11:03:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-12-09T11:03:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-09T11:03:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-12-09T11:03:48.086 INFO:teuthology.orchestra.run.smithi194.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-12-09T11:03:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-12-09T11:03:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-12-09T11:03:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-12-09T11:03:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-12-09T11:03:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-09T11:03:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-12-09T11:03:48.087 INFO:teuthology.orchestra.run.smithi194.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-12-09T11:03:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-09T11:03:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-12-09T11:03:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-12-09T11:03:48.088 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:48.088 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:03:48.148 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-12-09T11:03:48.210 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-daemon 2019-12-09T11:03:48.240 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-12-09T11:03:48.333 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-12-09T11:03:48.475 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-12-09T11:03:48.499 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:03:48.544 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:03:48.545 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:03:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:03:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:03:48.546 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:03:48.567 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-osd-15.0.0-7900.g1351c81.el7.x86_64 13/22 2019-12-09T11:03:48.659 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 14/22 2019-12-09T11:03:48.777 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 15/22 2019-12-09T11:03:48.895 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-12-09T11:03:49.193 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:03:49.236 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-12-09T11:03:49.386 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 18/22 2019-12-09T11:03:49.512 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 19/22 2019-12-09T11:03:49.535 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:03:49.535 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:03:49.536 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:49.621 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 20/22 2019-12-09T11:03:49.721 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 21/22 2019-12-09T11:03:49.905 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:03:50.128 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:50.129 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:03:50.129 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:50.129 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:03:50.130 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository 2019-12-09T11:03:50.130 INFO:teuthology.orchestra.run.smithi194.stdout: Size 2019-12-09T11:03:50.130 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:03:50.130 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:03:50.130 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-daemon x86_64 2:15.0.0-7900.g1351c81.el7 ceph 17 k 2019-12-09T11:03:50.130 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:50.130 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:03:50.131 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:03:50.131 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2019-12-09T11:03:50.131 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:50.131 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 17 k 2019-12-09T11:03:50.131 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 68 k 2019-12-09T11:03:50.131 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:03:50.279 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-12-09T11:03:50.279 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:50.279 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:03:50.280 INFO:teuthology.orchestra.run.smithi146.stdout: ceph.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:50.280 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:50.280 INFO:teuthology.orchestra.run.smithi146.stdout:Dependency Installed: 2019-12-09T11:03:50.280 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:50.280 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:50.280 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:50.281 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:50.281 INFO:teuthology.orchestra.run.smithi146.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-12-09T11:03:50.281 INFO:teuthology.orchestra.run.smithi146.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-12-09T11:03:50.281 INFO:teuthology.orchestra.run.smithi146.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-12-09T11:03:50.281 INFO:teuthology.orchestra.run.smithi146.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-12-09T11:03:50.281 INFO:teuthology.orchestra.run.smithi146.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-09T11:03:50.281 INFO:teuthology.orchestra.run.smithi146.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-12-09T11:03:50.282 INFO:teuthology.orchestra.run.smithi146.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-12-09T11:03:50.282 INFO:teuthology.orchestra.run.smithi146.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-12-09T11:03:50.282 INFO:teuthology.orchestra.run.smithi146.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-12-09T11:03:50.282 INFO:teuthology.orchestra.run.smithi146.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-12-09T11:03:50.282 INFO:teuthology.orchestra.run.smithi146.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-12-09T11:03:50.282 INFO:teuthology.orchestra.run.smithi146.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-09T11:03:50.282 INFO:teuthology.orchestra.run.smithi146.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-12-09T11:03:50.283 INFO:teuthology.orchestra.run.smithi146.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-12-09T11:03:50.283 INFO:teuthology.orchestra.run.smithi146.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-09T11:03:50.283 INFO:teuthology.orchestra.run.smithi146.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-12-09T11:03:50.283 INFO:teuthology.orchestra.run.smithi146.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-12-09T11:03:50.283 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:50.283 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:03:50.399 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-daemon 2019-12-09T11:03:50.473 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:03:50.481 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:03:50.483 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:03:50.484 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:03:50.687 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:03:50.734 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:03:50.735 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:03:50.735 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:03:50.736 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:03:50.736 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:03:51.291 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-daemon-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T11:03:51.389 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:03:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-daemon-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T11:03:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:51.705 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:03:51.705 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-daemon.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:51.706 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:51.706 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:03:51.738 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:03:51.739 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:03:51.739 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:51.832 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr 2019-12-09T11:03:52.106 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:03:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:03:52.152 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:03:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:03:52.153 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:03:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:03:52.154 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:03:52.330 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:03:52.331 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:03:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository 2019-12-09T11:03:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: Size 2019-12-09T11:03:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:03:52.332 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:03:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-daemon x86_64 2:15.0.0-7900.g1351c81.el7 ceph 17 k 2019-12-09T11:03:52.332 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:03:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:03:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2019-12-09T11:03:52.333 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 17 k 2019-12-09T11:03:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 68 k 2019-12-09T11:03:52.333 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:03:52.638 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:03:52.646 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:03:52.648 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:03:52.649 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:03:52.808 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:03:53.153 INFO:teuthology.orchestra.run.smithi194.stdout:Package 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T11:03:53.153 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do 2019-12-09T11:03:53.215 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-dashboard 2019-12-09T11:03:53.465 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:03:53.508 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-daemon-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T11:03:53.510 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:03:53.512 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:03:53.512 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:03:53.512 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:03:53.513 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:03:54.159 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:03:54.501 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:03:54.502 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:03:54.502 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:54.505 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T11:03:54.535 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T11:03:54.536 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:03:54.536 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:54.537 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-12-09T11:03:54.537 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-12-09T11:03:54.538 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:03:54.538 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-12-09T11:03:54.887 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-daemon-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T11:03:54.887 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:54.888 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:03:54.888 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-daemon.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:03:54.888 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:54.888 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:03:54.904 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:03:55.015 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-mgr 2019-12-09T11:03:55.128 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:55.128 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:03:55.129 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:55.129 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:03:55.129 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2019-12-09T11:03:55.129 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:03:55.130 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:03:55.130 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 3.9 M 2019-12-09T11:03:55.130 INFO:teuthology.orchestra.run.smithi194.stdout:Installing for dependencies: 2019-12-09T11:03:55.130 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 18 k 2019-12-09T11:03:55.130 INFO:teuthology.orchestra.run.smithi194.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-12-09T11:03:55.130 INFO:teuthology.orchestra.run.smithi194.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-12-09T11:03:55.130 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:55.131 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:03:55.131 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:03:55.131 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package (+3 Dependent packages) 2019-12-09T11:03:55.131 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:03:55.131 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 4.6 M 2019-12-09T11:03:55.131 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 20 M 2019-12-09T11:03:55.131 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:03:55.302 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:03:55.348 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:03:55.349 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:03:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:03:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:03:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:03:56.009 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:03:56.355 INFO:teuthology.orchestra.run.smithi146.stdout:Package 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T11:03:56.356 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do 2019-12-09T11:03:56.417 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-mgr-dashboard 2019-12-09T11:03:56.585 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:03:56.621 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:03:56.622 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:03:56.623 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:03:56.623 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:03:56.623 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:03:57.247 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:03:57.582 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:03:57.582 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:03:57.582 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:57.585 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T11:03:57.616 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T11:03:57.617 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:03:57.617 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:03:57.618 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-12-09T11:03:57.618 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-12-09T11:03:57.619 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:03:57.619 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-12-09T11:03:57.998 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:03:58.231 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:58.232 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:03:58.233 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:58.233 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:03:58.233 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2019-12-09T11:03:58.233 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:03:58.234 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:03:58.234 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 3.9 M 2019-12-09T11:03:58.234 INFO:teuthology.orchestra.run.smithi146.stdout:Installing for dependencies: 2019-12-09T11:03:58.234 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 18 k 2019-12-09T11:03:58.235 INFO:teuthology.orchestra.run.smithi146.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-12-09T11:03:58.235 INFO:teuthology.orchestra.run.smithi146.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-12-09T11:03:58.235 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:58.235 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:03:58.235 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:03:58.236 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package (+3 Dependent packages) 2019-12-09T11:03:58.236 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:03:58.236 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 4.6 M 2019-12-09T11:03:58.236 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 20 M 2019-12-09T11:03:58.237 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:03:59.387 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:03:59.387 INFO:teuthology.orchestra.run.smithi146.stdout:Total 4.0 MB/s | 4.6 MB 00:01 2019-12-09T11:03:59.392 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:03:59.395 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:03:59.396 INFO:teuthology.orchestra.run.smithi194.stdout:Total 1.1 MB/s | 4.6 MB 00:04 2019-12-09T11:03:59.400 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:03:59.401 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:03:59.410 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:03:59.549 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:03:59.550 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:03:59.587 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:03:59.588 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:04:00.225 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7900.g1351c81.el7.noarch 1/4 2019-12-09T11:04:00.248 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7900.g1351c81.el7.noarch 1/4 2019-12-09T11:04:00.653 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-12-09T11:04:00.664 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-12-09T11:04:01.792 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-12-09T11:04:01.794 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-12-09T11:04:02.222 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 4/4 2019-12-09T11:04:02.240 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 4/4 2019-12-09T11:04:02.324 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-12-09T11:04:02.358 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-12-09T11:04:02.492 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2/4 2019-12-09T11:04:02.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2/4 2019-12-09T11:04:02.600 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7900.g1351c81.el7.noarch 3/4 2019-12-09T11:04:02.600 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7900.g1351c81.el7.noarch 3/4 2019-12-09T11:04:03.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-12-09T11:04:03.094 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:03.094 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:04:03.094 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:03.094 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:03.095 INFO:teuthology.orchestra.run.smithi146.stdout:Dependency Installed: 2019-12-09T11:04:03.095 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:03.095 INFO:teuthology.orchestra.run.smithi146.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-12-09T11:04:03.095 INFO:teuthology.orchestra.run.smithi146.stdout: python-routes.noarch 0:1.13-2.el7 2019-12-09T11:04:03.095 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:03.095 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:04:03.096 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-12-09T11:04:03.096 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:03.096 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:04:03.096 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:03.096 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:03.096 INFO:teuthology.orchestra.run.smithi194.stdout:Dependency Installed: 2019-12-09T11:04:03.097 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:03.097 INFO:teuthology.orchestra.run.smithi194.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-12-09T11:04:03.097 INFO:teuthology.orchestra.run.smithi194.stdout: python-routes.noarch 0:1.13-2.el7 2019-12-09T11:04:03.097 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:03.097 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:04:03.214 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-12-09T11:04:03.222 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-12-09T11:04:03.477 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:03.482 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:03.521 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:03.525 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:04:03.525 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:04:03.525 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:03.525 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:03.527 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:03.528 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:04:03.528 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:04:03.529 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:03.529 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:04.183 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:04.188 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:04.521 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:04:04.522 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:04.522 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:04.541 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:04:04.541 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:04.542 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:04.890 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:04.908 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:05.114 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:05.115 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:04:05.115 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:05.116 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:05.116 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2019-12-09T11:04:05.116 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:05.116 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:04:05.116 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-cloud 2019-12-09T11:04:05.116 INFO:teuthology.orchestra.run.smithi194.stdout: noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 82 k 2019-12-09T11:04:05.116 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:05.117 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:04:05.117 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:05.117 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2019-12-09T11:04:05.117 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:05.117 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 82 k 2019-12-09T11:04:05.117 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 411 k 2019-12-09T11:04:05.117 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:04:05.132 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:05.133 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:04:05.133 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:05.134 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:05.134 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2019-12-09T11:04:05.134 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:05.134 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:04:05.134 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-cloud 2019-12-09T11:04:05.134 INFO:teuthology.orchestra.run.smithi146.stdout: noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 82 k 2019-12-09T11:04:05.134 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:05.135 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:04:05.135 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:05.135 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2019-12-09T11:04:05.135 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:05.136 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 82 k 2019-12-09T11:04:05.136 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 411 k 2019-12-09T11:04:05.136 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:04:05.430 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:04:05.433 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:04:05.477 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:04:05.481 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:04:05.484 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:04:05.484 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:04:05.535 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:04:05.535 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:04:06.141 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7900.g1351c81.el7.n 1/1 2019-12-09T11:04:06.265 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7900.g1351c81.el7.n 1/1 2019-12-09T11:04:06.639 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7900.g1351c81.el7.n 1/1 2019-12-09T11:04:06.639 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:06.639 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:04:06.640 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:06.640 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:06.640 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:04:06.705 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7900.g1351c81.el7.n 1/1 2019-12-09T11:04:06.705 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:06.705 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:04:06.705 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:06.705 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:06.706 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:04:06.757 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-diskprediction-local 2019-12-09T11:04:06.821 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-mgr-diskprediction-local 2019-12-09T11:04:06.994 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:07.036 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:07.038 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:04:07.038 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:04:07.038 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:07.039 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:07.085 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:07.131 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:07.132 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:04:07.133 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:04:07.133 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:07.134 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:07.691 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:07.791 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:08.024 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:04:08.024 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:08.025 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:08.027 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T11:04:08.057 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:08.057 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-12-09T11:04:08.064 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-12-09T11:04:08.065 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-09T11:04:08.067 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-09T11:04:08.067 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:08.067 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-12-09T11:04:08.068 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-12-09T11:04:08.069 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-09T11:04:08.071 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-09T11:04:08.071 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:08.071 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-12-09T11:04:08.138 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:04:08.139 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:08.139 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:08.141 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T11:04:08.172 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:08.172 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-12-09T11:04:08.179 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-12-09T11:04:08.180 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-09T11:04:08.182 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-09T11:04:08.182 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:08.182 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-12-09T11:04:08.183 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-12-09T11:04:08.184 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-09T11:04:08.185 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-09T11:04:08.186 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:08.186 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-12-09T11:04:08.433 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:08.550 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:08.658 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:04:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:08.659 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2019-12-09T11:04:08.659 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:08.659 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:04:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local 2019-12-09T11:04:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 8.6 M 2019-12-09T11:04:08.660 INFO:teuthology.orchestra.run.smithi194.stdout:Installing for dependencies: 2019-12-09T11:04:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-12-09T11:04:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-12-09T11:04:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-12-09T11:04:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-12-09T11:04:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:08.661 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:04:08.661 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:08.661 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package (+4 Dependent packages) 2019-12-09T11:04:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:08.661 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 19 M 2019-12-09T11:04:08.661 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 104 M 2019-12-09T11:04:08.662 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:04:08.776 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:08.776 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:04:08.777 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:08.777 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:08.778 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2019-12-09T11:04:08.778 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:08.778 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:04:08.778 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local 2019-12-09T11:04:08.778 INFO:teuthology.orchestra.run.smithi146.stdout: noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 8.6 M 2019-12-09T11:04:08.778 INFO:teuthology.orchestra.run.smithi146.stdout:Installing for dependencies: 2019-12-09T11:04:08.778 INFO:teuthology.orchestra.run.smithi146.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-12-09T11:04:08.779 INFO:teuthology.orchestra.run.smithi146.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-12-09T11:04:08.779 INFO:teuthology.orchestra.run.smithi146.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-12-09T11:04:08.779 INFO:teuthology.orchestra.run.smithi146.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-12-09T11:04:08.779 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:08.779 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:04:08.779 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:08.779 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package (+4 Dependent packages) 2019-12-09T11:04:08.780 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:08.780 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 19 M 2019-12-09T11:04:08.780 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 104 M 2019-12-09T11:04:08.780 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:04:09.844 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:04:09.845 INFO:teuthology.orchestra.run.smithi194.stdout:Total 16 MB/s | 19 MB 00:01 2019-12-09T11:04:09.856 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:04:09.886 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:04:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:04:09.979 INFO:teuthology.orchestra.run.smithi146.stdout:Total 16 MB/s | 19 MB 00:01 2019-12-09T11:04:09.988 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:04:10.010 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:04:10.122 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:04:10.122 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:04:10.165 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:04:10.166 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:04:11.058 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-12-09T11:04:11.100 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-12-09T11:04:11.482 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-12-09T11:04:11.566 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-12-09T11:04:13.226 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-09T11:04:13.322 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-09T11:04:14.887 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-09T11:04:15.024 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-09T11:04:15.224 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.n 5/5 2019-12-09T11:04:15.329 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-12-09T11:04:15.358 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.n 5/5 2019-12-09T11:04:15.462 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-12-09T11:04:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.n 2/5 2019-12-09T11:04:15.588 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-12-09T11:04:15.596 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.n 2/5 2019-12-09T11:04:15.680 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-12-09T11:04:15.705 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-12-09T11:04:15.797 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-12-09T11:04:16.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-12-09T11:04:16.157 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:16.157 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:04:16.157 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:16.158 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:16.158 INFO:teuthology.orchestra.run.smithi194.stdout:Dependency Installed: 2019-12-09T11:04:16.158 INFO:teuthology.orchestra.run.smithi194.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-12-09T11:04:16.158 INFO:teuthology.orchestra.run.smithi194.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-12-09T11:04:16.158 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:16.158 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:04:16.249 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-12-09T11:04:16.249 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:16.249 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:04:16.249 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:16.249 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:16.250 INFO:teuthology.orchestra.run.smithi146.stdout:Dependency Installed: 2019-12-09T11:04:16.250 INFO:teuthology.orchestra.run.smithi146.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-12-09T11:04:16.250 INFO:teuthology.orchestra.run.smithi146.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-12-09T11:04:16.250 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:16.250 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:04:16.295 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-rook 2019-12-09T11:04:16.380 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-mgr-rook 2019-12-09T11:04:16.559 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:16.604 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:16.605 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:04:16.606 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:04:16.606 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:16.607 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:16.635 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:16.679 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:16.680 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:04:16.681 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:04:16.681 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:16.681 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:17.202 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:17.340 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:17.530 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:04:17.531 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:17.531 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:17.532 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T11:04:17.563 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:17.563 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-12-09T11:04:17.565 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T11:04:17.566 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T11:04:17.567 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T11:04:17.568 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T11:04:17.569 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:17.569 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-12-09T11:04:17.570 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-12-09T11:04:17.570 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-12-09T11:04:17.570 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-09T11:04:17.571 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-09T11:04:17.572 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-09T11:04:17.573 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-12-09T11:04:17.573 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-12-09T11:04:17.574 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:17.574 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-12-09T11:04:17.574 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-12-09T11:04:17.575 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-12-09T11:04:17.576 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-12-09T11:04:17.576 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-12-09T11:04:17.576 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:17.576 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-12-09T11:04:17.695 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:04:17.695 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:17.695 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:17.697 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T11:04:17.727 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:17.728 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-12-09T11:04:17.730 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T11:04:17.731 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T11:04:17.732 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T11:04:17.733 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T11:04:17.734 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:17.734 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-12-09T11:04:17.734 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-12-09T11:04:17.735 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-12-09T11:04:17.735 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-09T11:04:17.736 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-09T11:04:17.737 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-09T11:04:17.738 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-12-09T11:04:17.738 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-12-09T11:04:17.739 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:17.739 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-12-09T11:04:17.739 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-12-09T11:04:17.740 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-12-09T11:04:17.741 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-12-09T11:04:17.741 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-12-09T11:04:17.741 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:17.741 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-12-09T11:04:17.942 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:18.105 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:18.171 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:18.171 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:04:18.171 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:18.171 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:18.171 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2019-12-09T11:04:18.171 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:18.172 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:04:18.172 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 23 k 2019-12-09T11:04:18.172 INFO:teuthology.orchestra.run.smithi194.stdout:Installing for dependencies: 2019-12-09T11:04:18.172 INFO:teuthology.orchestra.run.smithi194.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-12-09T11:04:18.172 INFO:teuthology.orchestra.run.smithi194.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-12-09T11:04:18.172 INFO:teuthology.orchestra.run.smithi194.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-12-09T11:04:18.172 INFO:teuthology.orchestra.run.smithi194.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-12-09T11:04:18.173 INFO:teuthology.orchestra.run.smithi194.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-12-09T11:04:18.173 INFO:teuthology.orchestra.run.smithi194.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-12-09T11:04:18.173 INFO:teuthology.orchestra.run.smithi194.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-12-09T11:04:18.173 INFO:teuthology.orchestra.run.smithi194.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-12-09T11:04:18.173 INFO:teuthology.orchestra.run.smithi194.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-12-09T11:04:18.173 INFO:teuthology.orchestra.run.smithi194.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-12-09T11:04:18.173 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:18.174 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:04:18.174 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:18.174 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package (+10 Dependent packages) 2019-12-09T11:04:18.174 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:18.175 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 1.6 M 2019-12-09T11:04:18.175 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 24 M 2019-12-09T11:04:18.175 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:04:18.332 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:18.332 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:04:18.334 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:18.334 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:18.334 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2019-12-09T11:04:18.334 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:18.334 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:04:18.335 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 23 k 2019-12-09T11:04:18.335 INFO:teuthology.orchestra.run.smithi146.stdout:Installing for dependencies: 2019-12-09T11:04:18.335 INFO:teuthology.orchestra.run.smithi146.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-12-09T11:04:18.335 INFO:teuthology.orchestra.run.smithi146.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-12-09T11:04:18.335 INFO:teuthology.orchestra.run.smithi146.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-12-09T11:04:18.335 INFO:teuthology.orchestra.run.smithi146.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-12-09T11:04:18.335 INFO:teuthology.orchestra.run.smithi146.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-12-09T11:04:18.336 INFO:teuthology.orchestra.run.smithi146.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-12-09T11:04:18.336 INFO:teuthology.orchestra.run.smithi146.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-12-09T11:04:18.336 INFO:teuthology.orchestra.run.smithi146.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-12-09T11:04:18.336 INFO:teuthology.orchestra.run.smithi146.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-12-09T11:04:18.336 INFO:teuthology.orchestra.run.smithi146.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-12-09T11:04:18.336 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:18.336 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:04:18.337 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:18.337 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package (+10 Dependent packages) 2019-12-09T11:04:18.337 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:18.337 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 1.6 M 2019-12-09T11:04:18.338 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 24 M 2019-12-09T11:04:18.338 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:04:18.935 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:04:18.935 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.2 MB/s | 1.6 MB 00:00 2019-12-09T11:04:18.951 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:04:18.964 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:04:19.036 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:04:19.037 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:04:19.200 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:04:19.201 INFO:teuthology.orchestra.run.smithi146.stdout:Total 1.9 MB/s | 1.6 MB 00:00 2019-12-09T11:04:19.215 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:04:19.227 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:04:19.295 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:04:19.296 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:04:19.730 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-12-09T11:04:20.139 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-12-09T11:04:20.374 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-12-09T11:04:20.503 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-12-09T11:04:20.701 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-12-09T11:04:20.850 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-12-09T11:04:21.004 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-12-09T11:04:21.140 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-12-09T11:04:21.335 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-12-09T11:04:21.512 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-12-09T11:04:21.674 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-09T11:04:21.879 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-09T11:04:22.051 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-12-09T11:04:22.227 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-12-09T11:04:22.330 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-12-09T11:04:22.557 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-12-09T11:04:23.609 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-12-09T11:04:23.869 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-12-09T11:04:23.954 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-12-09T11:04:24.225 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 11/11 2019-12-09T11:04:24.255 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-12-09T11:04:24.340 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-12-09T11:04:24.449 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-12-09T11:04:24.583 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-12-09T11:04:24.601 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 11/11 2019-12-09T11:04:24.658 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-12-09T11:04:24.725 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-12-09T11:04:24.750 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 5/11 2019-12-09T11:04:24.850 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-12-09T11:04:24.893 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-12-09T11:04:25.010 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-12-09T11:04:25.017 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-12-09T11:04:25.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-12-09T11:04:25.127 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 8/11 2019-12-09T11:04:25.193 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 5/11 2019-12-09T11:04:25.227 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-12-09T11:04:25.294 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-12-09T11:04:25.328 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 10/11 2019-12-09T11:04:25.411 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-12-09T11:04:25.511 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 8/11 2019-12-09T11:04:25.604 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-12-09T11:04:25.687 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 10/11 2019-12-09T11:04:25.847 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-12-09T11:04:25.847 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:25.847 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:04:25.847 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:25.847 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:25.848 INFO:teuthology.orchestra.run.smithi194.stdout:Dependency Installed: 2019-12-09T11:04:25.848 INFO:teuthology.orchestra.run.smithi194.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-12-09T11:04:25.848 INFO:teuthology.orchestra.run.smithi194.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-12-09T11:04:25.848 INFO:teuthology.orchestra.run.smithi194.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-12-09T11:04:25.848 INFO:teuthology.orchestra.run.smithi194.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-12-09T11:04:25.848 INFO:teuthology.orchestra.run.smithi194.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-12-09T11:04:25.848 INFO:teuthology.orchestra.run.smithi194.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-12-09T11:04:25.849 INFO:teuthology.orchestra.run.smithi194.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-12-09T11:04:25.849 INFO:teuthology.orchestra.run.smithi194.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-12-09T11:04:25.849 INFO:teuthology.orchestra.run.smithi194.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-12-09T11:04:25.849 INFO:teuthology.orchestra.run.smithi194.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-12-09T11:04:25.849 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:25.849 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:04:25.983 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-ssh 2019-12-09T11:04:26.214 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-12-09T11:04:26.214 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:26.215 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:04:26.215 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:26.215 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:26.215 INFO:teuthology.orchestra.run.smithi146.stdout:Dependency Installed: 2019-12-09T11:04:26.215 INFO:teuthology.orchestra.run.smithi146.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-12-09T11:04:26.215 INFO:teuthology.orchestra.run.smithi146.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-12-09T11:04:26.215 INFO:teuthology.orchestra.run.smithi146.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-12-09T11:04:26.216 INFO:teuthology.orchestra.run.smithi146.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-12-09T11:04:26.216 INFO:teuthology.orchestra.run.smithi146.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-12-09T11:04:26.216 INFO:teuthology.orchestra.run.smithi146.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-12-09T11:04:26.216 INFO:teuthology.orchestra.run.smithi146.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-12-09T11:04:26.216 INFO:teuthology.orchestra.run.smithi146.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-12-09T11:04:26.216 INFO:teuthology.orchestra.run.smithi146.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-12-09T11:04:26.216 INFO:teuthology.orchestra.run.smithi146.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-12-09T11:04:26.217 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:26.217 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:04:26.243 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:26.289 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:26.290 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:04:26.290 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:04:26.290 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:26.291 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:26.334 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-mgr-ssh 2019-12-09T11:04:26.586 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:26.630 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:26.631 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:04:26.632 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:04:26.632 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:26.632 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:26.943 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:27.284 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:04:27.284 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:27.284 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:27.287 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T11:04:27.294 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:27.317 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:27.317 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-12-09T11:04:27.318 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-12-09T11:04:27.318 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:27.319 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-12-09T11:04:27.633 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:04:27.633 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:27.633 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:27.636 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T11:04:27.668 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:27.668 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-12-09T11:04:27.668 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-12-09T11:04:27.669 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:27.669 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-12-09T11:04:27.686 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:27.913 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:27.913 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:04:27.914 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:27.914 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2019-12-09T11:04:27.915 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:27.915 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:04:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-ssh noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 33 k 2019-12-09T11:04:27.915 INFO:teuthology.orchestra.run.smithi194.stdout:Installing for dependencies: 2019-12-09T11:04:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-12-09T11:04:27.915 INFO:teuthology.orchestra.run.smithi194.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-12-09T11:04:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:27.916 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:04:27.916 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:27.916 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package (+2 Dependent packages) 2019-12-09T11:04:27.916 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:27.916 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 316 k 2019-12-09T11:04:27.917 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 1.1 M 2019-12-09T11:04:27.917 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:04:28.039 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:28.271 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:28.271 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:04:28.271 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:28.272 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:28.272 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2019-12-09T11:04:28.272 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:28.272 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:04:28.272 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-ssh noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 33 k 2019-12-09T11:04:28.272 INFO:teuthology.orchestra.run.smithi146.stdout:Installing for dependencies: 2019-12-09T11:04:28.273 INFO:teuthology.orchestra.run.smithi146.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-12-09T11:04:28.273 INFO:teuthology.orchestra.run.smithi146.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-12-09T11:04:28.273 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:28.273 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:04:28.273 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:28.273 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package (+2 Dependent packages) 2019-12-09T11:04:28.274 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:28.274 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 316 k 2019-12-09T11:04:28.274 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 1.1 M 2019-12-09T11:04:28.274 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:04:28.447 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:04:28.447 INFO:teuthology.orchestra.run.smithi194.stdout:Total 594 kB/s | 316 kB 00:00 2019-12-09T11:04:28.450 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:04:28.460 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:04:28.543 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:04:28.544 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:04:28.803 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:04:28.803 INFO:teuthology.orchestra.run.smithi146.stdout:Total 596 kB/s | 316 kB 00:00 2019-12-09T11:04:28.807 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:04:28.815 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:04:28.897 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:04:29.315 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-12-09T11:04:29.563 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-12-09T11:04:29.765 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-12-09T11:04:29.839 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 3/3 2019-12-09T11:04:29.984 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-12-09T11:04:30.056 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-12-09T11:04:30.101 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-12-09T11:04:30.373 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 3/3 2019-12-09T11:04:30.477 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-12-09T11:04:30.585 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-12-09T11:04:30.587 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 3/3 2019-12-09T11:04:30.587 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:30.587 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:04:30.587 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:30.587 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:30.588 INFO:teuthology.orchestra.run.smithi194.stdout:Dependency Installed: 2019-12-09T11:04:30.588 INFO:teuthology.orchestra.run.smithi194.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-12-09T11:04:30.588 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:30.588 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:04:30.718 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-fuse 2019-12-09T11:04:30.984 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:31.020 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 3/3 2019-12-09T11:04:31.020 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:31.020 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:04:31.020 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:31.020 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:31.021 INFO:teuthology.orchestra.run.smithi146.stdout:Dependency Installed: 2019-12-09T11:04:31.021 INFO:teuthology.orchestra.run.smithi146.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-12-09T11:04:31.021 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:31.021 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:04:31.030 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:31.031 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:04:31.032 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:04:31.032 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:31.033 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:31.139 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-fuse 2019-12-09T11:04:31.368 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:31.409 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:31.410 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:04:31.410 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:04:31.410 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:31.411 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:31.683 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:32.030 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:04:32.030 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:32.030 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:32.040 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:04:32.072 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:32.073 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:04:32.074 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:32.074 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-12-09T11:04:32.074 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-12-09T11:04:32.076 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-12-09T11:04:32.077 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-12-09T11:04:32.078 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-12-09T11:04:32.078 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:32.079 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-12-09T11:04:32.084 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-12-09T11:04:32.084 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-12-09T11:04:32.406 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:04:32.406 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:32.407 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:32.417 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:04:32.447 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:32.450 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:04:32.450 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:32.450 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-12-09T11:04:32.450 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-12-09T11:04:32.452 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-12-09T11:04:32.453 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-12-09T11:04:32.454 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-12-09T11:04:32.455 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:32.455 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-12-09T11:04:32.461 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-12-09T11:04:32.461 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-12-09T11:04:32.671 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:32.672 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:04:32.672 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:32.672 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository 2019-12-09T11:04:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: Size 2019-12-09T11:04:32.673 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:32.673 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:04:32.673 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 566 k 2019-12-09T11:04:32.673 INFO:teuthology.orchestra.run.smithi194.stdout:Installing for dependencies: 2019-12-09T11:04:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-12-09T11:04:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-12-09T11:04:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-12-09T11:04:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-12-09T11:04:32.674 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:32.674 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:04:32.674 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:32.674 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package (+4 Dependent packages) 2019-12-09T11:04:32.675 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:32.675 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 10 M 2019-12-09T11:04:32.675 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 49 M 2019-12-09T11:04:32.676 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:04:32.823 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:33.051 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:33.052 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:04:33.052 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:33.053 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:33.053 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository 2019-12-09T11:04:33.053 INFO:teuthology.orchestra.run.smithi146.stdout: Size 2019-12-09T11:04:33.053 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:33.053 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:04:33.053 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 566 k 2019-12-09T11:04:33.054 INFO:teuthology.orchestra.run.smithi146.stdout:Installing for dependencies: 2019-12-09T11:04:33.054 INFO:teuthology.orchestra.run.smithi146.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-12-09T11:04:33.054 INFO:teuthology.orchestra.run.smithi146.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-12-09T11:04:33.054 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-12-09T11:04:33.054 INFO:teuthology.orchestra.run.smithi146.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-12-09T11:04:33.054 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:33.054 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:04:33.055 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:33.055 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package (+4 Dependent packages) 2019-12-09T11:04:33.055 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:33.055 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 10 M 2019-12-09T11:04:33.055 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 49 M 2019-12-09T11:04:33.055 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:04:33.352 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:04:33.352 INFO:teuthology.orchestra.run.smithi194.stdout:Total 15 MB/s | 10 MB 00:00 2019-12-09T11:04:33.373 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:04:33.402 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:04:33.546 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:04:33.546 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:04:35.637 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:04:35.638 INFO:teuthology.orchestra.run.smithi146.stdout:Total 3.9 MB/s | 10 MB 00:02 2019-12-09T11:04:35.655 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:04:35.679 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:04:35.813 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:04:35.813 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:04:35.819 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-12-09T11:04:36.299 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-12-09T11:04:37.144 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-12-09T11:04:37.579 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-12-09T11:04:37.830 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 5/5 2019-12-09T11:04:37.964 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/5 2019-12-09T11:04:38.071 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-12-09T11:04:38.127 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-12-09T11:04:38.171 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-12-09T11:04:38.272 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-12-09T11:04:38.644 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-12-09T11:04:38.715 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-12-09T11:04:38.716 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:38.716 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:04:38.716 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:38.716 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:38.716 INFO:teuthology.orchestra.run.smithi194.stdout:Dependency Installed: 2019-12-09T11:04:38.716 INFO:teuthology.orchestra.run.smithi194.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-12-09T11:04:38.716 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-12-09T11:04:38.717 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:38.717 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:04:38.833 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install libcephfs2 2019-12-09T11:04:39.097 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:39.144 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:39.145 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:04:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:04:39.146 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:39.147 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:39.531 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-12-09T11:04:39.807 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:40.033 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-12-09T11:04:40.154 INFO:teuthology.orchestra.run.smithi194.stdout:Package 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T11:04:40.154 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do 2019-12-09T11:04:40.216 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install libcephfs-devel 2019-12-09T11:04:40.347 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 5/5 2019-12-09T11:04:40.420 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:40.457 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:40.458 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:04:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:04:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:40.459 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:40.463 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/5 2019-12-09T11:04:40.599 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-12-09T11:04:40.722 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-12-09T11:04:40.831 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-12-09T11:04:41.046 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:41.266 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-12-09T11:04:41.266 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:41.266 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:04:41.266 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:41.266 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:Dependency Installed: 2019-12-09T11:04:41.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-12-09T11:04:41.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-12-09T11:04:41.267 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:41.267 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:04:41.374 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:04:41.375 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:41.375 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:41.375 INFO:teuthology.orchestra.run.smithi194.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7900.g1351c81.el7 for package: 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:04:41.393 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install libcephfs2 2019-12-09T11:04:41.406 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:41.406 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package librados-devel.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:41.628 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:41.671 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:41.672 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:04:41.673 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:04:41.673 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:41.673 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:41.775 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:42.002 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:42.002 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:04:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:42.003 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:42.003 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository 2019-12-09T11:04:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: Size 2019-12-09T11:04:42.004 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:42.004 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:04:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:15.0.0-7900.g1351c81.el7 ceph 17 k 2019-12-09T11:04:42.004 INFO:teuthology.orchestra.run.smithi194.stdout:Installing for dependencies: 2019-12-09T11:04:42.004 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:15.0.0-7900.g1351c81.el7 ceph 153 k 2019-12-09T11:04:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:42.005 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:04:42.005 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:42.005 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package (+1 Dependent package) 2019-12-09T11:04:42.005 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:42.005 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 170 k 2019-12-09T11:04:42.005 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 679 k 2019-12-09T11:04:42.006 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:04:42.334 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:42.389 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:04:42.390 INFO:teuthology.orchestra.run.smithi194.stdout:Total 440 kB/s | 170 kB 00:00 2019-12-09T11:04:42.393 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:04:42.404 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:04:42.407 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:04:42.407 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:04:42.679 INFO:teuthology.orchestra.run.smithi146.stdout:Package 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T11:04:42.679 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do 2019-12-09T11:04:42.742 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install libcephfs-devel 2019-12-09T11:04:42.965 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:42.977 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:librados-devel-15.0.0-7900.g1351c81.el7.x86_64 1/2 2019-12-09T11:04:43.006 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:43.006 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:04:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:04:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:43.007 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:43.229 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2/2 2019-12-09T11:04:43.344 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:librados-devel-15.0.0-7900.g1351c81.el7.x86_64 1/2 2019-12-09T11:04:43.598 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2/2 2019-12-09T11:04:43.853 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:43.854 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:04:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:43.854 INFO:teuthology.orchestra.run.smithi194.stdout:Dependency Installed: 2019-12-09T11:04:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:43.854 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:43.854 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:04:43.926 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:04:43.926 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:43.926 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:43.927 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7900.g1351c81.el7 for package: 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T11:04:43.958 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:43.958 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package librados-devel.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:43.972 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install librados2 2019-12-09T11:04:44.215 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:44.258 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:44.259 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:04:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:04:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:44.260 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:44.330 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:44.566 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:44.567 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:04:44.567 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:44.568 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository 2019-12-09T11:04:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: Size 2019-12-09T11:04:44.568 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:44.568 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:04:44.568 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:15.0.0-7900.g1351c81.el7 ceph 17 k 2019-12-09T11:04:44.568 INFO:teuthology.orchestra.run.smithi146.stdout:Installing for dependencies: 2019-12-09T11:04:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:15.0.0-7900.g1351c81.el7 ceph 153 k 2019-12-09T11:04:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:44.569 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:04:44.569 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:44.569 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package (+1 Dependent package) 2019-12-09T11:04:44.569 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:44.569 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 170 k 2019-12-09T11:04:44.570 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 679 k 2019-12-09T11:04:44.570 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:04:44.920 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:44.969 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:04:44.969 INFO:teuthology.orchestra.run.smithi146.stdout:Total 423 kB/s | 170 kB 00:00 2019-12-09T11:04:44.972 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:04:44.984 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:04:44.986 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:04:44.987 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:04:45.256 INFO:teuthology.orchestra.run.smithi194.stdout:Package 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T11:04:45.257 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do 2019-12-09T11:04:45.318 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install librbd1 2019-12-09T11:04:45.481 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:45.515 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:04:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:04:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:46.029 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:librados-devel-15.0.0-7900.g1351c81.el7.x86_64 1/2 2019-12-09T11:04:46.107 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:46.273 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2/2 2019-12-09T11:04:46.422 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:librados-devel-15.0.0-7900.g1351c81.el7.x86_64 1/2 2019-12-09T11:04:46.434 INFO:teuthology.orchestra.run.smithi194.stdout:Package 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T11:04:46.435 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do 2019-12-09T11:04:46.497 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install python-ceph 2019-12-09T11:04:46.719 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:46.763 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:46.765 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:04:46.765 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:04:46.765 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:46.766 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:46.872 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2/2 2019-12-09T11:04:46.873 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:46.873 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:04:46.873 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:46.873 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:46.873 INFO:teuthology.orchestra.run.smithi146.stdout:Dependency Installed: 2019-12-09T11:04:46.873 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:46.874 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:46.874 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:04:47.000 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install librados2 2019-12-09T11:04:47.260 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:47.305 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:04:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:04:47.306 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:47.307 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:47.415 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:47.754 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:04:47.754 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:47.755 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:48.125 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:48.300 INFO:teuthology.orchestra.run.smithi146.stdout:Package 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T11:04:48.301 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do 2019-12-09T11:04:48.308 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:48.309 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:04:48.309 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:48.309 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:48.310 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository 2019-12-09T11:04:48.310 INFO:teuthology.orchestra.run.smithi194.stdout: Size 2019-12-09T11:04:48.310 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:48.310 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:04:48.310 INFO:teuthology.orchestra.run.smithi194.stdout: python-ceph-compat x86_64 2:15.0.0-7900.g1351c81.el7 ceph 2.2 k 2019-12-09T11:04:48.310 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:48.310 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:04:48.311 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:48.311 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2019-12-09T11:04:48.311 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:48.311 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 2.2 k 2019-12-09T11:04:48.311 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 0 2019-12-09T11:04:48.311 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:04:48.363 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install librbd1 2019-12-09T11:04:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:48.615 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:04:48.617 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:04:48.619 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:04:48.619 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:04:48.655 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:48.656 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:04:48.656 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:04:48.657 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:48.657 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:49.241 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:python-ceph-compat-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T11:04:49.308 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:Package 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T11:04:49.645 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do 2019-12-09T11:04:49.706 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install python-ceph 2019-12-09T11:04:49.732 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:python-ceph-compat-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T11:04:49.733 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:04:49.733 INFO:teuthology.orchestra.run.smithi194.stdout: python-ceph-compat.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:49.733 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:04:49.843 INFO:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-fuse 2019-12-09T11:04:49.913 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:49.956 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:49.959 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:04:49.960 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:04:49.960 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:49.960 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:50.100 INFO:teuthology.orchestra.run.smithi194.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:50.145 INFO:teuthology.orchestra.run.smithi194.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:50.146 INFO:teuthology.orchestra.run.smithi194.stdout: * base: mirror.fileplanet.com 2019-12-09T11:04:50.146 INFO:teuthology.orchestra.run.smithi194.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T11:04:50.147 INFO:teuthology.orchestra.run.smithi194.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:50.147 INFO:teuthology.orchestra.run.smithi194.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:50.795 INFO:teuthology.orchestra.run.smithi194.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:04:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:50.956 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:51.135 INFO:teuthology.orchestra.run.smithi194.stdout:Resolving Dependencies 2019-12-09T11:04:51.136 INFO:teuthology.orchestra.run.smithi194.stdout:--> Running transaction check 2019-12-09T11:04:51.136 INFO:teuthology.orchestra.run.smithi194.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:51.327 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:51.510 INFO:teuthology.orchestra.run.smithi194.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:51.514 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:04:51.515 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:51.515 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:51.516 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository 2019-12-09T11:04:51.516 INFO:teuthology.orchestra.run.smithi146.stdout: Size 2019-12-09T11:04:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:51.516 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:04:51.516 INFO:teuthology.orchestra.run.smithi146.stdout: python-ceph-compat x86_64 2:15.0.0-7900.g1351c81.el7 ceph 2.2 k 2019-12-09T11:04:51.516 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:04:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2019-12-09T11:04:51.517 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 2.2 k 2019-12-09T11:04:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 0 2019-12-09T11:04:51.517 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:04:51.694 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:51.695 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies Resolved 2019-12-09T11:04:51.695 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:51.696 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2019-12-09T11:04:51.696 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:51.696 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2019-12-09T11:04:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 76 k 2019-12-09T11:04:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:51.696 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2019-12-09T11:04:51.697 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2019-12-09T11:04:51.697 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2019-12-09T11:04:51.697 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:51.697 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 76 k 2019-12-09T11:04:51.697 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 200 k 2019-12-09T11:04:51.697 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading packages: 2019-12-09T11:04:51.795 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:04:51.796 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:04:51.798 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:04:51.799 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:04:52.036 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2019-12-09T11:04:52.058 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2019-12-09T11:04:52.060 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded 2019-12-09T11:04:52.060 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2019-12-09T11:04:52.367 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:python-ceph-compat-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T11:04:52.670 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : 2:rbd-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T11:04:52.860 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:python-ceph-compat-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T11:04:52.860 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:52.860 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:04:52.860 INFO:teuthology.orchestra.run.smithi146.stdout: python-ceph-compat.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:52.861 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:52.861 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:04:52.970 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install rbd-fuse 2019-12-09T11:04:53.087 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : 2:rbd-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T11:04:53.087 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:53.087 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2019-12-09T11:04:53.087 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:53.087 INFO:teuthology.orchestra.run.smithi194.stdout: 2019-12-09T11:04:53.088 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2019-12-09T11:04:53.207 DEBUG:teuthology.parallel:result is None 2019-12-09T11:04:53.233 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:04:53.278 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:04:53.279 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:04:53.279 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:04:53.280 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:04:53.280 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:04:53.939 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:04:54.281 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:04:54.281 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:04:54.281 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T11:04:54.658 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:04:54.844 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:54.844 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:04:54.845 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:54.845 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:54.845 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2019-12-09T11:04:54.845 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:54.845 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:04:54.845 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 76 k 2019-12-09T11:04:54.846 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:54.846 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:04:54.846 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:04:54.846 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2019-12-09T11:04:54.846 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:54.846 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 76 k 2019-12-09T11:04:54.846 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 200 k 2019-12-09T11:04:54.847 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:04:55.171 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:04:55.193 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:04:55.195 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:04:55.195 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:04:55.822 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : 2:rbd-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T11:04:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : 2:rbd-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T11:04:56.272 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:56.273 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:04:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:56.273 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:04:56.273 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:04:56.383 DEBUG:teuthology.parallel:result is None 2019-12-09T11:04:56.383 INFO:teuthology.orchestra.run.smithi146:> sudo lsb_release -is 2019-12-09T11:04:56.521 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS 2019-12-09T11:04:56.523 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-09T11:04:56.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T11:04:56.670 INFO:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-09T11:04:56.807 INFO:teuthology.orchestra.run.smithi146.stdout:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:56.807 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7900.g1351c81.el7 2019-12-09T11:04:56.807 INFO:teuthology.task.install:The correct ceph version 15.0.0-7900.g1351c81 is installed. 2019-12-09T11:04:56.807 INFO:teuthology.orchestra.run.smithi194:> sudo lsb_release -is 2019-12-09T11:04:56.957 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS 2019-12-09T11:04:56.959 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-09T11:04:56.959 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T11:04:57.105 INFO:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-09T11:04:57.239 INFO:teuthology.orchestra.run.smithi194.stdout:15.0.0-7900.g1351c81.el7 2019-12-09T11:04:57.239 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7900.g1351c81.el7 2019-12-09T11:04:57.239 INFO:teuthology.task.install:The correct ceph version 15.0.0-7900.g1351c81 is installed. 2019-12-09T11:04:57.239 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-12-09T11:04:57.240 INFO:teuthology.orchestra.run.smithi146:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-09T11:04:57.358 INFO:teuthology.orchestra.run.smithi194:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-09T11:04:57.479 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-12-09T11:04:57.479 INFO:teuthology.orchestra.run.smithi146:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-09T11:04:57.601 INFO:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-09T11:04:57.703 INFO:teuthology.orchestra.run.smithi194:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-09T11:04:57.822 INFO:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-09T11:04:57.933 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-12-09T11:04:57.933 INFO:teuthology.orchestra.run.smithi146:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-09T11:04:58.055 INFO:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-09T11:04:58.169 INFO:teuthology.orchestra.run.smithi194:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-09T11:04:58.291 INFO:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-09T11:04:58.396 INFO:teuthology.run_tasks:Running task ceph... 2019-12-09T11:04:58.452 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-12-09T11:04:58.452 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2019-12-09T11:04:58.457 INFO:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2019-12-09T11:04:58.572 INFO:tasks.ceph:Disabling ceph logrotate... 2019-12-09T11:04:58.573 INFO:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-09T11:04:58.576 INFO:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-09T11:04:58.687 INFO:tasks.ceph:Creating extra log directories... 2019-12-09T11:04:58.688 INFO:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-09T11:04:58.692 INFO:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-09T11:04:58.791 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-12-09T11:04:58.791 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd fast shutdown': False, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}} 2019-12-09T11:04:58.791 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'flavor': 'notcmalloc', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}, {'swift': {'client.0': {'rgw_server': 'client.0'}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.13056', 'owner': 'scheduled_ofriedma@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi146.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDtaDrN3mqKUeO17/nPMpfCLNrb+ja08MoRWrzSEOyZpcm0C8DDyKtfLu/MwZ065gKVzsks5iuXZbys1k629yU+4kXQj3FWsfrdm15u+t7oXfRvA/rk3AAOGwRQMbByqkGE+rJ37mnB311HdiEJSzGHLHTdJGZV4MGNjyPz1vd5e3OH004mQmsSK8eKNP6NaUVj7iwudDilGqhfUUiGFkO60ZcIXfFfBam6r/BqmlXnih/amAQsflDfONYhSDucy1GHLTCmudstHns/KVDnPHyPZhiGPt5xLmM5ZYz/cPdaTqbb3sr9/Ew18HGaKqKBukVE+s/0i+4KXkbLCUqTGaVB', 'smithi194.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKkk8KkZMySBRapKco1VibaGG4KM7UDqg5ILU7Ny+KrmtjxttCDS1hqJZEbk+r0q8uqjJDGTb3mfEOx3d8vU6myJOZuqhg+kt41M7ADQnvZr7woIGQskdeCAUMFblQWe1K9jHpBsrVzqumNpxQ4gNULFATZ2s0EMuMW5tf0pZNV5Ic2Z1bd23CZXjsHmE8LSE6dbsV7tDflKGutT338MqohkVj+4DDgt04bxKfUdp700kYg3HZQ2CV3/Ga3+Cjyr8DBTCUYB2jsTXqUzrfTXhmz5yDB8MR/wNRIxdOaDGyRIjqVduqw2eOjrtAvphTu0hXqiUnAFnGQGjjIzncy0/B'}, 'job_id': '4584280', 'tube': 'smithi', 'suite_branch': 'wip-ofriedma-dynamic-disable', 'priority': 60, 'first_in_suite': False, 'branch': 'wip-ofriedma-dynamic-disable', 'suite': 'rgw', 'email': 'ofriedma@redhat.com', 'archive_path': '/home/teuthworker/archive/ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4584280', 'description': 'rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}', 'nuke-on-error': True, 'repo': 'https://github.com/ceph/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'name': 'ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'os_type': 'centos', 'overrides': {'s3tests': {'slow_backend': True}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'rgw': {'frontend': 'beast', 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'ec-data-pool': True, 'client.1': {'ssl certificate': 'rgw.client.1'}, 'client.0': {'ssl certificate': 'rgw.client.0'}, 'storage classes': 'LUKEWARM, FROZEN', 'compression type': 'random'}, 'workunit': {'sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'branch': 'wip-ofriedma-dynamic-disable'}, 'ceph': {'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd fast shutdown': False, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}, 'fs': 'xfs', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'}, 'openssl_keys': {'rgw.client.1': {'ca': 'root', 'client': 'client.1', 'embed-key': True}, 'root': {'key-type': 'rsa:4096', 'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0', 'client.1']}, 'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}}, 'install': {'ceph': {'flavor': 'notcmalloc', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'}}, 'admin_socket': {'branch': 'wip-ofriedma-dynamic-disable'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}}} 2019-12-09T11:04:58.792 INFO:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-12-09T11:04:58.795 INFO:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-12-09T11:04:58.871 INFO:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2019-12-09T11:04:58.874 INFO:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2019-12-09T11:04:59.025 DEBUG:teuthology.orchestra.remote:smithi146:/scratch_devs is 72B 2019-12-09T11:04:59.096 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-09T11:04:59.096 INFO:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-09T11:04:59.155 INFO:teuthology.orchestra.run.smithi146.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-09T11:04:59.155 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T11:04:59.155 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 101876 Links: 1 2019-12-09T11:04:59.155 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T11:04:59.155 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T11:04:59.155 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2019-12-09 11:03:46.672003767 +0000 2019-12-09T11:04:59.156 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2019-12-09 11:00:56.778078023 +0000 2019-12-09T11:04:59.156 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2019-12-09 11:00:56.778078023 +0000 2019-12-09T11:04:59.156 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2019-12-09T11:04:59.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2019-12-09T11:04:59.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2019-12-09T11:04:59.172 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes (512 B) copied, 0.000349166 s, 1.5 MB/s 2019-12-09T11:04:59.176 INFO:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-09T11:04:59.224 INFO:teuthology.orchestra.run.smithi146.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-09T11:04:59.224 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T11:04:59.224 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 102937 Links: 1 2019-12-09T11:04:59.224 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T11:04:59.224 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T11:04:59.224 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2019-12-09 11:03:46.672003767 +0000 2019-12-09T11:04:59.225 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2019-12-09 11:00:57.254069676 +0000 2019-12-09T11:04:59.225 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2019-12-09 11:00:57.254069676 +0000 2019-12-09T11:04:59.225 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2019-12-09T11:04:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2019-12-09T11:04:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2019-12-09T11:04:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes (512 B) copied, 0.00044619 s, 1.1 MB/s 2019-12-09T11:04:59.244 INFO:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-09T11:04:59.295 INFO:teuthology.orchestra.run.smithi146.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-09T11:04:59.295 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T11:04:59.295 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 109617 Links: 1 2019-12-09T11:04:59.295 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T11:04:59.295 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T11:04:59.295 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2019-12-09 11:03:46.672003767 +0000 2019-12-09T11:04:59.295 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2019-12-09 11:00:57.732061293 +0000 2019-12-09T11:04:59.296 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2019-12-09 11:00:57.732061293 +0000 2019-12-09T11:04:59.296 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2019-12-09T11:04:59.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2019-12-09T11:04:59.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2019-12-09T11:04:59.311 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes (512 B) copied, 0.000300852 s, 1.7 MB/s 2019-12-09T11:04:59.313 INFO:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-09T11:04:59.358 INFO:teuthology.orchestra.run.smithi146.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-09T11:04:59.358 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T11:04:59.358 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 101967 Links: 1 2019-12-09T11:04:59.359 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T11:04:59.359 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T11:04:59.359 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2019-12-09 11:03:46.672003767 +0000 2019-12-09T11:04:59.359 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2019-12-09 11:00:58.190053260 +0000 2019-12-09T11:04:59.359 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2019-12-09 11:00:58.190053260 +0000 2019-12-09T11:04:59.359 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2019-12-09T11:04:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2019-12-09T11:04:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2019-12-09T11:04:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes (512 B) copied, 0.000334702 s, 1.5 MB/s 2019-12-09T11:04:59.376 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-09T11:04:59.376 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-09T11:04:59.376 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-09T11:04:59.376 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-09T11:04:59.474 DEBUG:teuthology.orchestra.remote:smithi194:/scratch_devs is 72B 2019-12-09T11:04:59.556 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-09T11:04:59.557 INFO:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-09T11:04:59.624 INFO:teuthology.orchestra.run.smithi194.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-09T11:04:59.624 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T11:04:59.624 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 109636 Links: 1 2019-12-09T11:04:59.625 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T11:04:59.625 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T11:04:59.625 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2019-12-09 11:03:44.959765340 +0000 2019-12-09T11:04:59.625 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2019-12-09 11:00:56.757512911 +0000 2019-12-09T11:04:59.625 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2019-12-09 11:00:56.757512911 +0000 2019-12-09T11:04:59.625 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2019-12-09T11:04:59.649 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2019-12-09T11:04:59.649 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2019-12-09T11:04:59.649 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes (512 B) copied, 0.000333471 s, 1.5 MB/s 2019-12-09T11:04:59.653 INFO:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-09T11:04:59.711 INFO:teuthology.orchestra.run.smithi194.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-09T11:04:59.711 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T11:04:59.712 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 104726 Links: 1 2019-12-09T11:04:59.712 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T11:04:59.712 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T11:04:59.712 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2019-12-09 11:03:44.959765340 +0000 2019-12-09T11:04:59.712 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2019-12-09 11:00:57.232502332 +0000 2019-12-09T11:04:59.712 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2019-12-09 11:00:57.232502332 +0000 2019-12-09T11:04:59.712 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2019-12-09T11:04:59.732 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2019-12-09T11:04:59.732 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2019-12-09T11:04:59.732 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes (512 B) copied, 0.000440912 s, 1.2 MB/s 2019-12-09T11:04:59.736 INFO:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-09T11:04:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-09T11:04:59.793 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T11:04:59.794 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 110630 Links: 1 2019-12-09T11:04:59.794 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T11:04:59.794 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T11:04:59.794 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2019-12-09 11:03:44.959765340 +0000 2019-12-09T11:04:59.794 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2019-12-09 11:00:57.723491396 +0000 2019-12-09T11:04:59.794 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2019-12-09 11:00:57.723491396 +0000 2019-12-09T11:04:59.794 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2019-12-09T11:04:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2019-12-09T11:04:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2019-12-09T11:04:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes (512 B) copied, 0.000300322 s, 1.7 MB/s 2019-12-09T11:04:59.814 INFO:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-09T11:04:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-09T11:04:59.868 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T11:04:59.868 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 110660 Links: 1 2019-12-09T11:04:59.868 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T11:04:59.869 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T11:04:59.869 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2019-12-09 11:03:44.959765340 +0000 2019-12-09T11:04:59.869 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2019-12-09 11:00:58.209480571 +0000 2019-12-09T11:04:59.869 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2019-12-09 11:00:58.209480571 +0000 2019-12-09T11:04:59.869 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2019-12-09T11:04:59.881 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2019-12-09T11:04:59.881 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2019-12-09T11:04:59.881 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes (512 B) copied, 0.000302956 s, 1.7 MB/s 2019-12-09T11:04:59.884 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-09T11:04:59.884 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-09T11:04:59.884 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-09T11:04:59.884 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-09T11:04:59.884 INFO:tasks.ceph:Generating config... 2019-12-09T11:04:59.886 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2019-12-09T11:04:59.886 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-12-09T11:04:59.886 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2019-12-09T11:04:59.886 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-12-09T11:04:59.886 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2019-12-09T11:04:59.886 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2019-12-09T11:04:59.886 INFO:tasks.ceph:[osd] debug ms = 1 2019-12-09T11:04:59.887 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2019-12-09T11:04:59.887 INFO:tasks.ceph:[osd] debug osd = 25 2019-12-09T11:04:59.887 INFO:tasks.ceph:[osd] debug bluestore = 20 2019-12-09T11:04:59.887 INFO:tasks.ceph:[osd] debug bluefs = 20 2019-12-09T11:04:59.887 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2019-12-09T11:04:59.887 INFO:tasks.ceph:[osd] debug rocksdb = 10 2019-12-09T11:04:59.887 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2019-12-09T11:04:59.887 INFO:tasks.ceph:[osd] debug journal = 20 2019-12-09T11:04:59.888 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2019-12-09T11:04:59.888 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2019-12-09T11:04:59.888 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2019-12-09T11:04:59.888 INFO:tasks.ceph:[osd] bdev async discard = True 2019-12-09T11:04:59.888 INFO:tasks.ceph:[osd] osd fast shutdown = False 2019-12-09T11:04:59.889 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2019-12-09T11:04:59.889 INFO:tasks.ceph:[osd] debug filestore = 20 2019-12-09T11:04:59.889 INFO:tasks.ceph:[osd] bdev enable discard = True 2019-12-09T11:04:59.889 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2019-12-09T11:04:59.889 INFO:tasks.ceph:[mon] debug mon = 20 2019-12-09T11:04:59.889 INFO:tasks.ceph:[mon] debug paxos = 20 2019-12-09T11:04:59.889 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2019-12-09T11:04:59.890 INFO:tasks.ceph:[mon] debug ms = 1 2019-12-09T11:04:59.890 INFO:tasks.ceph:[client] debug rgw = 20 2019-12-09T11:04:59.890 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2019-12-09T11:04:59.890 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2019-12-09T11:04:59.890 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2019-12-09T11:04:59.890 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2019-12-09T11:04:59.890 INFO:tasks.ceph:Setting up mon.a... 2019-12-09T11:04:59.891 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-12-09T11:05:00.074 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.keyring 2019-12-09T11:05:00.078 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-12-09T11:05:00.222 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-09T11:05:00.328 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.146'), ('mon.c', '[v2:172.21.15.146:3301,v1:172.21.15.146:6790]'), ('mon.b', '172.21.15.194')] 2019-12-09T11:05:00.329 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.146 --addv c '[v2:172.21.15.146:3301,v1:172.21.15.146:6790]' --add b 172.21.15.194 --print /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:00.458 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:00.458 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: generated fsid 200bc98e-4aef-4869-b3f7-6e32c2ad2995 2019-12-09T11:05:00.459 INFO:teuthology.orchestra.run.smithi146.stdout:epoch 0 2019-12-09T11:05:00.459 INFO:teuthology.orchestra.run.smithi146.stdout:fsid 200bc98e-4aef-4869-b3f7-6e32c2ad2995 2019-12-09T11:05:00.459 INFO:teuthology.orchestra.run.smithi146.stdout:last_changed 2019-12-09T11:05:00.460898+0000 2019-12-09T11:05:00.459 INFO:teuthology.orchestra.run.smithi146.stdout:created 2019-12-09T11:05:00.460898+0000 2019-12-09T11:05:00.459 INFO:teuthology.orchestra.run.smithi146.stdout:min_mon_release 0 (unknown) 2019-12-09T11:05:00.459 INFO:teuthology.orchestra.run.smithi146.stdout:0: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.a 2019-12-09T11:05:00.459 INFO:teuthology.orchestra.run.smithi146.stdout:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2019-12-09T11:05:00.460 INFO:teuthology.orchestra.run.smithi146.stdout:2: [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] mon.c 2019-12-09T11:05:00.460 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-12-09T11:05:00.461 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 200bc98e-4aef-4869-b3f7-6e32c2ad2995... 2019-12-09T11:05:00.462 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-12-09T11:05:00.465 INFO:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-12-09T11:05:00.675 INFO:tasks.ceph:Creating admin key on mon.a... 2019-12-09T11:05:00.675 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-12-09T11:05:00.805 INFO:tasks.ceph:Copying monmap to all nodes... 2019-12-09T11:05:00.872 DEBUG:teuthology.orchestra.remote:smithi146:/etc/ceph/ceph.keyring is 206B 2019-12-09T11:05:01.021 DEBUG:teuthology.orchestra.remote:smithi146:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-12-09T11:05:01.088 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T11:05:01.089 INFO:teuthology.orchestra.run.smithi146:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-09T11:05:01.193 INFO:teuthology.orchestra.run.smithi146:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:01.247 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2019-12-09T11:05:01.248 INFO:teuthology.orchestra.run.smithi194:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-09T11:05:01.397 INFO:teuthology.orchestra.run.smithi194:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:01.462 INFO:tasks.ceph:Setting up mon nodes... 2019-12-09T11:05:01.462 INFO:tasks.ceph:Setting up mgr nodes... 2019-12-09T11:05:01.463 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-12-09T11:05:01.634 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-12-09T11:05:01.639 INFO:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-12-09T11:05:01.843 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-12-09T11:05:01.848 INFO:tasks.ceph:Setting up mds nodes... 2019-12-09T11:05:01.848 INFO:tasks.ceph_client:Setting up client nodes... 2019-12-09T11:05:01.848 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-12-09T11:05:02.002 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-12-09T11:05:02.035 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-12-09T11:05:02.185 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-12-09T11:05:02.216 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-12-09T11:05:02.216 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}} 2019-12-09T11:05:02.217 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-12-09T11:05:02.332 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-09T11:05:02.332 INFO:tasks.ceph:{} 2019-12-09T11:05:02.333 INFO:tasks.ceph:osd.0 2019-12-09T11:05:02.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T11:05:02.333 INFO:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-09T11:05:02.919 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T11:05:02.919 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T11:05:02.920 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T11:05:02.920 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T11:05:02.920 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2019-12-09T11:05:02.920 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T11:05:02.920 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T11:05:02.920 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T11:05:02.920 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T11:05:02.922 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2019-12-09T11:05:02.922 INFO:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-12-09T11:05:03.088 INFO:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-12-09T11:05:03.186 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-12-09T11:05:03.281 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-09T11:05:03.281 INFO:tasks.ceph:{} 2019-12-09T11:05:03.281 INFO:tasks.ceph:osd.1 2019-12-09T11:05:03.281 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T11:05:03.281 INFO:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-09T11:05:03.819 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T11:05:03.819 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T11:05:03.819 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T11:05:03.819 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T11:05:03.819 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2019-12-09T11:05:03.820 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T11:05:03.820 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T11:05:03.820 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T11:05:03.820 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T11:05:03.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2019-12-09T11:05:03.821 INFO:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-12-09T11:05:03.977 INFO:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-12-09T11:05:04.084 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-12-09T11:05:04.169 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-09T11:05:04.169 INFO:tasks.ceph:{} 2019-12-09T11:05:04.169 INFO:tasks.ceph:osd.2 2019-12-09T11:05:04.169 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T11:05:04.170 INFO:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-09T11:05:04.742 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T11:05:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T11:05:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T11:05:04.742 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T11:05:04.742 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2019-12-09T11:05:04.743 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T11:05:04.743 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T11:05:04.743 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T11:05:04.743 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T11:05:04.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2019-12-09T11:05:04.745 INFO:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-12-09T11:05:04.885 INFO:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-12-09T11:05:04.977 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-12-09T11:05:05.053 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-09T11:05:05.053 INFO:tasks.ceph:{} 2019-12-09T11:05:05.053 INFO:tasks.ceph:osd.3 2019-12-09T11:05:05.053 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T11:05:05.054 INFO:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-12-09T11:05:05.608 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T11:05:05.609 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T11:05:05.609 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T11:05:05.609 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T11:05:05.609 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2019-12-09T11:05:05.609 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T11:05:05.609 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T11:05:05.610 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T11:05:05.610 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T11:05:05.611 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2019-12-09T11:05:05.611 INFO:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-12-09T11:05:05.737 INFO:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-12-09T11:05:05.822 INFO:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:05.977 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:05.977+0000 7f7108d34b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-12-09T11:05:05.977 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:05.978+0000 7f7108d34b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-12-09T11:05:05.977 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:05.978+0000 7f7108d34b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-12-09T11:05:05.978 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:05.978+0000 7f7108d34b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-12-09T11:05:05.978 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:05.978+0000 7f7108d34b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-12-09T11:05:05.978 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:05.979+0000 7f7108d34b40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2019-12-09T11:05:08.288 INFO:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-12-09T11:05:08.409 INFO:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:08.548 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:08.548+0000 7f8a32971b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-12-09T11:05:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:08.549+0000 7f8a32971b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-12-09T11:05:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:08.549+0000 7f8a32971b40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-12-09T11:05:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:08.549+0000 7f8a32971b40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-12-09T11:05:08.549 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:08.549+0000 7f8a32971b40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-12-09T11:05:08.550 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:08.550+0000 7f8a32971b40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2019-12-09T11:05:10.860 INFO:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-12-09T11:05:10.978 INFO:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:11.113 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:11.113+0000 7fc7d7251b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-12-09T11:05:11.113 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:11.114+0000 7fc7d7251b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-12-09T11:05:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:11.114+0000 7fc7d7251b40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-12-09T11:05:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:11.114+0000 7fc7d7251b40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-12-09T11:05:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:11.114+0000 7fc7d7251b40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-12-09T11:05:11.114 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:11.115+0000 7fc7d7251b40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2019-12-09T11:05:13.423 INFO:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-12-09T11:05:13.541 INFO:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:13.695 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:13.696+0000 7f1e2e39fb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-12-09T11:05:13.696 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:13.697+0000 7f1e2e39fb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-12-09T11:05:13.696 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:13.697+0000 7f1e2e39fb40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-12-09T11:05:13.697 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:13.697+0000 7f1e2e39fb40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-12-09T11:05:13.697 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:13.697+0000 7f1e2e39fb40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-12-09T11:05:13.697 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:05:13.698+0000 7f1e2e39fb40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2019-12-09T11:05:16.008 INFO:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-12-09T11:05:16.127 INFO:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-12-09T11:05:16.247 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-09T11:05:16.247 INFO:tasks.ceph:{} 2019-12-09T11:05:16.247 INFO:tasks.ceph:osd.4 2019-12-09T11:05:16.248 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com 2019-12-09T11:05:16.248 INFO:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-09T11:05:16.857 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T11:05:16.857 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T11:05:16.857 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T11:05:16.857 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T11:05:16.858 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2019-12-09T11:05:16.858 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T11:05:16.858 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T11:05:16.858 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T11:05:16.858 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T11:05:16.861 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2019-12-09T11:05:16.862 INFO:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-12-09T11:05:17.044 INFO:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-12-09T11:05:17.168 INFO:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-12-09T11:05:17.284 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-09T11:05:17.284 INFO:tasks.ceph:{} 2019-12-09T11:05:17.284 INFO:tasks.ceph:osd.5 2019-12-09T11:05:17.285 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2019-12-09T11:05:17.285 INFO:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-09T11:05:17.821 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T11:05:17.821 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T11:05:17.822 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T11:05:17.822 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T11:05:17.822 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2019-12-09T11:05:17.822 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T11:05:17.822 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T11:05:17.822 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T11:05:17.822 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T11:05:17.824 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2019-12-09T11:05:17.824 INFO:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-12-09T11:05:17.976 INFO:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-12-09T11:05:18.088 INFO:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-12-09T11:05:18.194 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-09T11:05:18.194 INFO:tasks.ceph:{} 2019-12-09T11:05:18.194 INFO:tasks.ceph:osd.6 2019-12-09T11:05:18.194 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2019-12-09T11:05:18.194 INFO:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-09T11:05:18.787 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T11:05:18.787 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T11:05:18.788 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T11:05:18.788 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T11:05:18.788 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2019-12-09T11:05:18.788 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T11:05:18.788 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T11:05:18.788 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T11:05:18.788 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T11:05:18.790 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2019-12-09T11:05:18.790 INFO:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-12-09T11:05:18.959 INFO:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-12-09T11:05:19.078 INFO:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-12-09T11:05:19.184 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-09T11:05:19.184 INFO:tasks.ceph:{} 2019-12-09T11:05:19.184 INFO:tasks.ceph:osd.7 2019-12-09T11:05:19.184 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com 2019-12-09T11:05:19.185 INFO:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-12-09T11:05:19.723 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T11:05:19.724 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T11:05:19.724 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T11:05:19.724 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T11:05:19.724 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2019-12-09T11:05:19.724 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T11:05:19.724 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T11:05:19.724 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T11:05:19.725 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T11:05:19.726 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2019-12-09T11:05:19.726 INFO:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-12-09T11:05:19.865 INFO:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-12-09T11:05:19.977 INFO:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:20.137 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:20.138+0000 7f5bcabeeb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-12-09T11:05:20.137 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:20.138+0000 7f5bcabeeb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-12-09T11:05:20.137 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:20.138+0000 7f5bcabeeb40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-12-09T11:05:20.137 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:20.139+0000 7f5bcabeeb40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-12-09T11:05:20.137 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:20.139+0000 7f5bcabeeb40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-12-09T11:05:20.143 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:20.146+0000 7f5bcabeeb40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2019-12-09T11:05:22.449 INFO:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-12-09T11:05:22.567 INFO:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:22.696 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:22.698+0000 7fd797347b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-12-09T11:05:22.697 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:22.699+0000 7fd797347b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-12-09T11:05:22.699 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:22.699+0000 7fd797347b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-12-09T11:05:22.700 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:22.699+0000 7fd797347b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-12-09T11:05:22.700 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:22.699+0000 7fd797347b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-12-09T11:05:22.700 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:22.700+0000 7fd797347b40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2019-12-09T11:05:25.005 INFO:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-12-09T11:05:25.121 INFO:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:25.265 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:25.267+0000 7f0d08144b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-12-09T11:05:25.266 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:25.268+0000 7f0d08144b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-12-09T11:05:25.266 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:25.268+0000 7f0d08144b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-12-09T11:05:25.266 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:25.268+0000 7f0d08144b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-12-09T11:05:25.267 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:25.268+0000 7f0d08144b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-12-09T11:05:25.267 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:25.269+0000 7f0d08144b40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2019-12-09T11:05:27.577 INFO:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-12-09T11:05:27.690 INFO:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:27.817+0000 7f7a511eab40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-12-09T11:05:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:27.818+0000 7f7a511eab40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-12-09T11:05:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:27.818+0000 7f7a511eab40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-12-09T11:05:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:27.818+0000 7f7a511eab40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-12-09T11:05:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:27.818+0000 7f7a511eab40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-12-09T11:05:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2019-12-09T11:05:27.819+0000 7f7a511eab40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2019-12-09T11:05:30.123 INFO:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-12-09T11:05:30.240 INFO:tasks.ceph:Reading keys from all nodes... 2019-12-09T11:05:30.240 INFO:teuthology.orchestra.run.smithi146:> mktemp 2019-12-09T11:05:30.332 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.tDSx5UVm32 2019-12-09T11:05:30.333 INFO:teuthology.orchestra.run.smithi146:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.tDSx5UVm32 2019-12-09T11:05:30.441 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.tDSx5UVm32 2019-12-09T11:05:30.600 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.tDSx5UVm32 is 56B 2019-12-09T11:05:30.682 INFO:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.tDSx5UVm32 2019-12-09T11:05:30.749 INFO:teuthology.orchestra.run.smithi146:> mktemp 2019-12-09T11:05:30.803 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.g4FJhTw0dB 2019-12-09T11:05:30.804 INFO:teuthology.orchestra.run.smithi146:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.g4FJhTw0dB 2019-12-09T11:05:30.886 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.g4FJhTw0dB 2019-12-09T11:05:31.017 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.g4FJhTw0dB is 56B 2019-12-09T11:05:31.077 INFO:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.g4FJhTw0dB 2019-12-09T11:05:31.133 INFO:teuthology.orchestra.run.smithi146:> mktemp 2019-12-09T11:05:31.255 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.5kTquuavcJ 2019-12-09T11:05:31.255 INFO:teuthology.orchestra.run.smithi146:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.5kTquuavcJ 2019-12-09T11:05:31.370 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.5kTquuavcJ 2019-12-09T11:05:31.562 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.5kTquuavcJ is 56B 2019-12-09T11:05:31.639 INFO:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.5kTquuavcJ 2019-12-09T11:05:31.702 INFO:teuthology.orchestra.run.smithi146:> mktemp 2019-12-09T11:05:31.764 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.YTEZhngaZd 2019-12-09T11:05:31.765 INFO:teuthology.orchestra.run.smithi146:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.YTEZhngaZd 2019-12-09T11:05:31.842 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.YTEZhngaZd 2019-12-09T11:05:31.969 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.YTEZhngaZd is 56B 2019-12-09T11:05:32.026 INFO:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.YTEZhngaZd 2019-12-09T11:05:32.090 INFO:teuthology.orchestra.run.smithi146:> mktemp 2019-12-09T11:05:32.215 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.73rY9wlV7k 2019-12-09T11:05:32.215 INFO:teuthology.orchestra.run.smithi146:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.73rY9wlV7k 2019-12-09T11:05:32.329 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.73rY9wlV7k 2019-12-09T11:05:32.522 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.73rY9wlV7k is 56B 2019-12-09T11:05:32.616 INFO:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.73rY9wlV7k 2019-12-09T11:05:32.685 INFO:teuthology.orchestra.run.smithi194:> mktemp 2019-12-09T11:05:32.775 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.JFv87Nj6if 2019-12-09T11:05:32.776 INFO:teuthology.orchestra.run.smithi194:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.JFv87Nj6if 2019-12-09T11:05:32.872 INFO:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.JFv87Nj6if 2019-12-09T11:05:33.076 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.JFv87Nj6if is 56B 2019-12-09T11:05:33.169 INFO:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.JFv87Nj6if 2019-12-09T11:05:33.241 INFO:teuthology.orchestra.run.smithi194:> mktemp 2019-12-09T11:05:33.304 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.kYXwuXrd4h 2019-12-09T11:05:33.305 INFO:teuthology.orchestra.run.smithi194:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.kYXwuXrd4h 2019-12-09T11:05:33.388 INFO:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.kYXwuXrd4h 2019-12-09T11:05:33.521 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.kYXwuXrd4h is 56B 2019-12-09T11:05:33.579 INFO:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.kYXwuXrd4h 2019-12-09T11:05:33.628 INFO:teuthology.orchestra.run.smithi194:> mktemp 2019-12-09T11:05:33.676 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.gpex4wfRcu 2019-12-09T11:05:33.677 INFO:teuthology.orchestra.run.smithi194:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.gpex4wfRcu 2019-12-09T11:05:33.743 INFO:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.gpex4wfRcu 2019-12-09T11:05:33.860 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.gpex4wfRcu is 56B 2019-12-09T11:05:33.917 INFO:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.gpex4wfRcu 2019-12-09T11:05:33.965 INFO:teuthology.orchestra.run.smithi194:> mktemp 2019-12-09T11:05:34.085 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.JhoP8rTADK 2019-12-09T11:05:34.085 INFO:teuthology.orchestra.run.smithi194:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.JhoP8rTADK 2019-12-09T11:05:34.181 INFO:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.JhoP8rTADK 2019-12-09T11:05:34.382 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.JhoP8rTADK is 56B 2019-12-09T11:05:34.468 INFO:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.JhoP8rTADK 2019-12-09T11:05:34.544 INFO:teuthology.orchestra.run.smithi194:> mktemp 2019-12-09T11:05:34.622 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.LxobE0wJCO 2019-12-09T11:05:34.622 INFO:teuthology.orchestra.run.smithi194:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.LxobE0wJCO 2019-12-09T11:05:34.717 INFO:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.LxobE0wJCO 2019-12-09T11:05:34.863 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.LxobE0wJCO is 56B 2019-12-09T11:05:34.924 INFO:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.LxobE0wJCO 2019-12-09T11:05:35.076 DEBUG:teuthology.orchestra.remote:smithi146:/etc/ceph/ceph.client.0.keyring is 59B 2019-12-09T11:05:35.237 DEBUG:teuthology.orchestra.remote:smithi194:/etc/ceph/ceph.client.1.keyring is 59B 2019-12-09T11:05:35.327 INFO:tasks.ceph:Adding keys to all mons... 2019-12-09T11:05:35.327 INFO:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2019-12-09T11:05:35.331 INFO:teuthology.orchestra.run.smithi194:> sudo tee -a /etc/ceph/ceph.keyring 2019-12-09T11:05:35.431 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.y] 2019-12-09T11:05:35.431 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBdKu5dc9PzJRAACucxTH/Xz9sbGrsUldyrRA== 2019-12-09T11:05:35.431 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.0] 2019-12-09T11:05:35.431 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBhKu5dzyJhOhAA4TI794ISuVxE/IvtlyG44Q== 2019-12-09T11:05:35.432 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.1] 2019-12-09T11:05:35.432 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBkKu5dL7fSIBAAMMlOwDcephMJW+iqpy0Ieg== 2019-12-09T11:05:35.432 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.2] 2019-12-09T11:05:35.432 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBnKu5dDKbhBhAAjpW4ifyRV+8WM3Z5Ayvbxg== 2019-12-09T11:05:35.432 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.3] 2019-12-09T11:05:35.432 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBpKu5dGJ+dKRAA1MZqNbQVNLHk3+abOhrBJg== 2019-12-09T11:05:35.432 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.x] 2019-12-09T11:05:35.433 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBdKu5dTTdyMhAAzIZVvkJsKaqJY147OYMePQ== 2019-12-09T11:05:35.433 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.4] 2019-12-09T11:05:35.433 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBwKu5dg0tLCBAAdQmXzHCaKQ2RScFQhXcYjQ== 2019-12-09T11:05:35.433 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.5] 2019-12-09T11:05:35.433 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQByKu5dmNe3KRAAldoHo41WouOW65XN/8f15w== 2019-12-09T11:05:35.433 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.6] 2019-12-09T11:05:35.433 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQB1Ku5dLY8HEBAARhV0anXsCap0iDzcDfVcyA== 2019-12-09T11:05:35.433 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.7] 2019-12-09T11:05:35.434 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQB3Ku5drE3IMBAAKBspzo35xS+yPomDclNJFA== 2019-12-09T11:05:35.434 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2019-12-09T11:05:35.434 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBeKu5dcJxJABAA7geR8GlM+OmL77R5fFz+Qg== 2019-12-09T11:05:35.434 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2019-12-09T11:05:35.434 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQBeKu5dzURACxAAU2OdoJ+tljLC1FCf0XEO7w== 2019-12-09T11:05:35.443 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2019-12-09T11:05:35.443 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBdKu5dc9PzJRAACucxTH/Xz9sbGrsUldyrRA== 2019-12-09T11:05:35.443 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2019-12-09T11:05:35.443 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBhKu5dzyJhOhAA4TI794ISuVxE/IvtlyG44Q== 2019-12-09T11:05:35.443 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2019-12-09T11:05:35.443 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBkKu5dL7fSIBAAMMlOwDcephMJW+iqpy0Ieg== 2019-12-09T11:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2019-12-09T11:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBnKu5dDKbhBhAAjpW4ifyRV+8WM3Z5Ayvbxg== 2019-12-09T11:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2019-12-09T11:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBpKu5dGJ+dKRAA1MZqNbQVNLHk3+abOhrBJg== 2019-12-09T11:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2019-12-09T11:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBdKu5dTTdyMhAAzIZVvkJsKaqJY147OYMePQ== 2019-12-09T11:05:35.444 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2019-12-09T11:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBwKu5dg0tLCBAAdQmXzHCaKQ2RScFQhXcYjQ== 2019-12-09T11:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2019-12-09T11:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQByKu5dmNe3KRAAldoHo41WouOW65XN/8f15w== 2019-12-09T11:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2019-12-09T11:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB1Ku5dLY8HEBAARhV0anXsCap0iDzcDfVcyA== 2019-12-09T11:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2019-12-09T11:05:35.445 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB3Ku5drE3IMBAAKBspzo35xS+yPomDclNJFA== 2019-12-09T11:05:35.446 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2019-12-09T11:05:35.446 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBeKu5dcJxJABAA7geR8GlM+OmL77R5fFz+Qg== 2019-12-09T11:05:35.446 INFO:teuthology.orchestra.run.smithi146.stdout:[client.1] 2019-12-09T11:05:35.446 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBeKu5dzURACxAAU2OdoJ+tljLC1FCf0XEO7w== 2019-12-09T11:05:35.447 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-09T11:05:35.450 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-09T11:05:35.613 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:35.618 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:35.784 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:35.787 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:35.943 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:35.946 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:36.117 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:36.120 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:36.289 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-09T11:05:36.293 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-09T11:05:36.455 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:36.459 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:36.618 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:36.623 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:36.790 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:36.794 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:36.966 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:36.970 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T11:05:37.135 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-09T11:05:37.138 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-09T11:05:37.299 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-09T11:05:37.302 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-09T11:05:37.468 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-12-09T11:05:37.469 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-12-09T11:05:37.584 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-09T11:05:37.745 INFO:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-12-09T11:05:37.848 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-12-09T11:05:37.947 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-09T11:05:38.132 INFO:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-12-09T11:05:38.238 INFO:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-12-09T11:05:38.360 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-09T11:05:38.550 INFO:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-12-09T11:05:38.658 INFO:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:38.662 INFO:teuthology.orchestra.run.smithi194:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-12-09T11:05:38.746 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-12-09T11:05:38.747 DEBUG:teuthology.misc:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-12-09T11:05:38.747 INFO:tasks.ceph.mon.a:Restarting daemon 2019-12-09T11:05:38.747 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2019-12-09T11:05:38.750 INFO:tasks.ceph.mon.a:Started 2019-12-09T11:05:38.751 DEBUG:teuthology.misc:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-12-09T11:05:38.751 INFO:tasks.ceph.mon.c:Restarting daemon 2019-12-09T11:05:38.751 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2019-12-09T11:05:38.754 INFO:tasks.ceph.mon.c:Started 2019-12-09T11:05:38.754 DEBUG:teuthology.misc:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-12-09T11:05:38.754 INFO:tasks.ceph.mon.b:Restarting daemon 2019-12-09T11:05:38.754 INFO:teuthology.orchestra.run.smithi194:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2019-12-09T11:05:38.758 INFO:tasks.ceph.mon.b:Started 2019-12-09T11:05:38.759 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-12-09T11:05:38.759 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-12-09T11:05:38.759 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2019-12-09T11:05:38.762 INFO:tasks.ceph.mgr.y:Started 2019-12-09T11:05:38.762 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-12-09T11:05:38.762 INFO:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2019-12-09T11:05:38.765 INFO:tasks.ceph.mgr.x:Started 2019-12-09T11:05:38.765 INFO:tasks.ceph:Setting crush tunables to default 2019-12-09T11:05:38.765 INFO:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd crush tunables default 2019-12-09T11:05:42.784 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:00:03.846 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:05:42.795 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:00:03.835 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:05:43.006 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:00:04.068 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:05:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:adjusted tunables profile to default 2019-12-09T11:05:50.224 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-12-09T11:05:50.224 INFO:teuthology.orchestra.run.smithi146:> mktemp 2019-12-09T11:05:50.293 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.IkGLVkIC8u 2019-12-09T11:05:50.293 INFO:teuthology.orchestra.run.smithi146:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.IkGLVkIC8u 2019-12-09T11:05:50.360 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.IkGLVkIC8u 2019-12-09T11:05:50.467 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.IkGLVkIC8u is 37B 2019-12-09T11:05:50.515 INFO:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.IkGLVkIC8u 2019-12-09T11:05:50.558 INFO:teuthology.orchestra.run.smithi146:> mktemp 2019-12-09T11:05:50.651 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.9OElsHw8cs 2019-12-09T11:05:50.652 INFO:teuthology.orchestra.run.smithi146:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.9OElsHw8cs 2019-12-09T11:05:50.715 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.9OElsHw8cs 2019-12-09T11:05:50.820 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.9OElsHw8cs is 37B 2019-12-09T11:05:50.868 INFO:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.9OElsHw8cs 2019-12-09T11:05:50.909 INFO:teuthology.orchestra.run.smithi146:> mktemp 2019-12-09T11:05:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.ll2LCVoIrV 2019-12-09T11:05:51.006 INFO:teuthology.orchestra.run.smithi146:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.ll2LCVoIrV 2019-12-09T11:05:51.062 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.ll2LCVoIrV 2019-12-09T11:05:51.174 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.ll2LCVoIrV is 37B 2019-12-09T11:05:51.221 INFO:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.ll2LCVoIrV 2019-12-09T11:05:51.263 INFO:teuthology.orchestra.run.smithi146:> mktemp 2019-12-09T11:05:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.8gujxzpxSa 2019-12-09T11:05:51.344 INFO:teuthology.orchestra.run.smithi146:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.8gujxzpxSa 2019-12-09T11:05:51.460 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.8gujxzpxSa 2019-12-09T11:05:51.590 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.8gujxzpxSa is 37B 2019-12-09T11:05:51.643 INFO:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.8gujxzpxSa 2019-12-09T11:05:51.687 INFO:teuthology.orchestra.run.smithi194:> mktemp 2019-12-09T11:05:51.775 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.Pw3ieBuRHW 2019-12-09T11:05:51.776 INFO:teuthology.orchestra.run.smithi194:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.Pw3ieBuRHW 2019-12-09T11:05:51.866 INFO:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.Pw3ieBuRHW 2019-12-09T11:05:51.980 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.Pw3ieBuRHW is 37B 2019-12-09T11:05:52.030 INFO:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.Pw3ieBuRHW 2019-12-09T11:05:52.075 INFO:teuthology.orchestra.run.smithi194:> mktemp 2019-12-09T11:05:52.183 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.e3Q5a5PHuH 2019-12-09T11:05:52.184 INFO:teuthology.orchestra.run.smithi194:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.e3Q5a5PHuH 2019-12-09T11:05:52.269 INFO:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.e3Q5a5PHuH 2019-12-09T11:05:52.376 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.e3Q5a5PHuH is 37B 2019-12-09T11:05:52.425 INFO:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.e3Q5a5PHuH 2019-12-09T11:05:52.487 INFO:teuthology.orchestra.run.smithi194:> mktemp 2019-12-09T11:05:52.607 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.RVvvxPEfXK 2019-12-09T11:05:52.608 INFO:teuthology.orchestra.run.smithi194:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.RVvvxPEfXK 2019-12-09T11:05:52.715 INFO:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.RVvvxPEfXK 2019-12-09T11:05:52.859 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.RVvvxPEfXK is 37B 2019-12-09T11:05:52.915 INFO:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.RVvvxPEfXK 2019-12-09T11:05:52.973 INFO:teuthology.orchestra.run.smithi194:> mktemp 2019-12-09T11:05:53.100 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.KJvmMKxjrq 2019-12-09T11:05:53.100 INFO:teuthology.orchestra.run.smithi194:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.KJvmMKxjrq 2019-12-09T11:05:53.204 INFO:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.KJvmMKxjrq 2019-12-09T11:05:53.347 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.KJvmMKxjrq is 37B 2019-12-09T11:05:53.404 INFO:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.KJvmMKxjrq 2019-12-09T11:05:53.454 INFO:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 4afce683-b22d-4b19-b483-7c476b3e66a2 0 2019-12-09T11:05:54.759 INFO:teuthology.orchestra.run.smithi194.stdout:0 2019-12-09T11:05:54.781 INFO:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new e437cfa5-c4f1-4ab2-9dd0-fa3e64245665 1 2019-12-09T11:05:56.150 INFO:teuthology.orchestra.run.smithi194.stdout:1 2019-12-09T11:05:56.177 INFO:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 87f24052-5457-4af3-a4bb-6022789115ba 2 2019-12-09T11:05:57.313 INFO:teuthology.orchestra.run.smithi194.stdout:2 2019-12-09T11:05:57.334 INFO:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new d487a545-36d6-45d4-b44e-d38aa06d0e4f 3 2019-12-09T11:05:58.389 INFO:teuthology.orchestra.run.smithi194.stdout:3 2019-12-09T11:05:58.414 INFO:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 141a9459-6c41-4014-8d64-18641bf263cd 4 2019-12-09T11:05:59.515 INFO:teuthology.orchestra.run.smithi194.stdout:4 2019-12-09T11:05:59.536 INFO:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new db5f97ec-455d-42bf-93e9-ecb7f5d0b4d6 5 2019-12-09T11:06:00.688 INFO:teuthology.orchestra.run.smithi194.stdout:5 2019-12-09T11:06:00.711 INFO:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new f489d8e4-3bdb-4395-ac80-371987cd828f 6 2019-12-09T11:06:01.701 INFO:teuthology.orchestra.run.smithi194.stdout:6 2019-12-09T11:06:01.724 INFO:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new d8e8e32a-8ad0-4c50-8509-b3bdb70f7fec 7 2019-12-09T11:06:02.782 INFO:teuthology.orchestra.run.smithi194.stdout:7 2019-12-09T11:06:02.802 DEBUG:teuthology.misc:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T11:06:02.802 INFO:tasks.ceph.osd.0:Restarting daemon 2019-12-09T11:06:02.802 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 0 2019-12-09T11:06:02.805 INFO:tasks.ceph.osd.0:Started 2019-12-09T11:06:02.805 DEBUG:teuthology.misc:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T11:06:02.805 INFO:tasks.ceph.osd.1:Restarting daemon 2019-12-09T11:06:02.805 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 1 2019-12-09T11:06:02.808 INFO:tasks.ceph.osd.1:Started 2019-12-09T11:06:02.808 DEBUG:teuthology.misc:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T11:06:02.808 INFO:tasks.ceph.osd.2:Restarting daemon 2019-12-09T11:06:02.808 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 2 2019-12-09T11:06:02.810 INFO:tasks.ceph.osd.2:Started 2019-12-09T11:06:02.810 DEBUG:teuthology.misc:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T11:06:02.811 INFO:tasks.ceph.osd.3:Restarting daemon 2019-12-09T11:06:02.811 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 3 2019-12-09T11:06:02.813 INFO:tasks.ceph.osd.3:Started 2019-12-09T11:06:02.813 DEBUG:teuthology.misc:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T11:06:02.814 INFO:tasks.ceph.osd.4:Restarting daemon 2019-12-09T11:06:02.814 INFO:teuthology.orchestra.run.smithi194:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 4 2019-12-09T11:06:02.817 INFO:tasks.ceph.osd.4:Started 2019-12-09T11:06:02.817 DEBUG:teuthology.misc:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T11:06:02.817 INFO:tasks.ceph.osd.5:Restarting daemon 2019-12-09T11:06:02.817 INFO:teuthology.orchestra.run.smithi194:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 5 2019-12-09T11:06:02.820 INFO:tasks.ceph.osd.5:Started 2019-12-09T11:06:02.821 DEBUG:teuthology.misc:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T11:06:02.821 INFO:tasks.ceph.osd.6:Restarting daemon 2019-12-09T11:06:02.821 INFO:teuthology.orchestra.run.smithi194:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 6 2019-12-09T11:06:02.824 INFO:tasks.ceph.osd.6:Started 2019-12-09T11:06:02.824 DEBUG:teuthology.misc:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T11:06:02.824 INFO:tasks.ceph.osd.7:Restarting daemon 2019-12-09T11:06:02.824 INFO:teuthology.orchestra.run.smithi194:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 7 2019-12-09T11:06:02.827 INFO:tasks.ceph.osd.7:Started 2019-12-09T11:06:02.828 INFO:tasks.ceph:Waiting for OSDs to come up 2019-12-09T11:06:03.636 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-09T11:06:04.548 INFO:teuthology.misc.health.smithi146.stdout: 2019-12-09T11:06:04.548 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":10,"fsid":"200bc98e-4aef-4869-b3f7-6e32c2ad2995","created":"2019-12-09T11:05:47.222249+0000","modified":"2019-12-09T11:06:02.647420+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"4afce683-b22d-4b19-b483-7c476b3e66a2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e437cfa5-c4f1-4ab2-9dd0-fa3e64245665","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"87f24052-5457-4af3-a4bb-6022789115ba","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d487a545-36d6-45d4-b44e-d38aa06d0e4f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"141a9459-6c41-4014-8d64-18641bf263cd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"db5f97ec-455d-42bf-93e9-ecb7f5d0b4d6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f489d8e4-3bdb-4395-ac80-371987cd828f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d8e8e32a-8ad0-4c50-8509-b3bdb70f7fec","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-09T11:06:04.567 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-12-09T11:06:06.588 INFO:tasks.ceph.osd.1.smithi146.stderr:==00:00:00:03.675 10556== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:06.646 INFO:tasks.ceph.osd.5.smithi194.stderr:==00:00:00:03.707 10132== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:06.647 INFO:tasks.ceph.osd.1.smithi146.stderr:==00:00:00:03.734 10556== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:06.685 INFO:tasks.ceph.osd.2.smithi146.stderr:==00:00:00:03.752 10558== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:06.696 INFO:tasks.ceph.osd.4.smithi194.stderr:==00:00:00:03.740 10134== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:06.724 INFO:tasks.ceph.osd.5.smithi194.stderr:==00:00:00:03.785 10132== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:06.741 INFO:tasks.ceph.osd.2.smithi146.stderr:==00:00:00:03.809 10558== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:06.752 INFO:tasks.ceph.osd.4.smithi194.stderr:==00:00:00:03.796 10134== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:06.761 INFO:tasks.ceph.osd.6.smithi194.stderr:==00:00:00:03.804 10133== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:06.836 INFO:tasks.ceph.osd.6.smithi194.stderr:==00:00:00:03.880 10133== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:06.868 INFO:tasks.ceph.osd.7.smithi194.stderr:==00:00:00:03.908 10135== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:06.925 INFO:tasks.ceph.osd.7.smithi194.stderr:==00:00:00:03.965 10135== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.253 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T11:06:07.239+0000 9b13800 -1 Falling back to public interface 2019-12-09T11:06:07.319 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T11:06:07.295+0000 9b13800 -1 Falling back to public interface 2019-12-09T11:06:07.321 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T11:06:07.309+0000 9b13800 -1 Falling back to public interface 2019-12-09T11:06:07.322 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T11:06:07.311+0000 9b13800 -1 Falling back to public interface 2019-12-09T11:06:07.425 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T11:06:07.404+0000 9b13800 -1 Falling back to public interface 2019-12-09T11:06:07.439 INFO:tasks.ceph.osd.1.smithi146.stderr:==00:00:00:04.526 10556== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.509 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T11:06:07.498+0000 9b13800 -1 Falling back to public interface 2019-12-09T11:06:07.516 INFO:tasks.ceph.osd.2.smithi146.stderr:==00:00:00:04.584 10558== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.558 INFO:tasks.ceph.osd.5.smithi194.stderr:==00:00:00:04.620 10132== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.564 INFO:tasks.ceph.osd.4.smithi194.stderr:==00:00:00:04.607 10134== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.637 INFO:tasks.ceph.osd.2.smithi146.stderr:==00:00:00:04.704 10558== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.649 INFO:tasks.ceph.osd.2.smithi146.stderr:==00:00:00:04.717 10558== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.667 INFO:tasks.ceph.osd.6.smithi194.stderr:==00:00:00:04.710 10133== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.707 INFO:tasks.ceph.osd.7.smithi194.stderr:==00:00:00:04.746 10135== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.711 INFO:tasks.ceph.osd.3.smithi146.stderr:==00:00:00:04.793 10557== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.769 INFO:tasks.ceph.osd.3.smithi146.stderr:==00:00:00:04.851 10557== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.828 INFO:tasks.ceph.osd.0.smithi146.stderr:==00:00:00:04.916 10555== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.847 INFO:tasks.ceph.osd.1.smithi146.stderr:==00:00:00:04.934 10556== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.861 INFO:tasks.ceph.osd.1.smithi146.stderr:==00:00:00:04.948 10556== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.884 INFO:tasks.ceph.osd.0.smithi146.stderr:==00:00:00:04.973 10555== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:07.981 INFO:tasks.ceph.osd.4.smithi194.stderr:==00:00:00:05.024 10134== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:08.001 INFO:tasks.ceph.osd.5.smithi194.stderr:==00:00:00:05.062 10132== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:08.004 INFO:tasks.ceph.osd.4.smithi194.stderr:==00:00:00:05.048 10134== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:08.019 INFO:tasks.ceph.osd.5.smithi194.stderr:==00:00:00:05.080 10132== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:08.033 INFO:tasks.ceph.osd.6.smithi194.stderr:==00:00:00:05.077 10133== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:08.045 INFO:tasks.ceph.osd.6.smithi194.stderr:==00:00:00:05.089 10133== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:08.073 INFO:tasks.ceph.osd.7.smithi194.stderr:==00:00:00:05.112 10135== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:08.085 INFO:tasks.ceph.osd.7.smithi194.stderr:==00:00:00:05.124 10135== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:08.335 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T11:06:08.326+0000 9b13800 -1 Falling back to public interface 2019-12-09T11:06:08.456 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T11:06:08.443+0000 9b13800 -1 Falling back to public interface 2019-12-09T11:06:08.613 INFO:tasks.ceph.osd.3.smithi146.stderr:==00:00:00:05.695 10557== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:08.722 INFO:tasks.ceph.osd.0.smithi146.stderr:==00:00:00:05.810 10555== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:09.000 INFO:tasks.ceph.osd.3.smithi146.stderr:==00:00:00:06.082 10557== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:09.020 INFO:tasks.ceph.osd.3.smithi146.stderr:==00:00:00:06.102 10557== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:09.115 INFO:tasks.ceph.osd.0.smithi146.stderr:==00:00:00:06.203 10555== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:09.133 INFO:tasks.ceph.osd.0.smithi146.stderr:==00:00:00:06.221 10555== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:10.656 INFO:tasks.ceph.osd.2.smithi146.stderr:==00:00:00:07.724 10558== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:10.661 INFO:tasks.ceph.osd.2.smithi146.stderr:==00:00:00:07.729 10558== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:10.686 INFO:tasks.ceph.osd.1.smithi146.stderr:==00:00:00:07.773 10556== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:10.696 INFO:tasks.ceph.osd.1.smithi146.stderr:==00:00:00:07.783 10556== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:10.924 INFO:tasks.ceph.osd.2.smithi146.stderr:==00:00:00:07.991 10558== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:10.963 INFO:tasks.ceph.osd.1.smithi146.stderr:==00:00:00:08.050 10556== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.035 INFO:tasks.ceph.osd.4.smithi194.stderr:==00:00:00:08.078 10134== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.037 INFO:tasks.ceph.osd.5.smithi194.stderr:==00:00:00:08.098 10132== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.042 INFO:tasks.ceph.osd.4.smithi194.stderr:==00:00:00:08.086 10134== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.051 INFO:tasks.ceph.osd.5.smithi194.stderr:==00:00:00:08.112 10132== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.055 INFO:tasks.ceph.osd.6.smithi194.stderr:==00:00:00:08.098 10133== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.061 INFO:tasks.ceph.osd.6.smithi194.stderr:==00:00:00:08.104 10133== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.304 INFO:tasks.ceph.osd.4.smithi194.stderr:==00:00:00:08.347 10134== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.318 INFO:tasks.ceph.osd.5.smithi194.stderr:==00:00:00:08.378 10132== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.323 INFO:tasks.ceph.osd.6.smithi194.stderr:==00:00:00:08.367 10133== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.341 INFO:tasks.ceph.osd.7.smithi194.stderr:==00:00:00:08.380 10135== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.351 INFO:tasks.ceph.osd.7.smithi194.stderr:==00:00:00:08.391 10135== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.372 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-09T11:06:11.617 INFO:tasks.ceph.osd.7.smithi194.stderr:==00:00:00:08.657 10135== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.909 INFO:tasks.ceph.osd.0.smithi146.stderr:==00:00:00:08.997 10555== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:11.918 INFO:tasks.ceph.osd.0.smithi146.stderr:==00:00:00:09.006 10555== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:12.181 INFO:tasks.ceph.osd.0.smithi146.stderr:==00:00:00:09.269 10555== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:12.182 INFO:teuthology.misc.health.smithi146.stdout: 2019-12-09T11:06:12.182 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":10,"fsid":"200bc98e-4aef-4869-b3f7-6e32c2ad2995","created":"2019-12-09T11:05:47.222249+0000","modified":"2019-12-09T11:06:02.647420+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"4afce683-b22d-4b19-b483-7c476b3e66a2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e437cfa5-c4f1-4ab2-9dd0-fa3e64245665","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"87f24052-5457-4af3-a4bb-6022789115ba","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d487a545-36d6-45d4-b44e-d38aa06d0e4f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"141a9459-6c41-4014-8d64-18641bf263cd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"db5f97ec-455d-42bf-93e9-ecb7f5d0b4d6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f489d8e4-3bdb-4395-ac80-371987cd828f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d8e8e32a-8ad0-4c50-8509-b3bdb70f7fec","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-09T11:06:12.197 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-12-09T11:06:12.408 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T11:06:12.407+0000 9b13800 -1 osd.2 0 log_to_monitors {default=true} 2019-12-09T11:06:12.489 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T11:06:12.488+0000 9b13800 -1 osd.1 0 log_to_monitors {default=true} 2019-12-09T11:06:12.529 INFO:tasks.ceph.osd.3.smithi146.stderr:==00:00:00:09.612 10557== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:12.535 INFO:tasks.ceph.osd.3.smithi146.stderr:==00:00:00:09.617 10557== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:12.734 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T11:06:12.725+0000 9b13800 -1 osd.6 0 log_to_monitors {default=true} 2019-12-09T11:06:12.789 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T11:06:12.789+0000 9b13800 -1 osd.5 0 log_to_monitors {default=true} 2019-12-09T11:06:12.795 INFO:tasks.ceph.osd.3.smithi146.stderr:==00:00:00:09.878 10557== Warning: unimplemented fcntl command: 1038 2019-12-09T11:06:12.857 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T11:06:12.857+0000 9b13800 -1 osd.4 0 log_to_monitors {default=true} 2019-12-09T11:06:13.256 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T11:06:13.238+0000 9b13800 -1 osd.7 0 log_to_monitors {default=true} 2019-12-09T11:06:13.552 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T11:06:13.550+0000 9b13800 -1 osd.0 0 log_to_monitors {default=true} 2019-12-09T11:06:14.237 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T11:06:14.235+0000 9b13800 -1 osd.3 0 log_to_monitors {default=true} 2019-12-09T11:06:14.827 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T11:06:14.819+0000 2476e700 -1 osd.1 0 waiting for initial osdmap 2019-12-09T11:06:14.854 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T11:06:14.843+0000 27772700 -1 osd.6 0 waiting for initial osdmap 2019-12-09T11:06:14.884 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T11:06:14.881+0000 2756d700 -1 osd.5 0 waiting for initial osdmap 2019-12-09T11:06:14.912 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T11:06:14.902+0000 27772700 -1 osd.2 0 waiting for initial osdmap 2019-12-09T11:06:14.913 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T11:06:14.912+0000 2476e700 -1 osd.4 0 waiting for initial osdmap 2019-12-09T11:06:15.942 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T11:06:15.930+0000 2476e700 -1 osd.7 0 waiting for initial osdmap 2019-12-09T11:06:16.008 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T11:06:15.999+0000 27772700 -1 osd.0 0 waiting for initial osdmap 2019-12-09T11:06:16.983 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T11:06:16.981+0000 27772700 -1 osd.3 0 waiting for initial osdmap 2019-12-09T11:06:19.005 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-09T11:06:19.715 INFO:teuthology.misc.health.smithi146.stdout: 2019-12-09T11:06:19.716 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":16,"fsid":"200bc98e-4aef-4869-b3f7-6e32c2ad2995","created":"2019-12-09T11:05:47.222249+0000","modified":"2019-12-09T11:06:18.685869+0000","last_up_change":"2019-12-09T11:06:18.685869+0000","last_in_change":"2019-12-09T11:06:18.685869+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"4afce683-b22d-4b19-b483-7c476b3e66a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":10555},{"type":"v1","addr":"172.21.15.146:6827","nonce":10555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":10555},{"type":"v1","addr":"172.21.15.146:6829","nonce":10555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":10555},{"type":"v1","addr":"172.21.15.146:6833","nonce":10555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":10555},{"type":"v1","addr":"172.21.15.146:6831","nonce":10555}]},"public_addr":"172.21.15.146:6827/10555","cluster_addr":"172.21.15.146:6829/10555","heartbeat_back_addr":"172.21.15.146:6833/10555","heartbeat_front_addr":"172.21.15.146:6831/10555","state":["exists","up"]},{"osd":1,"uuid":"e437cfa5-c4f1-4ab2-9dd0-fa3e64245665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":10556},{"type":"v1","addr":"172.21.15.146:6803","nonce":10556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":10556},{"type":"v1","addr":"172.21.15.146:6805","nonce":10556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":10556},{"type":"v1","addr":"172.21.15.146:6809","nonce":10556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":10556},{"type":"v1","addr":"172.21.15.146:6807","nonce":10556}]},"public_addr":"172.21.15.146:6803/10556","cluster_addr":"172.21.15.146:6805/10556","heartbeat_back_addr":"172.21.15.146:6809/10556","heartbeat_front_addr":"172.21.15.146:6807/10556","state":["exists","up"]},{"osd":2,"uuid":"87f24052-5457-4af3-a4bb-6022789115ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":10558},{"type":"v1","addr":"172.21.15.146:6811","nonce":10558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":10558},{"type":"v1","addr":"172.21.15.146:6813","nonce":10558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":10558},{"type":"v1","addr":"172.21.15.146:6817","nonce":10558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":10558},{"type":"v1","addr":"172.21.15.146:6815","nonce":10558}]},"public_addr":"172.21.15.146:6811/10558","cluster_addr":"172.21.15.146:6813/10558","heartbeat_back_addr":"172.21.15.146:6817/10558","heartbeat_front_addr":"172.21.15.146:6815/10558","state":["exists","up"]},{"osd":3,"uuid":"d487a545-36d6-45d4-b44e-d38aa06d0e4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":10557},{"type":"v1","addr":"172.21.15.146:6819","nonce":10557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":10557},{"type":"v1","addr":"172.21.15.146:6821","nonce":10557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":10557},{"type":"v1","addr":"172.21.15.146:6825","nonce":10557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":10557},{"type":"v1","addr":"172.21.15.146:6823","nonce":10557}]},"public_addr":"172.21.15.146:6819/10557","cluster_addr":"172.21.15.146:6821/10557","heartbeat_back_addr":"172.21.15.146:6825/10557","heartbeat_front_addr":"172.21.15.146:6823/10557","state":["exists","up"]},{"osd":4,"uuid":"141a9459-6c41-4014-8d64-18641bf263cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":10134},{"type":"v1","addr":"172.21.15.194:6803","nonce":10134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":10134},{"type":"v1","addr":"172.21.15.194:6808","nonce":10134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":10134},{"type":"v1","addr":"172.21.15.194:6815","nonce":10134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":10134},{"type":"v1","addr":"172.21.15.194:6812","nonce":10134}]},"public_addr":"172.21.15.194:6803/10134","cluster_addr":"172.21.15.194:6808/10134","heartbeat_back_addr":"172.21.15.194:6815/10134","heartbeat_front_addr":"172.21.15.194:6812/10134","state":["exists","up"]},{"osd":5,"uuid":"db5f97ec-455d-42bf-93e9-ecb7f5d0b4d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":10132},{"type":"v1","addr":"172.21.15.194:6801","nonce":10132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":10132},{"type":"v1","addr":"172.21.15.194:6805","nonce":10132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":10132},{"type":"v1","addr":"172.21.15.194:6813","nonce":10132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6807","nonce":10132},{"type":"v1","addr":"172.21.15.194:6809","nonce":10132}]},"public_addr":"172.21.15.194:6801/10132","cluster_addr":"172.21.15.194:6805/10132","heartbeat_back_addr":"172.21.15.194:6813/10132","heartbeat_front_addr":"172.21.15.194:6809/10132","state":["exists","up"]},{"osd":6,"uuid":"f489d8e4-3bdb-4395-ac80-371987cd828f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":10133},{"type":"v1","addr":"172.21.15.194:6817","nonce":10133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":10133},{"type":"v1","addr":"172.21.15.194:6819","nonce":10133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":10133},{"type":"v1","addr":"172.21.15.194:6823","nonce":10133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":10133},{"type":"v1","addr":"172.21.15.194:6821","nonce":10133}]},"public_addr":"172.21.15.194:6817/10133","cluster_addr":"172.21.15.194:6819/10133","heartbeat_back_addr":"172.21.15.194:6823/10133","heartbeat_front_addr":"172.21.15.194:6821/10133","state":["exists","up"]},{"osd":7,"uuid":"d8e8e32a-8ad0-4c50-8509-b3bdb70f7fec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":10135},{"type":"v1","addr":"172.21.15.194:6825","nonce":10135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":10135},{"type":"v1","addr":"172.21.15.194:6827","nonce":10135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":10135},{"type":"v1","addr":"172.21.15.194:6831","nonce":10135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":10135},{"type":"v1","addr":"172.21.15.194:6829","nonce":10135}]},"public_addr":"172.21.15.194:6825/10135","cluster_addr":"172.21.15.194:6827/10135","heartbeat_back_addr":"172.21.15.194:6831/10135","heartbeat_front_addr":"172.21.15.194:6829/10135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.597506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.456058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.984252+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.870847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.839464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:14.408302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-09T11:06:19.728 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-12-09T11:06:19.728 INFO:tasks.ceph:Creating RBD pool 2019-12-09T11:06:19.728 INFO:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd pool create rbd 8 2019-12-09T11:06:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'rbd' created 2019-12-09T11:06:21.775 INFO:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-12-09T11:06:23.845 INFO:teuthology.orchestra.run.smithi146.stderr:enabled application 'rbd' on pool 'rbd' 2019-12-09T11:06:23.857 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-12-09T11:06:23.857 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-09T11:06:23.858 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-12-09T11:06:24.700 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:06:24.701 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"200bc98e-4aef-4869-b3f7-6e32c2ad2995","created":"2019-12-09T11:05:47.222249+0000","modified":"2019-12-09T11:06:23.684185+0000","last_up_change":"2019-12-09T11:06:18.685869+0000","last_in_change":"2019-12-09T11:06:18.685869+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-09T11:06:20.441677+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4afce683-b22d-4b19-b483-7c476b3e66a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":10555},{"type":"v1","addr":"172.21.15.146:6827","nonce":10555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":10555},{"type":"v1","addr":"172.21.15.146:6829","nonce":10555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":10555},{"type":"v1","addr":"172.21.15.146:6833","nonce":10555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":10555},{"type":"v1","addr":"172.21.15.146:6831","nonce":10555}]},"public_addr":"172.21.15.146:6827/10555","cluster_addr":"172.21.15.146:6829/10555","heartbeat_back_addr":"172.21.15.146:6833/10555","heartbeat_front_addr":"172.21.15.146:6831/10555","state":["exists","up"]},{"osd":1,"uuid":"e437cfa5-c4f1-4ab2-9dd0-fa3e64245665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":10556},{"type":"v1","addr":"172.21.15.146:6803","nonce":10556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":10556},{"type":"v1","addr":"172.21.15.146:6805","nonce":10556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":10556},{"type":"v1","addr":"172.21.15.146:6809","nonce":10556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":10556},{"type":"v1","addr":"172.21.15.146:6807","nonce":10556}]},"public_addr":"172.21.15.146:6803/10556","cluster_addr":"172.21.15.146:6805/10556","heartbeat_back_addr":"172.21.15.146:6809/10556","heartbeat_front_addr":"172.21.15.146:6807/10556","state":["exists","up"]},{"osd":2,"uuid":"87f24052-5457-4af3-a4bb-6022789115ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":10558},{"type":"v1","addr":"172.21.15.146:6811","nonce":10558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":10558},{"type":"v1","addr":"172.21.15.146:6813","nonce":10558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":10558},{"type":"v1","addr":"172.21.15.146:6817","nonce":10558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":10558},{"type":"v1","addr":"172.21.15.146:6815","nonce":10558}]},"public_addr":"172.21.15.146:6811/10558","cluster_addr":"172.21.15.146:6813/10558","heartbeat_back_addr":"172.21.15.146:6817/10558","heartbeat_front_addr":"172.21.15.146:6815/10558","state":["exists","up"]},{"osd":3,"uuid":"d487a545-36d6-45d4-b44e-d38aa06d0e4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":10557},{"type":"v1","addr":"172.21.15.146:6819","nonce":10557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":10557},{"type":"v1","addr":"172.21.15.146:6821","nonce":10557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":10557},{"type":"v1","addr":"172.21.15.146:6825","nonce":10557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":10557},{"type":"v1","addr":"172.21.15.146:6823","nonce":10557}]},"public_addr":"172.21.15.146:6819/10557","cluster_addr":"172.21.15.146:6821/10557","heartbeat_back_addr":"172.21.15.146:6825/10557","heartbeat_front_addr":"172.21.15.146:6823/10557","state":["exists","up"]},{"osd":4,"uuid":"141a9459-6c41-4014-8d64-18641bf263cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":10134},{"type":"v1","addr":"172.21.15.194:6803","nonce":10134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":10134},{"type":"v1","addr":"172.21.15.194:6808","nonce":10134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":10134},{"type":"v1","addr":"172.21.15.194:6815","nonce":10134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":10134},{"type":"v1","addr":"172.21.15.194:6812","nonce":10134}]},"public_addr":"172.21.15.194:6803/10134","cluster_addr":"172.21.15.194:6808/10134","heartbeat_back_addr":"172.21.15.194:6815/10134","heartbeat_front_addr":"172.21.15.194:6812/10134","state":["exists","up"]},{"osd":5,"uuid":"db5f97ec-455d-42bf-93e9-ecb7f5d0b4d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":10132},{"type":"v1","addr":"172.21.15.194:6801","nonce":10132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":10132},{"type":"v1","addr":"172.21.15.194:6805","nonce":10132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":10132},{"type":"v1","addr":"172.21.15.194:6813","nonce":10132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6807","nonce":10132},{"type":"v1","addr":"172.21.15.194:6809","nonce":10132}]},"public_addr":"172.21.15.194:6801/10132","cluster_addr":"172.21.15.194:6805/10132","heartbeat_back_addr":"172.21.15.194:6813/10132","heartbeat_front_addr":"172.21.15.194:6809/10132","state":["exists","up"]},{"osd":6,"uuid":"f489d8e4-3bdb-4395-ac80-371987cd828f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":10133},{"type":"v1","addr":"172.21.15.194:6817","nonce":10133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":10133},{"type":"v1","addr":"172.21.15.194:6819","nonce":10133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":10133},{"type":"v1","addr":"172.21.15.194:6823","nonce":10133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":10133},{"type":"v1","addr":"172.21.15.194:6821","nonce":10133}]},"public_addr":"172.21.15.194:6817/10133","cluster_addr":"172.21.15.194:6819/10133","heartbeat_back_addr":"172.21.15.194:6823/10133","heartbeat_front_addr":"172.21.15.194:6821/10133","state":["exists","up"]},{"osd":7,"uuid":"d8e8e32a-8ad0-4c50-8509-b3bdb70f7fec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":10135},{"type":"v1","addr":"172.21.15.194:6825","nonce":10135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":10135},{"type":"v1","addr":"172.21.15.194:6827","nonce":10135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":10135},{"type":"v1","addr":"172.21.15.194:6831","nonce":10135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":10135},{"type":"v1","addr":"172.21.15.194:6829","nonce":10135}]},"public_addr":"172.21.15.194:6825/10135","cluster_addr":"172.21.15.194:6827/10135","heartbeat_back_addr":"172.21.15.194:6831/10135","heartbeat_front_addr":"172.21.15.194:6829/10135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:14.682995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.597506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.456058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:15.332659+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.984252+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.870847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.839464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:14.408302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-09T11:06:24.715 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-09T11:06:20.441677+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-09T11:06:24.715 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-09T11:06:25.472 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2019-12-09T11:06:25.493 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-12-09T11:06:25.493 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-12-09T11:06:25.493 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-12-09T11:06:26.540 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:06:26.561 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":3,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":9590},{"type":"v1","addr":"172.21.15.146:6801","nonce":9590}]},"active_addr":"172.21.15.146:6801/9590","active_change":"2019-12-09T11:05:50.819317+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]}} 2019-12-09T11:06:26.566 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-12-09T11:06:26.566 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-12-09T11:06:26.567 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-09T11:06:27.365 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:06:27.365 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":22,"fsid":"200bc98e-4aef-4869-b3f7-6e32c2ad2995","created":"2019-12-09T11:05:47.222249+0000","modified":"2019-12-09T11:06:25.808450+0000","last_up_change":"2019-12-09T11:06:18.685869+0000","last_in_change":"2019-12-09T11:06:18.685869+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-09T11:06:20.441677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4afce683-b22d-4b19-b483-7c476b3e66a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":10555},{"type":"v1","addr":"172.21.15.146:6827","nonce":10555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":10555},{"type":"v1","addr":"172.21.15.146:6829","nonce":10555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":10555},{"type":"v1","addr":"172.21.15.146:6833","nonce":10555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":10555},{"type":"v1","addr":"172.21.15.146:6831","nonce":10555}]},"public_addr":"172.21.15.146:6827/10555","cluster_addr":"172.21.15.146:6829/10555","heartbeat_back_addr":"172.21.15.146:6833/10555","heartbeat_front_addr":"172.21.15.146:6831/10555","state":["exists","up"]},{"osd":1,"uuid":"e437cfa5-c4f1-4ab2-9dd0-fa3e64245665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":10556},{"type":"v1","addr":"172.21.15.146:6803","nonce":10556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":10556},{"type":"v1","addr":"172.21.15.146:6805","nonce":10556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":10556},{"type":"v1","addr":"172.21.15.146:6809","nonce":10556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":10556},{"type":"v1","addr":"172.21.15.146:6807","nonce":10556}]},"public_addr":"172.21.15.146:6803/10556","cluster_addr":"172.21.15.146:6805/10556","heartbeat_back_addr":"172.21.15.146:6809/10556","heartbeat_front_addr":"172.21.15.146:6807/10556","state":["exists","up"]},{"osd":2,"uuid":"87f24052-5457-4af3-a4bb-6022789115ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":10558},{"type":"v1","addr":"172.21.15.146:6811","nonce":10558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":10558},{"type":"v1","addr":"172.21.15.146:6813","nonce":10558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":10558},{"type":"v1","addr":"172.21.15.146:6817","nonce":10558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":10558},{"type":"v1","addr":"172.21.15.146:6815","nonce":10558}]},"public_addr":"172.21.15.146:6811/10558","cluster_addr":"172.21.15.146:6813/10558","heartbeat_back_addr":"172.21.15.146:6817/10558","heartbeat_front_addr":"172.21.15.146:6815/10558","state":["exists","up"]},{"osd":3,"uuid":"d487a545-36d6-45d4-b44e-d38aa06d0e4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":10557},{"type":"v1","addr":"172.21.15.146:6819","nonce":10557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":10557},{"type":"v1","addr":"172.21.15.146:6821","nonce":10557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":10557},{"type":"v1","addr":"172.21.15.146:6825","nonce":10557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":10557},{"type":"v1","addr":"172.21.15.146:6823","nonce":10557}]},"public_addr":"172.21.15.146:6819/10557","cluster_addr":"172.21.15.146:6821/10557","heartbeat_back_addr":"172.21.15.146:6825/10557","heartbeat_front_addr":"172.21.15.146:6823/10557","state":["exists","up"]},{"osd":4,"uuid":"141a9459-6c41-4014-8d64-18641bf263cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":10134},{"type":"v1","addr":"172.21.15.194:6803","nonce":10134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":10134},{"type":"v1","addr":"172.21.15.194:6808","nonce":10134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":10134},{"type":"v1","addr":"172.21.15.194:6815","nonce":10134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":10134},{"type":"v1","addr":"172.21.15.194:6812","nonce":10134}]},"public_addr":"172.21.15.194:6803/10134","cluster_addr":"172.21.15.194:6808/10134","heartbeat_back_addr":"172.21.15.194:6815/10134","heartbeat_front_addr":"172.21.15.194:6812/10134","state":["exists","up"]},{"osd":5,"uuid":"db5f97ec-455d-42bf-93e9-ecb7f5d0b4d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":10132},{"type":"v1","addr":"172.21.15.194:6801","nonce":10132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":10132},{"type":"v1","addr":"172.21.15.194:6805","nonce":10132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":10132},{"type":"v1","addr":"172.21.15.194:6813","nonce":10132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6807","nonce":10132},{"type":"v1","addr":"172.21.15.194:6809","nonce":10132}]},"public_addr":"172.21.15.194:6801/10132","cluster_addr":"172.21.15.194:6805/10132","heartbeat_back_addr":"172.21.15.194:6813/10132","heartbeat_front_addr":"172.21.15.194:6809/10132","state":["exists","up"]},{"osd":6,"uuid":"f489d8e4-3bdb-4395-ac80-371987cd828f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":10133},{"type":"v1","addr":"172.21.15.194:6817","nonce":10133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":10133},{"type":"v1","addr":"172.21.15.194:6819","nonce":10133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":10133},{"type":"v1","addr":"172.21.15.194:6823","nonce":10133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":10133},{"type":"v1","addr":"172.21.15.194:6821","nonce":10133}]},"public_addr":"172.21.15.194:6817/10133","cluster_addr":"172.21.15.194:6819/10133","heartbeat_back_addr":"172.21.15.194:6823/10133","heartbeat_front_addr":"172.21.15.194:6821/10133","state":["exists","up"]},{"osd":7,"uuid":"d8e8e32a-8ad0-4c50-8509-b3bdb70f7fec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":10135},{"type":"v1","addr":"172.21.15.194:6825","nonce":10135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":10135},{"type":"v1","addr":"172.21.15.194:6827","nonce":10135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":10135},{"type":"v1","addr":"172.21.15.194:6831","nonce":10135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":10135},{"type":"v1","addr":"172.21.15.194:6829","nonce":10135}]},"public_addr":"172.21.15.194:6825/10135","cluster_addr":"172.21.15.194:6827/10135","heartbeat_back_addr":"172.21.15.194:6831/10135","heartbeat_front_addr":"172.21.15.194:6829/10135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:14.682995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.597506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.456058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:15.332659+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.984252+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.870847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.839464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:14.408302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-09T11:06:27.384 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-12-09T11:06:27.385 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-09T11:06:28.167 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:06:28.167 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":22,"fsid":"200bc98e-4aef-4869-b3f7-6e32c2ad2995","created":"2019-12-09T11:05:47.222249+0000","modified":"2019-12-09T11:06:25.808450+0000","last_up_change":"2019-12-09T11:06:18.685869+0000","last_in_change":"2019-12-09T11:06:18.685869+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-09T11:06:20.441677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4afce683-b22d-4b19-b483-7c476b3e66a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":10555},{"type":"v1","addr":"172.21.15.146:6827","nonce":10555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":10555},{"type":"v1","addr":"172.21.15.146:6829","nonce":10555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":10555},{"type":"v1","addr":"172.21.15.146:6833","nonce":10555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":10555},{"type":"v1","addr":"172.21.15.146:6831","nonce":10555}]},"public_addr":"172.21.15.146:6827/10555","cluster_addr":"172.21.15.146:6829/10555","heartbeat_back_addr":"172.21.15.146:6833/10555","heartbeat_front_addr":"172.21.15.146:6831/10555","state":["exists","up"]},{"osd":1,"uuid":"e437cfa5-c4f1-4ab2-9dd0-fa3e64245665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":10556},{"type":"v1","addr":"172.21.15.146:6803","nonce":10556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":10556},{"type":"v1","addr":"172.21.15.146:6805","nonce":10556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":10556},{"type":"v1","addr":"172.21.15.146:6809","nonce":10556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":10556},{"type":"v1","addr":"172.21.15.146:6807","nonce":10556}]},"public_addr":"172.21.15.146:6803/10556","cluster_addr":"172.21.15.146:6805/10556","heartbeat_back_addr":"172.21.15.146:6809/10556","heartbeat_front_addr":"172.21.15.146:6807/10556","state":["exists","up"]},{"osd":2,"uuid":"87f24052-5457-4af3-a4bb-6022789115ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":10558},{"type":"v1","addr":"172.21.15.146:6811","nonce":10558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":10558},{"type":"v1","addr":"172.21.15.146:6813","nonce":10558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":10558},{"type":"v1","addr":"172.21.15.146:6817","nonce":10558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":10558},{"type":"v1","addr":"172.21.15.146:6815","nonce":10558}]},"public_addr":"172.21.15.146:6811/10558","cluster_addr":"172.21.15.146:6813/10558","heartbeat_back_addr":"172.21.15.146:6817/10558","heartbeat_front_addr":"172.21.15.146:6815/10558","state":["exists","up"]},{"osd":3,"uuid":"d487a545-36d6-45d4-b44e-d38aa06d0e4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":10557},{"type":"v1","addr":"172.21.15.146:6819","nonce":10557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":10557},{"type":"v1","addr":"172.21.15.146:6821","nonce":10557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":10557},{"type":"v1","addr":"172.21.15.146:6825","nonce":10557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":10557},{"type":"v1","addr":"172.21.15.146:6823","nonce":10557}]},"public_addr":"172.21.15.146:6819/10557","cluster_addr":"172.21.15.146:6821/10557","heartbeat_back_addr":"172.21.15.146:6825/10557","heartbeat_front_addr":"172.21.15.146:6823/10557","state":["exists","up"]},{"osd":4,"uuid":"141a9459-6c41-4014-8d64-18641bf263cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":10134},{"type":"v1","addr":"172.21.15.194:6803","nonce":10134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":10134},{"type":"v1","addr":"172.21.15.194:6808","nonce":10134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":10134},{"type":"v1","addr":"172.21.15.194:6815","nonce":10134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":10134},{"type":"v1","addr":"172.21.15.194:6812","nonce":10134}]},"public_addr":"172.21.15.194:6803/10134","cluster_addr":"172.21.15.194:6808/10134","heartbeat_back_addr":"172.21.15.194:6815/10134","heartbeat_front_addr":"172.21.15.194:6812/10134","state":["exists","up"]},{"osd":5,"uuid":"db5f97ec-455d-42bf-93e9-ecb7f5d0b4d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":10132},{"type":"v1","addr":"172.21.15.194:6801","nonce":10132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":10132},{"type":"v1","addr":"172.21.15.194:6805","nonce":10132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":10132},{"type":"v1","addr":"172.21.15.194:6813","nonce":10132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6807","nonce":10132},{"type":"v1","addr":"172.21.15.194:6809","nonce":10132}]},"public_addr":"172.21.15.194:6801/10132","cluster_addr":"172.21.15.194:6805/10132","heartbeat_back_addr":"172.21.15.194:6813/10132","heartbeat_front_addr":"172.21.15.194:6809/10132","state":["exists","up"]},{"osd":6,"uuid":"f489d8e4-3bdb-4395-ac80-371987cd828f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":10133},{"type":"v1","addr":"172.21.15.194:6817","nonce":10133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":10133},{"type":"v1","addr":"172.21.15.194:6819","nonce":10133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":10133},{"type":"v1","addr":"172.21.15.194:6823","nonce":10133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":10133},{"type":"v1","addr":"172.21.15.194:6821","nonce":10133}]},"public_addr":"172.21.15.194:6817/10133","cluster_addr":"172.21.15.194:6819/10133","heartbeat_back_addr":"172.21.15.194:6823/10133","heartbeat_front_addr":"172.21.15.194:6821/10133","state":["exists","up"]},{"osd":7,"uuid":"d8e8e32a-8ad0-4c50-8509-b3bdb70f7fec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":10135},{"type":"v1","addr":"172.21.15.194:6825","nonce":10135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":10135},{"type":"v1","addr":"172.21.15.194:6827","nonce":10135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":10135},{"type":"v1","addr":"172.21.15.194:6831","nonce":10135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":10135},{"type":"v1","addr":"172.21.15.194:6829","nonce":10135}]},"public_addr":"172.21.15.194:6825/10135","cluster_addr":"172.21.15.194:6827/10135","heartbeat_back_addr":"172.21.15.194:6831/10135","heartbeat_front_addr":"172.21.15.194:6829/10135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:14.682995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.597506+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.456058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:15.332659+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.984252+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.870847+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:13.839464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T11:06:14.408302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-09T11:06:28.189 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-12-09T11:06:28.594 INFO:teuthology.orchestra.run.smithi146.stdout:64424509446 2019-12-09T11:06:28.594 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-12-09T11:06:29.028 INFO:teuthology.orchestra.run.smithi146.stdout:55834574852 2019-12-09T11:06:29.029 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-12-09T11:06:29.483 INFO:teuthology.orchestra.run.smithi146.stdout:60129542149 2019-12-09T11:06:29.483 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-12-09T11:06:29.941 INFO:teuthology.orchestra.run.smithi146.stdout:68719476741 2019-12-09T11:06:29.942 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-12-09T11:06:30.510 INFO:teuthology.orchestra.run.smithi146.stdout:60129542149 2019-12-09T11:06:30.510 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-12-09T11:06:31.053 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2019-12-09T11:06:31.053 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-12-09T11:06:31.543 INFO:teuthology.orchestra.run.smithi146.stdout:55834574853 2019-12-09T11:06:31.544 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-12-09T11:06:32.166 INFO:teuthology.orchestra.run.smithi146.stdout:60129542149 2019-12-09T11:06:32.167 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-12-09T11:06:33.069 INFO:teuthology.orchestra.run.smithi146.stdout:64424509446 2019-12-09T11:06:33.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2019-12-09T11:06:33.084 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-12-09T11:06:33.903 INFO:teuthology.orchestra.run.smithi146.stdout:55834574853 2019-12-09T11:06:33.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.1 2019-12-09T11:06:33.922 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-12-09T11:06:34.676 INFO:teuthology.orchestra.run.smithi146.stdout:60129542150 2019-12-09T11:06:34.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.2 2019-12-09T11:06:34.689 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-12-09T11:06:35.505 INFO:teuthology.orchestra.run.smithi146.stdout:68719476741 2019-12-09T11:06:35.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476741 for osd.3 2019-12-09T11:06:35.522 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-12-09T11:06:36.238 INFO:teuthology.orchestra.run.smithi146.stdout:60129542150 2019-12-09T11:06:36.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.4 2019-12-09T11:06:36.257 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-12-09T11:06:37.076 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2019-12-09T11:06:37.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2019-12-09T11:06:37.095 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-12-09T11:06:37.995 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2019-12-09T11:06:38.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2019-12-09T11:06:38.010 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-12-09T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stdout:60129542149 2019-12-09T11:06:38.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2019-12-09T11:06:38.736 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-12-09T11:06:38.736 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-09T11:06:39.570 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2019-12-09T11:06:39.570 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:06:39.585 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2019-12-09T11:06:38.957338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390400,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584320,"statfs":{"total":773094113280,"available":764502343680,"internally_reserved":8589934592,"allocated":1769472,"data_stored":592472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:24.861466+0000","last_change":"2019-12-09T11:06:23.605402+0000","last_active":"2019-12-09T11:06:24.861466+0000","last_peered":"2019-12-09T11:06:24.861466+0000","last_clean":"2019-12-09T11:06:24.861466+0000","last_became_active":"2019-12-09T11:06:23.553330+0000","last_became_peered":"2019-12-09T11:06:23.553330+0000","last_unstale":"2019-12-09T11:06:24.861466+0000","last_undegraded":"2019-12-09T11:06:24.861466+0000","last_fullsized":"2019-12-09T11:06:24.861466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:24.857468+0000","last_change":"2019-12-09T11:06:23.754755+0000","last_active":"2019-12-09T11:06:24.857468+0000","last_peered":"2019-12-09T11:06:24.857468+0000","last_clean":"2019-12-09T11:06:24.857468+0000","last_became_active":"2019-12-09T11:06:23.739729+0000","last_became_peered":"2019-12-09T11:06:23.739729+0000","last_unstale":"2019-12-09T11:06:24.857468+0000","last_undegraded":"2019-12-09T11:06:24.857468+0000","last_fullsized":"2019-12-09T11:06:24.857468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:25.808542+0000","last_change":"2019-12-09T11:06:23.788190+0000","last_active":"2019-12-09T11:06:25.808542+0000","last_peered":"2019-12-09T11:06:25.808542+0000","last_clean":"2019-12-09T11:06:25.808542+0000","last_became_active":"2019-12-09T11:06:23.756243+0000","last_became_peered":"2019-12-09T11:06:23.756243+0000","last_unstale":"2019-12-09T11:06:25.808542+0000","last_undegraded":"2019-12-09T11:06:25.808542+0000","last_fullsized":"2019-12-09T11:06:25.808542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:24.843098+0000","last_change":"2019-12-09T11:06:24.007957+0000","last_active":"2019-12-09T11:06:24.843098+0000","last_peered":"2019-12-09T11:06:24.843098+0000","last_clean":"2019-12-09T11:06:24.843098+0000","last_became_active":"2019-12-09T11:06:23.975942+0000","last_became_peered":"2019-12-09T11:06:23.975942+0000","last_unstale":"2019-12-09T11:06:24.843098+0000","last_undegraded":"2019-12-09T11:06:24.843098+0000","last_fullsized":"2019-12-09T11:06:24.843098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:25.914021+0000","last_change":"2019-12-09T11:06:24.788061+0000","last_active":"2019-12-09T11:06:25.914021+0000","last_peered":"2019-12-09T11:06:25.914021+0000","last_clean":"2019-12-09T11:06:25.914021+0000","last_became_active":"2019-12-09T11:06:24.709612+0000","last_became_peered":"2019-12-09T11:06:24.709612+0000","last_unstale":"2019-12-09T11:06:25.914021+0000","last_undegraded":"2019-12-09T11:06:25.914021+0000","last_fullsized":"2019-12-09T11:06:25.914021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:24.859599+0000","last_change":"2019-12-09T11:06:23.822007+0000","last_active":"2019-12-09T11:06:24.859599+0000","last_peered":"2019-12-09T11:06:24.859599+0000","last_clean":"2019-12-09T11:06:24.859599+0000","last_became_active":"2019-12-09T11:06:23.777483+0000","last_became_peered":"2019-12-09T11:06:23.777483+0000","last_unstale":"2019-12-09T11:06:24.859599+0000","last_undegraded":"2019-12-09T11:06:24.859599+0000","last_fullsized":"2019-12-09T11:06:24.859599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:25.910384+0000","last_change":"2019-12-09T11:06:24.764477+0000","last_active":"2019-12-09T11:06:25.910384+0000","last_peered":"2019-12-09T11:06:25.910384+0000","last_clean":"2019-12-09T11:06:25.910384+0000","last_became_active":"2019-12-09T11:06:24.685954+0000","last_became_peered":"2019-12-09T11:06:24.685954+0000","last_unstale":"2019-12-09T11:06:25.910384+0000","last_undegraded":"2019-12-09T11:06:25.910384+0000","last_fullsized":"2019-12-09T11:06:25.910384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:25.862398+0000","last_change":"2019-12-09T11:06:23.067439+0000","last_active":"2019-12-09T11:06:25.862398+0000","last_peered":"2019-12-09T11:06:25.862398+0000","last_clean":"2019-12-09T11:06:25.862398+0000","last_became_active":"2019-12-09T11:06:23.030230+0000","last_became_peered":"2019-12-09T11:06:23.030230+0000","last_unstale":"2019-12-09T11:06:25.862398+0000","last_undegraded":"2019-12-09T11:06:25.862398+0000","last_fullsized":"2019-12-09T11:06:25.862398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476742,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.459}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":7.653}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.081}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":7.289}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.051}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.558}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.942}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.792}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.604}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.361}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.566}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.274}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.354}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.085}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.259}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.647}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.986}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.138}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.050}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.045}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.788}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.520}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.715}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.072}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.355}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.512}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.402}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.547}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.537}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.490}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.668}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.293}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.643}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.712}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.483}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.307}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.899}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.435}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.080}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.016}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.449}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.383}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.937}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.834}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.293}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.614}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.559}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.863}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.115}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.635}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.227}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.237}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.431}]}]}]}} 2019-12-09T11:06:39.588 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-09T11:06:40.290 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2019-12-09T11:06:40.290 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:06:40.302 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2019-12-09T11:06:38.957338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390400,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584320,"statfs":{"total":773094113280,"available":764502343680,"internally_reserved":8589934592,"allocated":1769472,"data_stored":592472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:24.861466+0000","last_change":"2019-12-09T11:06:23.605402+0000","last_active":"2019-12-09T11:06:24.861466+0000","last_peered":"2019-12-09T11:06:24.861466+0000","last_clean":"2019-12-09T11:06:24.861466+0000","last_became_active":"2019-12-09T11:06:23.553330+0000","last_became_peered":"2019-12-09T11:06:23.553330+0000","last_unstale":"2019-12-09T11:06:24.861466+0000","last_undegraded":"2019-12-09T11:06:24.861466+0000","last_fullsized":"2019-12-09T11:06:24.861466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:24.857468+0000","last_change":"2019-12-09T11:06:23.754755+0000","last_active":"2019-12-09T11:06:24.857468+0000","last_peered":"2019-12-09T11:06:24.857468+0000","last_clean":"2019-12-09T11:06:24.857468+0000","last_became_active":"2019-12-09T11:06:23.739729+0000","last_became_peered":"2019-12-09T11:06:23.739729+0000","last_unstale":"2019-12-09T11:06:24.857468+0000","last_undegraded":"2019-12-09T11:06:24.857468+0000","last_fullsized":"2019-12-09T11:06:24.857468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:25.808542+0000","last_change":"2019-12-09T11:06:23.788190+0000","last_active":"2019-12-09T11:06:25.808542+0000","last_peered":"2019-12-09T11:06:25.808542+0000","last_clean":"2019-12-09T11:06:25.808542+0000","last_became_active":"2019-12-09T11:06:23.756243+0000","last_became_peered":"2019-12-09T11:06:23.756243+0000","last_unstale":"2019-12-09T11:06:25.808542+0000","last_undegraded":"2019-12-09T11:06:25.808542+0000","last_fullsized":"2019-12-09T11:06:25.808542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:24.843098+0000","last_change":"2019-12-09T11:06:24.007957+0000","last_active":"2019-12-09T11:06:24.843098+0000","last_peered":"2019-12-09T11:06:24.843098+0000","last_clean":"2019-12-09T11:06:24.843098+0000","last_became_active":"2019-12-09T11:06:23.975942+0000","last_became_peered":"2019-12-09T11:06:23.975942+0000","last_unstale":"2019-12-09T11:06:24.843098+0000","last_undegraded":"2019-12-09T11:06:24.843098+0000","last_fullsized":"2019-12-09T11:06:24.843098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:25.914021+0000","last_change":"2019-12-09T11:06:24.788061+0000","last_active":"2019-12-09T11:06:25.914021+0000","last_peered":"2019-12-09T11:06:25.914021+0000","last_clean":"2019-12-09T11:06:25.914021+0000","last_became_active":"2019-12-09T11:06:24.709612+0000","last_became_peered":"2019-12-09T11:06:24.709612+0000","last_unstale":"2019-12-09T11:06:25.914021+0000","last_undegraded":"2019-12-09T11:06:25.914021+0000","last_fullsized":"2019-12-09T11:06:25.914021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:24.859599+0000","last_change":"2019-12-09T11:06:23.822007+0000","last_active":"2019-12-09T11:06:24.859599+0000","last_peered":"2019-12-09T11:06:24.859599+0000","last_clean":"2019-12-09T11:06:24.859599+0000","last_became_active":"2019-12-09T11:06:23.777483+0000","last_became_peered":"2019-12-09T11:06:23.777483+0000","last_unstale":"2019-12-09T11:06:24.859599+0000","last_undegraded":"2019-12-09T11:06:24.859599+0000","last_fullsized":"2019-12-09T11:06:24.859599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:25.910384+0000","last_change":"2019-12-09T11:06:24.764477+0000","last_active":"2019-12-09T11:06:25.910384+0000","last_peered":"2019-12-09T11:06:25.910384+0000","last_clean":"2019-12-09T11:06:25.910384+0000","last_became_active":"2019-12-09T11:06:24.685954+0000","last_became_peered":"2019-12-09T11:06:24.685954+0000","last_unstale":"2019-12-09T11:06:25.910384+0000","last_undegraded":"2019-12-09T11:06:25.910384+0000","last_fullsized":"2019-12-09T11:06:25.910384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-09T11:06:25.862398+0000","last_change":"2019-12-09T11:06:23.067439+0000","last_active":"2019-12-09T11:06:25.862398+0000","last_peered":"2019-12-09T11:06:25.862398+0000","last_clean":"2019-12-09T11:06:25.862398+0000","last_became_active":"2019-12-09T11:06:23.030230+0000","last_became_peered":"2019-12-09T11:06:23.030230+0000","last_unstale":"2019-12-09T11:06:25.862398+0000","last_undegraded":"2019-12-09T11:06:25.862398+0000","last_fullsized":"2019-12-09T11:06:25.862398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T11:06:21.241515+0000","last_clean_scrub_stamp":"2019-12-09T11:06:21.241515+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476742,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.459}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":7.653}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.081}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":7.289}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.051}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.558}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.942}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.792}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.604}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.361}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.566}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.274}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.354}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.085}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.259}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.647}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.986}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.138}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.050}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.045}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.788}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.520}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.715}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.072}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.355}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.512}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.402}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.547}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.537}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.490}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.668}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.293}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.643}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.712}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.483}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.307}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.899}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.435}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.080}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.016}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.449}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.383}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.937}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.834}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.293}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.614}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048800,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323040,"statfs":{"total":96636764160,"available":95562792960,"internally_reserved":1073741824,"allocated":221184,"data_stored":74059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.559}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.863}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.115}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.635}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.227}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.237}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.431}]}]}]}} 2019-12-09T11:06:40.304 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-12-09T11:06:40.305 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-12-09T11:06:40.305 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-12-09T11:06:40.305 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-12-09T11:06:41.050 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:06:41.064 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-12-09T11:06:41.065 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-12-09T11:06:41.065 INFO:teuthology.run_tasks:Running task openssl_keys... 2019-12-09T11:06:41.098 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.1': {'ca': 'root', 'client': 'client.1', 'embed-key': True}, 'root': {'key-type': 'rsa:4096', 'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0', 'client.1']}, 'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}} 2019-12-09T11:06:41.099 INFO:teuthology.orchestra.run.smithi146:> mkdir -p /home/ubuntu/cephtest/ca 2019-12-09T11:06:41.169 INFO:teuthology.orchestra.run.smithi146:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2019-12-09T11:06:41.245 INFO:teuthology.orchestra.run.smithi146.stderr:Generating a 4096 bit RSA private key 2019-12-09T11:06:41.463 INFO:teuthology.orchestra.run.smithi146.stderr:.............................................................++ 2019-12-09T11:06:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:..........................................++ 2019-12-09T11:06:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:writing new private key to '/home/ubuntu/cephtest/ca/root.key' 2019-12-09T11:06:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:----- 2019-12-09T11:06:41.609 INFO:teuthology.orchestra.run.smithi146:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2019-12-09T11:06:41.694 INFO:teuthology.orchestra.run.smithi146:> sudo update-ca-trust 2019-12-09T11:06:42.375 INFO:teuthology.orchestra.run.smithi194:> mkdir -p /home/ubuntu/cephtest/ca 2019-12-09T11:06:42.464 INFO:tasks.openssl_keys:copying from ubuntu@smithi146.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/root.crt to ubuntu@smithi194.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/root.crt... 2019-12-09T11:06:42.560 DEBUG:teuthology.orchestra.remote:smithi146:/home/ubuntu/cephtest/ca/root.crt is 2KB 2019-12-09T11:06:42.741 INFO:teuthology.orchestra.run.smithi194:> sudo mv /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2019-12-09T11:06:42.864 INFO:teuthology.orchestra.run.smithi194:> sudo update-ca-trust 2019-12-09T11:06:43.630 INFO:teuthology.orchestra.run.smithi194:> mkdir -p /home/ubuntu/cephtest/ca 2019-12-09T11:06:43.709 INFO:teuthology.orchestra.run.smithi146:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.1.key -out /home/ubuntu/cephtest/ca/rgw.client.1.csr -subj /CN=smithi194.front.sepia.ceph.com 2019-12-09T11:06:43.803 INFO:teuthology.orchestra.run.smithi146.stderr:Generating a 2048 bit RSA private key 2019-12-09T11:06:43.874 INFO:teuthology.orchestra.run.smithi146.stderr:........................................+++ 2019-12-09T11:06:43.895 INFO:teuthology.orchestra.run.smithi146.stderr:..................+++ 2019-12-09T11:06:43.895 INFO:teuthology.orchestra.run.smithi146.stderr:writing new private key to '/home/ubuntu/cephtest/ca/rgw.client.1.key' 2019-12-09T11:06:43.896 INFO:teuthology.orchestra.run.smithi146.stderr:----- 2019-12-09T11:06:43.897 INFO:teuthology.orchestra.run.smithi146:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.1.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.1.crt -days 365 -sha256 2019-12-09T11:06:43.967 INFO:teuthology.orchestra.run.smithi146.stderr:Signature ok 2019-12-09T11:06:43.967 INFO:teuthology.orchestra.run.smithi146.stderr:subject=/CN=smithi194.front.sepia.ceph.com 2019-12-09T11:06:43.967 INFO:teuthology.orchestra.run.smithi146.stderr:Getting CA Private Key 2019-12-09T11:06:43.978 INFO:teuthology.orchestra.run.smithi146:> rm /home/ubuntu/cephtest/ca/rgw.client.1.csr /home/ubuntu/cephtest/ca/root.srl 2019-12-09T11:06:44.030 INFO:teuthology.orchestra.run.smithi146:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.1.crt 2019-12-09T11:06:44.085 INFO:teuthology.orchestra.run.smithi146.stdout:/home/ubuntu/cephtest/ca/rgw.client.1.crt: OK 2019-12-09T11:06:44.085 INFO:tasks.openssl_keys:copying from ubuntu@smithi146.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.crt to ubuntu@smithi194.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.crt... 2019-12-09T11:06:44.133 DEBUG:teuthology.orchestra.remote:smithi146:/home/ubuntu/cephtest/ca/rgw.client.1.crt is 1KB 2019-12-09T11:06:44.279 INFO:tasks.openssl_keys:copying from ubuntu@smithi146.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.key to ubuntu@smithi194.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.key... 2019-12-09T11:06:44.354 DEBUG:teuthology.orchestra.remote:smithi146:/home/ubuntu/cephtest/ca/rgw.client.1.key is 2KB 2019-12-09T11:06:44.525 INFO:teuthology.orchestra.run.smithi146:> rm /home/ubuntu/cephtest/ca/rgw.client.1.crt /home/ubuntu/cephtest/ca/rgw.client.1.key 2019-12-09T11:06:44.611 INFO:teuthology.orchestra.run.smithi194:> openssl verify /home/ubuntu/cephtest/ca/rgw.client.1.crt 2019-12-09T11:06:44.719 INFO:teuthology.orchestra.run.smithi194.stdout:/home/ubuntu/cephtest/ca/rgw.client.1.crt: OK 2019-12-09T11:06:44.720 INFO:teuthology.orchestra.run.smithi194:> cat /home/ubuntu/cephtest/ca/rgw.client.1.key >> /home/ubuntu/cephtest/ca/rgw.client.1.crt 2019-12-09T11:06:44.804 INFO:teuthology.orchestra.run.smithi146:> mkdir -p /home/ubuntu/cephtest/ca 2019-12-09T11:06:44.889 INFO:teuthology.orchestra.run.smithi146:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi146.front.sepia.ceph.com 2019-12-09T11:06:44.964 INFO:teuthology.orchestra.run.smithi146.stderr:Generating a 2048 bit RSA private key 2019-12-09T11:06:44.986 INFO:teuthology.orchestra.run.smithi146.stderr:..............+++ 2019-12-09T11:06:45.016 INFO:teuthology.orchestra.run.smithi146.stderr:......................+++ 2019-12-09T11:06:45.017 INFO:teuthology.orchestra.run.smithi146.stderr:writing new private key to '/home/ubuntu/cephtest/ca/rgw.client.0.key' 2019-12-09T11:06:45.017 INFO:teuthology.orchestra.run.smithi146.stderr:----- 2019-12-09T11:06:45.019 INFO:teuthology.orchestra.run.smithi146:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 2019-12-09T11:06:45.086 INFO:teuthology.orchestra.run.smithi146.stderr:Signature ok 2019-12-09T11:06:45.086 INFO:teuthology.orchestra.run.smithi146.stderr:subject=/CN=smithi146.front.sepia.ceph.com 2019-12-09T11:06:45.086 INFO:teuthology.orchestra.run.smithi146.stderr:Getting CA Private Key 2019-12-09T11:06:45.097 INFO:teuthology.orchestra.run.smithi146:> rm /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl 2019-12-09T11:06:45.157 INFO:teuthology.orchestra.run.smithi146:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2019-12-09T11:06:45.215 INFO:teuthology.orchestra.run.smithi146.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2019-12-09T11:06:45.216 INFO:teuthology.orchestra.run.smithi146:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2019-12-09T11:06:45.269 INFO:teuthology.run_tasks:Running task rgw... 2019-12-09T11:06:45.285 DEBUG:tasks.rgw:config is {'client.1': {'ssl certificate': 'rgw.client.1'}, 'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2019-12-09T11:06:45.285 DEBUG:tasks.rgw:client list is ['client.0'] 2019-12-09T11:06:45.285 INFO:tasks.rgw:Creating data pools 2019-12-09T11:06:45.285 DEBUG:tasks.rgw:Obtaining remote for client client.0 2019-12-09T11:06:45.285 INFO:teuthology.orchestra.run.smithi146:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2019-12-09T11:06:46.354 INFO:teuthology.orchestra.run.smithi146:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2019-12-09T11:06:48.709 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'default.rgw.buckets.data' created 2019-12-09T11:06:48.723 INFO:teuthology.orchestra.run.smithi146:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2019-12-09T11:06:49.932 INFO:teuthology.orchestra.run.smithi146.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2019-12-09T11:06:49.945 INFO:teuthology.orchestra.run.smithi146:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2019-12-09T11:06:51.272 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'default.rgw.buckets.index' created 2019-12-09T11:06:51.287 INFO:teuthology.orchestra.run.smithi146:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2019-12-09T11:06:52.217 INFO:teuthology.orchestra.run.smithi146.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2019-12-09T11:06:52.231 DEBUG:tasks.rgw:Pools created 2019-12-09T11:06:52.231 INFO:tasks.rgw:Configuring compression type = random 2019-12-09T11:06:52.231 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-12-09T11:06:52.232 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-12-09T11:06:52.232 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-12-09T11:06:52.363 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:52.365+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:54.790 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:54.793+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:54.793+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:54.904 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:54.906+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:54.904 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:54.906+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:54.918 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:54.921+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:54.919 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:54.921+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:54.925 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:54.928+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:56.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.105+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:56.111 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.113+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:56.111 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.113+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:56.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.119+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:56.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.119+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:56.122 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.125+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:56.122 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.125+0000 7f293471eec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T11:06:56.123 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.125+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:56.129 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.131+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:56.129 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.131+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:56.135 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.138+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:56.136 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.138+0000 7f293471eec0 10 Creating default zonegroup 2019-12-09T11:06:56.136 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.138+0000 7f293471eec0 20 get_system_obj_state: rctx=0x7ffec16fdae0 obj=:.pools.avail state=0x564b935b16e0 s->prefetch_data=0 2019-12-09T11:06:56.140 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.142+0000 7f293471eec0 10 couldn't find old data placement pools config, setting up new ones for the zone 2019-12-09T11:06:56.310 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.312+0000 7f293471eec0 10 WARNING: store->list_zones() returned r=-2 2019-12-09T11:06:56.310 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.312+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:56.321 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:56.323+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:57.324 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:57.327+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:57.335+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:57.335+0000 7f293471eec0 10 could not read realm id: (2) No such file or directory 2019-12-09T11:06:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:57.335+0000 7f293471eec0 10 WARNING: failed to set zone as default, r=-22 2019-12-09T11:06:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:57.335+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:57.344 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:57.347+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:58.010 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.012+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:58.069 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.071+0000 7f293471eec0 20 rados_obj.operate() r=0 bl.length=805 2019-12-09T11:06:58.069 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.071+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:58.141 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.142+0000 7f293471eec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-09T11:06:58.141 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.143+0000 7f293471eec0 20 zonegroup default 2019-12-09T11:06:58.141 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.143+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:58.165 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.168+0000 7f293471eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:06:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.168+0000 7f293471eec0 10 Cannot find current period zone using local zone 2019-12-09T11:06:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.168+0000 7f293471eec0 10 Using default name default 2019-12-09T11:06:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.168+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:58.230 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.233+0000 7f293471eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:06:58.231 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.233+0000 7f293471eec0 20 rados->read ofs=0 len=0 2019-12-09T11:06:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.248+0000 7f293471eec0 20 rados_obj.operate() r=0 bl.length=805 2019-12-09T11:06:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.248+0000 7f293471eec0 20 zone default found 2019-12-09T11:06:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.248+0000 7f293471eec0 20 started sync module instance, tier type = 2019-12-09T11:06:58.247 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.248+0000 7f293471eec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T11:06:58.709 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:06:58.711+0000 7f2921147700 0 -- 172.21.15.146:0/535905841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564b9359bb10 msgr2=0x564b9359df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T11:07:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:01.195+0000 7f2921147700 0 -- 172.21.15.146:0/535905841 >> [v2:172.21.15.146:6810/10558,v1:172.21.15.146:6811/10558] conn(0x564b935b5fa0 msgr2=0x564b935b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T11:07:02.557 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:02.559+0000 7f293471eec0 20 add_watcher() i=0 2019-12-09T11:07:02.557 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:02.559+0000 7f293471eec0 20 add_watcher() i=1 2019-12-09T11:07:02.557 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:02.559+0000 7f293471eec0 20 add_watcher() i=2 2019-12-09T11:07:02.557 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:02.559+0000 7f293471eec0 20 add_watcher() i=3 2019-12-09T11:07:02.558 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:02.559+0000 7f293471eec0 20 add_watcher() i=4 2019-12-09T11:07:02.558 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:02.559+0000 7f293471eec0 20 add_watcher() i=5 2019-12-09T11:07:02.558 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:02.559+0000 7f293471eec0 20 add_watcher() i=6 2019-12-09T11:07:02.614 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:02.616+0000 7f293471eec0 20 add_watcher() i=7 2019-12-09T11:07:02.614 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:02.616+0000 7f293471eec0 2 all 8 watchers are set, enabling cache 2019-12-09T11:07:02.614 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:02.616+0000 7f28f27dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T11:07:07.021 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:07.023+0000 7f293471eec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2019-12-09T11:07:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:11.755+0000 7f293471eec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.log 2019-12-09T11:07:16.168 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:16.170+0000 7f2860ff9700 20 reqs_thread_entry: start 2019-12-09T11:07:16.168 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:16.170+0000 7f28527fc700 20 reqs_thread_entry: start 2019-12-09T11:07:16.169 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:16.170+0000 7f293471eec0 20 init_complete bucket index max shards: 0 2019-12-09T11:07:16.169 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:16.171+0000 7f2850ff9700 20 reqs_thread_entry: start 2019-12-09T11:07:16.653 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:16.656+0000 7f293471eec0 20 remove_watcher() i=0 2019-12-09T11:07:16.654 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:16.656+0000 7f293471eec0 2 removed watcher, disabling cache 2019-12-09T11:07:16.729 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:16.732+0000 7f293471eec0 20 remove_watcher() i=1 2019-12-09T11:07:16.803 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:16.805+0000 7f293471eec0 20 remove_watcher() i=2 2019-12-09T11:07:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:16.910+0000 7f293471eec0 20 remove_watcher() i=3 2019-12-09T11:07:16.996 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:16.998+0000 7f293471eec0 20 remove_watcher() i=4 2019-12-09T11:07:17.062 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.065+0000 7f293471eec0 20 remove_watcher() i=5 2019-12-09T11:07:17.147 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.149+0000 7f293471eec0 20 remove_watcher() i=6 2019-12-09T11:07:17.204 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.207+0000 7f293471eec0 20 remove_watcher() i=7 2019-12-09T11:07:17.213 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2019-12-09T11:07:17.214 DEBUG:tasks.util.rgw: json result: [] 2019-12-09T11:07:17.214 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-12-09T11:07:17.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-12-09T11:07:17.214 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2019-12-09T11:07:17.406 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.408+0000 7fb87effd700 20 reqs_thread_entry: start 2019-12-09T11:07:17.406 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.409+0000 7fb949929ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:17.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.426+0000 7fb949929ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:17.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.426+0000 7fb949929ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:17.438 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.441+0000 7fb949929ec0 20 rados_obj.operate() r=0 bl.length=805 2019-12-09T11:07:17.439 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.441+0000 7fb949929ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:17.443 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.446+0000 7fb949929ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:07:17.444 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.446+0000 7fb949929ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:17.456 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.459+0000 7fb949929ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:17.456 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.459+0000 7fb949929ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:17.487 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.490+0000 7fb949929ec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-09T11:07:17.668 INFO:teuthology.orchestra.run.smithi146.stdout:{"id":"eaaaea16-3e32-4d4e-94b4-60e1a08a3965","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-12-09T11:07:17.668 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'eaaaea16-3e32-4d4e-94b4-60e1a08a3965', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-12-09T11:07:17.669 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-12-09T11:07:17.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-12-09T11:07:17.669 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-12-09T11:07:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.855+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:17.880 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.883+0000 7f7c70860ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:07:17.881 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.883+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:17.890 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.893+0000 7f7c70860ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:07:17.890 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.893+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:17.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.897+0000 7f7c70860ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:07:17.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.897+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:17.906 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:17.908+0000 7f7c70860ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.164+0000 7f7c70860ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T11:07:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.164+0000 7f7c70860ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T11:07:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.164+0000 7f7c70860ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T11:07:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.164+0000 7f7c70860ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T11:07:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.164+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:18.187 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.190+0000 7f7c70860ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:18.188 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.190+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:18.201 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.203+0000 7f7c70860ec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-09T11:07:18.201 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.204+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:18.212 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.215+0000 7f7c70860ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:18.212 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.215+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:18.231 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.233+0000 7f7c70860ec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-09T11:07:18.231 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.233+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:18.244 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.247+0000 7f7c70860ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:07:18.245 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.247+0000 7f7c70860ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T11:07:18.245 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.247+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:18.252 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.255+0000 7f7c70860ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:07:18.253 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.255+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:18.268 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.271+0000 7f7c70860ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:18.268 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.271+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:18.288 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.290+0000 7f7c70860ec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-09T11:07:18.288 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.290+0000 7f7c70860ec0 20 zonegroup default 2019-12-09T11:07:18.288 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.290+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:18.297 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.299+0000 7f7c70860ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:07:18.297 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.299+0000 7f7c70860ec0 10 Cannot find current period zone using local zone 2019-12-09T11:07:18.297 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.299+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:18.305 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.308+0000 7f7c70860ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:07:18.306 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.308+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:18.323 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.325+0000 7f7c70860ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:18.323 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.325+0000 7f7c70860ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:18.335 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.338+0000 7f7c70860ec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-09T11:07:18.336 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.338+0000 7f7c70860ec0 20 zone default found 2019-12-09T11:07:18.336 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.338+0000 7f7c70860ec0 20 started sync module instance, tier type = 2019-12-09T11:07:18.336 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.338+0000 7f7c70860ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T11:07:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.795+0000 7f7c70860ec0 20 add_watcher() i=0 2019-12-09T11:07:18.793 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.795+0000 7f7c70860ec0 20 add_watcher() i=1 2019-12-09T11:07:18.793 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.795+0000 7f7c70860ec0 20 add_watcher() i=2 2019-12-09T11:07:18.793 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.795+0000 7f7c70860ec0 20 add_watcher() i=3 2019-12-09T11:07:18.793 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.795+0000 7f7c70860ec0 20 add_watcher() i=4 2019-12-09T11:07:18.793 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.795+0000 7f7c70860ec0 20 add_watcher() i=5 2019-12-09T11:07:18.820 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.822+0000 7f7c70860ec0 20 add_watcher() i=6 2019-12-09T11:07:18.833 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.836+0000 7f7c70860ec0 20 add_watcher() i=7 2019-12-09T11:07:18.834 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.836+0000 7f7c70860ec0 2 all 8 watchers are set, enabling cache 2019-12-09T11:07:18.834 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.836+0000 7f7c2e7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T11:07:18.844 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:18.846+0000 7f7c5da8a700 0 -- 172.21.15.146:0/1511083271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f207c87d10 msgr2=0x55f207c8e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-09T11:07:19.046 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:19.049+0000 7f7c5da8a700 0 --2- 172.21.15.146:0/1511083271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f207c87d10 0x55f207c8e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-09T11:07:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:19.134+0000 7f7c5da8a700 0 -- 172.21.15.146:0/625833620 >> [v2:172.21.15.146:6800/9590,v1:172.21.15.146:6801/9590] conn(0x7f7ba0022470 msgr2=0x7f7ba0024960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T11:07:21.496 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:21.498+0000 7f7ba4ff9700 20 reqs_thread_entry: start 2019-12-09T11:07:21.496 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:21.498+0000 7f7b9e7fc700 20 reqs_thread_entry: start 2019-12-09T11:07:21.496 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:21.499+0000 7f7c70860ec0 20 init_complete bucket index max shards: 0 2019-12-09T11:07:21.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:21.499+0000 7f7b9cff9700 20 reqs_thread_entry: start 2019-12-09T11:07:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:21.762+0000 7f7c70860ec0 20 remove_watcher() i=0 2019-12-09T11:07:21.760 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:21.762+0000 7f7c70860ec0 2 removed watcher, disabling cache 2019-12-09T11:07:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:21.837+0000 7f7c70860ec0 20 remove_watcher() i=1 2019-12-09T11:07:21.889 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:21.892+0000 7f7c70860ec0 20 remove_watcher() i=2 2019-12-09T11:07:21.960 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:21.962+0000 7f7c70860ec0 20 remove_watcher() i=3 2019-12-09T11:07:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.054+0000 7f7c70860ec0 20 remove_watcher() i=4 2019-12-09T11:07:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.144+0000 7f7c70860ec0 20 remove_watcher() i=5 2019-12-09T11:07:22.237 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.230+0000 7f7c70860ec0 20 remove_watcher() i=6 2019-12-09T11:07:22.299 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.302+0000 7f7c70860ec0 20 remove_watcher() i=7 2019-12-09T11:07:22.305 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2019-12-09T11:07:22.305 DEBUG:tasks.util.rgw: json result: [] 2019-12-09T11:07:22.306 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2019-12-09T11:07:22.306 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-12-09T11:07:22.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-12-09T11:07:22.306 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2019-12-09T11:07:22.467 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.469+0000 7fc2d27fc700 20 reqs_thread_entry: start 2019-12-09T11:07:22.467 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.469+0000 7fc39d1faec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.478+0000 7fc39d1faec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:07:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.478+0000 7fc39d1faec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.487+0000 7fc39d1faec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:22.485 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.487+0000 7fc39d1faec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.500+0000 7fc39d1faec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-09T11:07:22.498 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.500+0000 7fc39d1faec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:22.509 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.512+0000 7fc39d1faec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-09T11:07:22.615 INFO:teuthology.orchestra.run.smithi146.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2019-12-09T11:07:22.616 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-12-09T11:07:22.616 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-12-09T11:07:22.616 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-12-09T11:07:22.617 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2019-12-09T11:07:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.861+0000 7f67c8ff9700 20 reqs_thread_entry: start 2019-12-09T11:07:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.861+0000 7f686b6b3ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.880+0000 7f686b6b3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.880+0000 7f686b6b3ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:22.891 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.893+0000 7f686b6b3ec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-09T11:07:22.891 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.893+0000 7f686b6b3ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.898+0000 7f686b6b3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:07:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.898+0000 7f686b6b3ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:22.904 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.907+0000 7f686b6b3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:22.904 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.907+0000 7f686b6b3ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:22.930 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:22.933+0000 7f686b6b3ec0 20 rados_obj.operate() r=0 bl.length=372 2019-12-09T11:07:22.997 INFO:teuthology.orchestra.run.smithi146.stdout:{"id":"eaaaea16-3e32-4d4e-94b4-60e1a08a3965","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-12-09T11:07:22.997 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'eaaaea16-3e32-4d4e-94b4-60e1a08a3965', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-12-09T11:07:22.998 INFO:tasks.rgw:Configuring storage class type = FROZEN 2019-12-09T11:07:22.998 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-12-09T11:07:22.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-12-09T11:07:22.998 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2019-12-09T11:07:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.185+0000 7f74c77fe700 20 reqs_thread_entry: start 2019-12-09T11:07:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.185+0000 7f7592005ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.195+0000 7f7592005ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:07:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.195+0000 7f7592005ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:23.200 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.203+0000 7f7592005ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:23.200 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.203+0000 7f7592005ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:23.219 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.221+0000 7f7592005ec0 20 rados_obj.operate() r=0 bl.length=372 2019-12-09T11:07:23.219 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.221+0000 7f7592005ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:23.231 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.234+0000 7f7592005ec0 20 rados_obj.operate() r=0 bl.length=888 2019-12-09T11:07:23.306 INFO:teuthology.orchestra.run.smithi146.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2019-12-09T11:07:23.306 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-12-09T11:07:23.306 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-12-09T11:07:23.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-12-09T11:07:23.307 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2019-12-09T11:07:23.553 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.555+0000 7fb6dffff700 20 reqs_thread_entry: start 2019-12-09T11:07:23.553 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.555+0000 7fb7ab222ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.570+0000 7fb7ab222ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.570+0000 7fb7ab222ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:23.581 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.584+0000 7fb7ab222ec0 20 rados_obj.operate() r=0 bl.length=888 2019-12-09T11:07:23.581 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.584+0000 7fb7ab222ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.589+0000 7fb7ab222ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:07:23.586 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.589+0000 7fb7ab222ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.597+0000 7fb7ab222ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:07:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.597+0000 7fb7ab222ec0 20 rados->read ofs=0 len=0 2019-12-09T11:07:23.622 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:07:23.624+0000 7fb7ab222ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:07:23.700 INFO:teuthology.orchestra.run.smithi146.stdout:{"id":"eaaaea16-3e32-4d4e-94b4-60e1a08a3965","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-12-09T11:07:23.700 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'eaaaea16-3e32-4d4e-94b4-60e1a08a3965', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-12-09T11:07:23.701 INFO:tasks.rgw:Starting rgw... 2019-12-09T11:07:23.701 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2019-12-09T11:07:23.701 INFO:tasks.rgw:Using beast as radosgw frontend 2019-12-09T11:07:23.702 DEBUG:teuthology.misc:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--tool=memcheck', '--max-threads=1024'] 2019-12-09T11:07:23.702 INFO:tasks.rgw.client.0:Restarting daemon 2019-12-09T11:07:23.702 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2019-12-09T11:07:23.705 INFO:tasks.rgw.client.0:Started 2019-12-09T11:07:23.705 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi146.front.sepia.ceph.com:443/ 2019-12-09T11:07:23.705 INFO:teuthology.orchestra.run.smithi146:> curl https://smithi146.front.sepia.ceph.com:443/ 2019-12-09T11:07:23.779 INFO:teuthology.orchestra.run.smithi146.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-09T11:07:23.779 INFO:teuthology.orchestra.run.smithi146.stderr: Dload Upload Total Spent Left Speed 2019-12-09T11:07:23.782 INFO:teuthology.orchestra.run.smithi146.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi146.front.sepia.ceph.com:443; Connection refused 2019-12-09T11:07:23.783 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-09T11:07:24.784 INFO:teuthology.orchestra.run.smithi146:> curl https://smithi146.front.sepia.ceph.com:443/ 2019-12-09T11:07:24.846 INFO:teuthology.orchestra.run.smithi146.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-09T11:07:24.846 INFO:teuthology.orchestra.run.smithi146.stderr: Dload Upload Total Spent Left Speed 2019-12-09T11:07:24.851 INFO:teuthology.orchestra.run.smithi146.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi146.front.sepia.ceph.com:443; Connection refused 2019-12-09T11:07:24.851 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-09T11:07:26.852 INFO:teuthology.orchestra.run.smithi146:> curl https://smithi146.front.sepia.ceph.com:443/ 2019-12-09T11:07:26.911 INFO:teuthology.orchestra.run.smithi146.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-09T11:07:26.911 INFO:teuthology.orchestra.run.smithi146.stderr: Dload Upload Total Spent Left Speed 2019-12-09T11:07:26.916 INFO:teuthology.orchestra.run.smithi146.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi146.front.sepia.ceph.com:443; Connection refused 2019-12-09T11:07:26.916 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-09T11:07:30.917 INFO:teuthology.orchestra.run.smithi146:> curl https://smithi146.front.sepia.ceph.com:443/ 2019-12-09T11:07:31.011 INFO:teuthology.orchestra.run.smithi146.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-09T11:07:31.012 INFO:teuthology.orchestra.run.smithi146.stderr: Dload Upload Total Spent Left Speed 2019-12-09T11:07:31.015 INFO:teuthology.orchestra.run.smithi146.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi146.front.sepia.ceph.com:443; Connection refused 2019-12-09T11:07:31.016 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-09T11:07:39.017 INFO:teuthology.orchestra.run.smithi146:> curl https://smithi146.front.sepia.ceph.com:443/ 2019-12-09T11:07:39.064 INFO:teuthology.orchestra.run.smithi146.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-09T11:07:39.064 INFO:teuthology.orchestra.run.smithi146.stderr: Dload Upload Total Spent Left Speed 2019-12-09T11:07:40.698 INFO:teuthology.orchestra.run.smithi146.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 100 214 0 214 0 0 130 0 --:--:-- 0:00:01 --:--:-- 130 2019-12-09T11:07:40.700 INFO:teuthology.orchestra.run.smithi146.stdout:anonymous 2019-12-09T11:07:40.700 INFO:teuthology.run_tasks:Running task workunit... 2019-12-09T11:07:40.725 INFO:tasks.workunit:Pulling workunits from ref 1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T11:07:40.725 INFO:tasks.workunit:Making a separate scratch dir for every client... 2019-12-09T11:07:40.725 INFO:teuthology.orchestra.run.smithi146:> stat -- /home/ubuntu/cephtest/mnt.0 2019-12-09T11:07:40.785 INFO:teuthology.orchestra.run.smithi146.stderr:stat: cannot stat ‘/home/ubuntu/cephtest/mnt.0’: No such file or directory 2019-12-09T11:07:40.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-09T11:07:40.786 INFO:teuthology.orchestra.run.smithi146:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-12-09T11:07:40.838 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2019-12-09T11:07:40.838 INFO:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2019-12-09T11:07:40.882 INFO:tasks.workunit:timeout=3h 2019-12-09T11:07:40.882 INFO:tasks.workunit:cleanup=True 2019-12-09T11:07:40.883 INFO:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T11:07:41.153 INFO:tasks.workunit.client.0.smithi146.stdout:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2019-12-09T11:08:46.542 INFO:tasks.workunit.client.0.smithi146.stderr:Note: checking out '1351c819e1a9518cde4c8b12d645782009028360'. 2019-12-09T11:08:46.543 INFO:tasks.workunit.client.0.smithi146.stderr: 2019-12-09T11:08:46.543 INFO:tasks.workunit.client.0.smithi146.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2019-12-09T11:08:46.543 INFO:tasks.workunit.client.0.smithi146.stderr:changes and commit them, and you can discard any commits you make in this 2019-12-09T11:08:46.543 INFO:tasks.workunit.client.0.smithi146.stderr:state without impacting any branches by performing another checkout. 2019-12-09T11:08:46.543 INFO:tasks.workunit.client.0.smithi146.stderr: 2019-12-09T11:08:46.543 INFO:tasks.workunit.client.0.smithi146.stderr:If you want to create a new branch to retain commits you create, you may 2019-12-09T11:08:46.543 INFO:tasks.workunit.client.0.smithi146.stderr:do so (now or later) by using -b with the checkout command again. Example: 2019-12-09T11:08:46.544 INFO:tasks.workunit.client.0.smithi146.stderr: 2019-12-09T11:08:46.544 INFO:tasks.workunit.client.0.smithi146.stderr: git checkout -b new_branch_name 2019-12-09T11:08:46.544 INFO:tasks.workunit.client.0.smithi146.stderr: 2019-12-09T11:08:46.544 INFO:tasks.workunit.client.0.smithi146.stderr:HEAD is now at 1351c81... rgw: Fix dynamic resharding not working for empty zonegroup in period 2019-12-09T11:08:46.545 INFO:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2019-12-09T11:08:46.604 INFO:tasks.workunit.client.0.smithi146.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2019-12-09T11:08:46.607 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-12-09T11:08:46.607 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2019-12-09T11:08:47.064 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2019-12-09T11:08:47.133 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2019-12-09T11:08:47.168 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-12-09T11:08:47.169 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-12-09T11:08:47.169 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2019-12-09T11:08:47.203 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-12-09T11:08:47.248 DEBUG:teuthology.orchestra.remote:smithi146:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2019-12-09T11:08:47.294 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2019-12-09T11:08:47.294 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2019-12-09T11:08:47.295 INFO:teuthology.orchestra.run.smithi146:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2019-12-09T11:08:47.349 INFO:tasks.workunit.client.0.smithi146.stdout:Running main() from gmock_main.cc 2019-12-09T11:08:47.349 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] Running 11 tests from 1 test suite. 2019-12-09T11:08:47.350 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment set-up. 2019-12-09T11:08:47.350 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 11 tests from ClsLock 2019-12-09T11:08:47.350 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ClsLock.TestMultiLocking 2019-12-09T11:08:50.125 INFO:tasks.workunit.client.0.smithi146.stdout:lock: mylock 2019-12-09T11:08:50.125 INFO:tasks.workunit.client.0.smithi146.stdout: lock_type: exclusive 2019-12-09T11:08:50.125 INFO:tasks.workunit.client.0.smithi146.stdout: tag: 2019-12-09T11:08:50.125 INFO:tasks.workunit.client.0.smithi146.stdout: lockers: 2019-12-09T11:08:50.126 INFO:tasks.workunit.client.0.smithi146.stdout: client.4388 expiration=2019-12-09T11:10:49.948167+0000 addr=v1:172.21.15.146:0/2595730123 cookie= 2019-12-09T11:08:50.327 INFO:tasks.workunit.client.0.smithi146.stdout:lock: mylock 2019-12-09T11:08:50.327 INFO:tasks.workunit.client.0.smithi146.stdout: lock_type: shared 2019-12-09T11:08:50.328 INFO:tasks.workunit.client.0.smithi146.stdout: tag: 2019-12-09T11:08:50.328 INFO:tasks.workunit.client.0.smithi146.stdout: lockers: 2019-12-09T11:08:50.328 INFO:tasks.workunit.client.0.smithi146.stdout: client.4388 expiration=2019-12-09T11:10:50.267814+0000 addr=v1:172.21.15.146:0/2595730123 cookie= 2019-12-09T11:08:50.328 INFO:tasks.workunit.client.0.smithi146.stdout: client.4516 expiration=0.000000 addr=v1:172.21.15.146:0/68469610 cookie= 2019-12-09T11:08:50.398 INFO:tasks.workunit.client.0.smithi146.stdout:lock: mylock 2019-12-09T11:08:50.398 INFO:tasks.workunit.client.0.smithi146.stdout: lock_type: shared 2019-12-09T11:08:50.398 INFO:tasks.workunit.client.0.smithi146.stdout: tag: 2019-12-09T11:08:50.398 INFO:tasks.workunit.client.0.smithi146.stdout: lockers: 2019-12-09T11:08:50.398 INFO:tasks.workunit.client.0.smithi146.stdout: client.4516 expiration=0.000000 addr=v1:172.21.15.146:0/68469610 cookie= 2019-12-09T11:08:51.611 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ClsLock.TestMultiLocking (4262 ms) 2019-12-09T11:08:51.612 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ClsLock.TestMeta 2019-12-09T11:08:54.688 INFO:tasks.workunit.client.0.smithi146.stdout:lock: mylock 2019-12-09T11:08:54.689 INFO:tasks.workunit.client.0.smithi146.stdout: lock_type: shared 2019-12-09T11:08:54.689 INFO:tasks.workunit.client.0.smithi146.stdout: tag: 2019-12-09T11:08:54.689 INFO:tasks.workunit.client.0.smithi146.stdout: lockers: 2019-12-09T11:08:54.689 INFO:tasks.workunit.client.0.smithi146.stdout: client.4400 expiration=0.000000 addr=v1:172.21.15.146:0/3732972915 cookie= 2019-12-09T11:08:54.776 INFO:tasks.workunit.client.0.smithi146.stdout:lock: mylock 2019-12-09T11:08:54.776 INFO:tasks.workunit.client.0.smithi146.stdout: lock_type: exclusive 2019-12-09T11:08:54.776 INFO:tasks.workunit.client.0.smithi146.stdout: tag: new_tag 2019-12-09T11:08:54.776 INFO:tasks.workunit.client.0.smithi146.stdout: lockers: 2019-12-09T11:08:54.776 INFO:tasks.workunit.client.0.smithi146.stdout: client.4394 expiration=0.000000 addr=v1:172.21.15.146:0/1379979417 cookie= 2019-12-09T11:08:55.109 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ClsLock.TestMeta (3498 ms) 2019-12-09T11:08:55.109 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ClsLock.TestCookie 2019-12-09T11:08:58.007 INFO:tasks.workunit.client.0.smithi146.stdout:lock: mylock 2019-12-09T11:08:58.007 INFO:tasks.workunit.client.0.smithi146.stdout: lock_type: exclusive 2019-12-09T11:08:58.007 INFO:tasks.workunit.client.0.smithi146.stdout: tag: 2019-12-09T11:08:58.008 INFO:tasks.workunit.client.0.smithi146.stdout: lockers: 2019-12-09T11:08:58.084 INFO:tasks.workunit.client.0.smithi146.stdout:lock: mylock 2019-12-09T11:08:58.084 INFO:tasks.workunit.client.0.smithi146.stdout: lock_type: shared 2019-12-09T11:08:58.085 INFO:tasks.workunit.client.0.smithi146.stdout: tag: 2019-12-09T11:08:58.085 INFO:tasks.workunit.client.0.smithi146.stdout: lockers: 2019-12-09T11:08:58.085 INFO:tasks.workunit.client.0.smithi146.stdout: client.4406 expiration=0.000000 addr=v1:172.21.15.146:0/2484086245 cookie= 2019-12-09T11:08:58.085 INFO:tasks.workunit.client.0.smithi146.stdout: client.4406 expiration=0.000000 addr=v1:172.21.15.146:0/2484086245 cookie=new cookie 2019-12-09T11:08:58.634 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ClsLock.TestCookie (3525 ms) 2019-12-09T11:08:58.635 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ClsLock.TestMultipleLocks 2019-12-09T11:09:01.981 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ClsLock.TestMultipleLocks (3346 ms) 2019-12-09T11:09:01.982 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ClsLock.TestLockDuration 2019-12-09T11:09:10.869 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ClsLock.TestLockDuration (8889 ms) 2019-12-09T11:09:10.870 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ClsLock.TestAssertLocked 2019-12-09T11:09:14.102 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ClsLock.TestAssertLocked (3231 ms) 2019-12-09T11:09:14.102 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ClsLock.TestSetCookie 2019-12-09T11:09:18.488 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ClsLock.TestSetCookie (4387 ms) 2019-12-09T11:09:18.488 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ClsLock.TestRenew 2019-12-09T11:09:40.945 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ClsLock.TestRenew (22458 ms) 2019-12-09T11:09:40.946 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2019-12-09T11:09:48.299 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7354 ms) 2019-12-09T11:09:48.299 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2019-12-09T11:09:57.012 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8712 ms) 2019-12-09T11:09:57.012 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2019-12-09T11:10:05.045 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8034 ms) 2019-12-09T11:10:05.046 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 11 tests from ClsLock (77697 ms total) 2019-12-09T11:10:05.046 INFO:tasks.workunit.client.0.smithi146.stdout: 2019-12-09T11:10:05.046 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment tear-down 2019-12-09T11:10:05.046 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] 11 tests from 1 test suite ran. (77697 ms total) 2019-12-09T11:10:05.047 INFO:tasks.workunit.client.0.smithi146.stdout:[ PASSED ] 11 tests. 2019-12-09T11:10:05.049 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-09T11:10:05.049 INFO:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-09T11:10:05.209 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2019-12-09T11:10:05.209 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2019-12-09T11:10:05.210 INFO:teuthology.orchestra.run.smithi146:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2019-12-09T11:10:05.269 INFO:tasks.workunit.client.0.smithi146.stdout:Running main() from gmock_main.cc 2019-12-09T11:10:05.270 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] Running 4 tests from 1 test suite. 2019-12-09T11:10:05.270 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment set-up. 2019-12-09T11:10:05.270 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 4 tests from cls_log 2019-12-09T11:10:05.270 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_log.test_log_add_same_time 2019-12-09T11:10:08.409 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_log.test_log_add_same_time (3140 ms) 2019-12-09T11:10:08.409 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_log.test_log_add_different_time 2019-12-09T11:10:11.870 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_log.test_log_add_different_time (3461 ms) 2019-12-09T11:10:11.870 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_log.trim_by_time 2019-12-09T11:10:17.058 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_log.trim_by_time (5188 ms) 2019-12-09T11:10:17.058 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_log.trim_by_marker 2019-12-09T11:10:21.596 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_log.trim_by_marker (4537 ms) 2019-12-09T11:10:21.596 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 4 tests from cls_log (16326 ms total) 2019-12-09T11:10:21.596 INFO:tasks.workunit.client.0.smithi146.stdout: 2019-12-09T11:10:21.596 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment tear-down 2019-12-09T11:10:21.596 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] 4 tests from 1 test suite ran. (16326 ms total) 2019-12-09T11:10:21.596 INFO:tasks.workunit.client.0.smithi146.stdout:[ PASSED ] 4 tests. 2019-12-09T11:10:21.597 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-09T11:10:21.597 INFO:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-09T11:10:21.665 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2019-12-09T11:10:21.665 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2019-12-09T11:10:21.665 INFO:teuthology.orchestra.run.smithi146:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2019-12-09T11:10:21.724 INFO:tasks.workunit.client.0.smithi146.stdout:Running main() from gmock_main.cc 2019-12-09T11:10:21.724 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] Running 5 tests from 1 test suite. 2019-12-09T11:10:21.725 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment set-up. 2019-12-09T11:10:21.725 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 5 tests from cls_rgw 2019-12-09T11:10:21.725 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.test_implicit 2019-12-09T11:10:25.224 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.test_implicit (3499 ms) 2019-12-09T11:10:25.224 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2019-12-09T11:10:28.568 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3344 ms) 2019-12-09T11:10:28.568 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.test_put_snap 2019-12-09T11:10:36.828 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T11:10:36.817+0000 38794700 -1 osd.2 pg_epoch: 107 pg[25.6( v 106'4 (0'0,106'4] local-lis/les=103/104 n=2 ec=103/103 lis/c=103/103 les/c/f=104/104/0 sis=103) [2,1] r=0 lpr=103 crt=105'3 lcod 105'3 mlcod 105'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2019-12-09T11:10:38.301 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.test_put_snap (9734 ms) 2019-12-09T11:10:38.302 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.test_explicit 2019-12-09T11:10:41.671 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.test_explicit (3369 ms) 2019-12-09T11:10:41.671 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.set 2019-12-09T11:10:45.035 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.set (3364 ms) 2019-12-09T11:10:45.035 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 5 tests from cls_rgw (23310 ms total) 2019-12-09T11:10:45.035 INFO:tasks.workunit.client.0.smithi146.stdout: 2019-12-09T11:10:45.035 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment tear-down 2019-12-09T11:10:45.036 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] 5 tests from 1 test suite ran. (23310 ms total) 2019-12-09T11:10:45.036 INFO:tasks.workunit.client.0.smithi146.stdout:[ PASSED ] 5 tests. 2019-12-09T11:10:45.037 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-09T11:10:45.037 INFO:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-09T11:10:45.105 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2019-12-09T11:10:45.106 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2019-12-09T11:10:45.106 INFO:teuthology.orchestra.run.smithi146:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2019-12-09T11:10:45.179 INFO:tasks.workunit.client.0.smithi146.stdout:Running main() from gmock_main.cc 2019-12-09T11:10:45.179 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] Running 13 tests from 1 test suite. 2019-12-09T11:10:45.180 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment set-up. 2019-12-09T11:10:45.180 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 13 tests from cls_rgw 2019-12-09T11:10:47.475 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.index_basic 2019-12-09T11:10:49.276 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.index_basic (1801 ms) 2019-12-09T11:10:49.276 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2019-12-09T11:10:51.015 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (1739 ms) 2019-12-09T11:10:51.015 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.index_remove_object 2019-12-09T11:10:52.907 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.index_remove_object (1892 ms) 2019-12-09T11:10:52.907 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.index_suggest 2019-12-09T11:11:19.182 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.index_suggest (26276 ms) 2019-12-09T11:11:19.182 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.index_list 2019-12-09T11:11:20.985 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.index_list (1802 ms) 2019-12-09T11:11:20.985 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.bi_list 2019-12-09T11:11:23.976 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.bi_list (2992 ms) 2019-12-09T11:11:23.976 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.gc_set 2019-12-09T11:11:24.466 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.gc_set (490 ms) 2019-12-09T11:11:24.466 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.gc_list 2019-12-09T11:11:24.992 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.gc_list (526 ms) 2019-12-09T11:11:24.993 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.gc_defer 2019-12-09T11:11:32.366 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.gc_defer (7374 ms) 2019-12-09T11:11:32.367 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.usage_basic 2019-12-09T11:11:39.917 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.usage_basic (7551 ms) 2019-12-09T11:11:39.917 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2019-12-09T11:11:39.965 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.usage_clear_no_obj (48 ms) 2019-12-09T11:11:39.965 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.usage_clear 2019-12-09T11:11:49.684 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.usage_clear (9719 ms) 2019-12-09T11:11:49.684 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] cls_rgw.bi_log_trim 2019-12-09T11:11:51.545 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] cls_rgw.bi_log_trim (1862 ms) 2019-12-09T11:11:52.366 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 13 tests from cls_rgw (64072 ms total) 2019-12-09T11:11:52.366 INFO:tasks.workunit.client.0.smithi146.stdout: 2019-12-09T11:11:52.366 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment tear-down 2019-12-09T11:11:52.366 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] 13 tests from 1 test suite ran. (67188 ms total) 2019-12-09T11:11:52.366 INFO:tasks.workunit.client.0.smithi146.stdout:[ PASSED ] 13 tests. 2019-12-09T11:11:52.368 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-09T11:11:52.369 INFO:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-09T11:11:52.486 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2019-12-09T11:11:52.487 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2019-12-09T11:11:52.487 INFO:teuthology.orchestra.run.smithi146:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2019-12-09T11:11:52.557 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] Running 6 tests from 1 test suite. 2019-12-09T11:11:52.558 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment set-up. 2019-12-09T11:11:54.473 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 6 tests from rgw_gc_log 2019-12-09T11:11:54.473 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2019-12-09T11:11:54.946 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] rgw_gc_log.init_existing_queue (473 ms) 2019-12-09T11:11:54.947 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2019-12-09T11:11:55.204 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] rgw_gc_log.init_existing_omap (256 ms) 2019-12-09T11:11:55.204 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2019-12-09T11:11:55.335 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (133 ms) 2019-12-09T11:11:55.336 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2019-12-09T11:11:55.377 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (42 ms) 2019-12-09T11:11:55.378 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2019-12-09T11:11:55.474 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] rgw_gc_log.defer1_after_init (96 ms) 2019-12-09T11:11:55.474 INFO:tasks.workunit.client.0.smithi146.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2019-12-09T11:11:55.530 INFO:tasks.workunit.client.0.smithi146.stdout:[ OK ] rgw_gc_log.defer2_before_init (56 ms) 2019-12-09T11:11:55.531 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] 6 tests from rgw_gc_log (1057 ms total) 2019-12-09T11:11:55.531 INFO:tasks.workunit.client.0.smithi146.stdout: 2019-12-09T11:11:55.531 INFO:tasks.workunit.client.0.smithi146.stdout:[----------] Global test environment tear-down 2019-12-09T11:11:56.720 INFO:tasks.workunit.client.0.smithi146.stdout:[==========] 6 tests from 1 test suite ran. (4162 ms total) 2019-12-09T11:11:56.720 INFO:tasks.workunit.client.0.smithi146.stdout:[ PASSED ] 6 tests. 2019-12-09T11:11:56.723 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-09T11:11:56.723 INFO:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-09T11:11:56.841 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh'] on client.0... 2019-12-09T11:11:56.841 INFO:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2019-12-09T11:11:57.096 DEBUG:teuthology.parallel:result is None 2019-12-09T11:11:57.097 INFO:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2019-12-09T11:11:57.157 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2019-12-09T11:11:57.158 INFO:teuthology.orchestra.run.smithi146:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-12-09T11:11:57.204 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2019-12-09T11:11:57.204 INFO:teuthology.run_tasks:Running task ragweed... 2019-12-09T11:11:57.219 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2019-12-09T11:11:57.219 INFO:tasks.ragweed:Downloading ragweed... 2019-12-09T11:11:57.219 INFO:tasks.ragweed:Using branch 'wip-ofriedma-dynamic-disable' for ragweed 2019-12-09T11:11:57.219 INFO:teuthology.orchestra.run.smithi146:> git clone -b wip-ofriedma-dynamic-disable git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-12-09T11:11:57.270 INFO:teuthology.orchestra.run.smithi146.stderr:fatal: Remote branch wip-ofriedma-dynamic-disable not found in upstream origin 2019-12-09T11:11:57.271 INFO:teuthology.orchestra.run.smithi146.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-12-09T11:11:57.271 DEBUG:teuthology.orchestra.run:got remote process result: 128 2019-12-09T11:11:57.271 INFO:teuthology.orchestra.run.smithi146:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-12-09T11:11:57.363 INFO:teuthology.orchestra.run.smithi146.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-12-09T11:11:57.469 INFO:tasks.ragweed:Creating rgw users... 2019-12-09T11:11:57.469 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2019-12-09T11:11:57.469 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key MUZEKYOJERZMRMTFIIQW --secret feVUjetEgVUjtGMr50T3HWvrbr/6wZaAwqikG6zRNvohOwTglkfkcg== --email sysuser.client.0+test@test.test --system true 2019-12-09T11:11:57.594 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.599+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.616 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.622+0000 7f5dbcc64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:11:57.616 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.622+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.624 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.629+0000 7f5dbcc64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:11:57.624 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.629+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.628 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.634+0000 7f5dbcc64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:11:57.628 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.634+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.634 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.640+0000 7f5dbcc64ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:11:57.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.767+0000 7f5dbcc64ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T11:11:57.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.767+0000 7f5dbcc64ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T11:11:57.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.767+0000 7f5dbcc64ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T11:11:57.762 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.767+0000 7f5dbcc64ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T11:11:57.762 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.767+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.772 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.778+0000 7f5dbcc64ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:11:57.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.778+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.787 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.792+0000 7f5dbcc64ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:11:57.787 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.792+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.795 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.801+0000 7f5dbcc64ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:11:57.795 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.801+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.815 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.821+0000 7f5dbcc64ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:11:57.815 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.821+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.820 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.826+0000 7f5dbcc64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:11:57.820 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.826+0000 7f5dbcc64ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T11:11:57.821 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.826+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.825 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.831+0000 7f5dbcc64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:11:57.825 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.831+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.833 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.839+0000 7f5dbcc64ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:11:57.833 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.839+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.856+0000 7f5dbcc64ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:11:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.856+0000 7f5dbcc64ec0 20 zonegroup default 2019-12-09T11:11:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.856+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.861+0000 7f5dbcc64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:11:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.861+0000 7f5dbcc64ec0 10 Cannot find current period zone using local zone 2019-12-09T11:11:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.861+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.866+0000 7f5dbcc64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:11:57.861 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.866+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.874+0000 7f5dbcc64ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:11:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.874+0000 7f5dbcc64ec0 20 rados->read ofs=0 len=0 2019-12-09T11:11:57.878 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.884+0000 7f5dbcc64ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:11:57.878 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.884+0000 7f5dbcc64ec0 20 zone default found 2019-12-09T11:11:57.878 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.884+0000 7f5dbcc64ec0 20 started sync module instance, tier type = 2019-12-09T11:11:57.878 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:57.884+0000 7f5dbcc64ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T11:11:58.215 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:58.220+0000 7f5da9e8e700 0 -- 172.21.15.146:0/2376003631 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x55cec40317a0 msgr2=0x55cec4033c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T11:11:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:58.293+0000 7f5dbcc64ec0 20 add_watcher() i=0 2019-12-09T11:11:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:58.293+0000 7f5dbcc64ec0 20 add_watcher() i=1 2019-12-09T11:11:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:58.293+0000 7f5dbcc64ec0 20 add_watcher() i=2 2019-12-09T11:11:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:58.293+0000 7f5dbcc64ec0 20 add_watcher() i=3 2019-12-09T11:11:58.289 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:58.293+0000 7f5dbcc64ec0 20 add_watcher() i=4 2019-12-09T11:11:58.289 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:58.293+0000 7f5dbcc64ec0 20 add_watcher() i=5 2019-12-09T11:11:58.289 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:58.293+0000 7f5dbcc64ec0 20 add_watcher() i=6 2019-12-09T11:11:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:58.322+0000 7f5dbcc64ec0 20 add_watcher() i=7 2019-12-09T11:11:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:58.322+0000 7f5dbcc64ec0 2 all 8 watchers are set, enabling cache 2019-12-09T11:11:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:58.322+0000 7f5d7a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T11:11:58.330 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:58.335+0000 7f5da968d700 0 -- 172.21.15.146:0/2894372408 >> v1:172.21.15.194:6789/0 conn(0x55cec4058c90 legacy=0x55cec405b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T11:11:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.799+0000 7f5cf0ff9700 20 reqs_thread_entry: start 2019-12-09T11:11:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.799+0000 7f5cea7fc700 20 reqs_thread_entry: start 2019-12-09T11:11:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.800+0000 7f5dbcc64ec0 20 init_complete bucket index max shards: 0 2019-12-09T11:11:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.800+0000 7f5ce8ff9700 20 reqs_thread_entry: start 2019-12-09T11:11:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.800+0000 7f5dbcc64ec0 20 get_system_obj_state: rctx=0x7ffd2c73f678 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x55cec40cee30 s->prefetch_data=0 2019-12-09T11:11:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.800+0000 7f5dbcc64ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-12-09T11:11:59.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.820+0000 7f5dbcc64ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2019-12-09T11:11:59.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.820+0000 7f5dbcc64ec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-09T11:11:59.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.820+0000 7f5dbcc64ec0 20 get_system_obj_state: rctx=0x7ffd2c73f688 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x55cec40d0bc0 s->prefetch_data=0 2019-12-09T11:11:59.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.820+0000 7f5dbcc64ec0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2019-12-09T11:11:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.831+0000 7f5dbcc64ec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2019-12-09T11:11:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.831+0000 7f5dbcc64ec0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-12-09T11:11:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.831+0000 7f5dbcc64ec0 20 get_system_obj_state: rctx=0x7ffd2c73f688 obj=default.rgw.meta:users.keys:MUZEKYOJERZMRMTFIIQW state=0x55cec40d0bc0 s->prefetch_data=0 2019-12-09T11:11:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.831+0000 7f5dbcc64ec0 10 cache get: name=default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW : miss 2019-12-09T11:11:59.837 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.842+0000 7f5dbcc64ec0 10 cache put: name=default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW info.flags=0x0 2019-12-09T11:11:59.837 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.842+0000 7f5dbcc64ec0 10 adding default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW to cache LRU end 2019-12-09T11:11:59.837 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.842+0000 7f5dbcc64ec0 20 get_system_obj_state: rctx=0x7ffd2c73f298 obj=default.rgw.meta:users.keys:MUZEKYOJERZMRMTFIIQW state=0x55cec40d0bc0 s->prefetch_data=0 2019-12-09T11:11:59.838 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.842+0000 7f5dbcc64ec0 10 cache get: name=default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW : type miss (requested=0x6, cached=0x0) 2019-12-09T11:11:59.843 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.847+0000 7f5dbcc64ec0 10 cache put: name=default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW info.flags=0x0 2019-12-09T11:11:59.843 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.847+0000 7f5dbcc64ec0 10 moving default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW to cache LRU end 2019-12-09T11:11:59.843 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.847+0000 7f5dbcc64ec0 20 get_system_obj_state: rctx=0x7ffd2c73f418 obj=default.rgw.meta:users.keys:MUZEKYOJERZMRMTFIIQW state=0x55cec40d0bc0 s->prefetch_data=0 2019-12-09T11:11:59.843 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.847+0000 7f5dbcc64ec0 10 cache get: name=default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW : type miss (requested=0x6, cached=0x0) 2019-12-09T11:11:59.851 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.855+0000 7f5dbcc64ec0 10 cache put: name=default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW info.flags=0x0 2019-12-09T11:11:59.851 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.855+0000 7f5dbcc64ec0 10 moving default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW to cache LRU end 2019-12-09T11:11:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.927+0000 7f5dbcc64ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-12-09T11:11:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.927+0000 7f5dbcc64ec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-09T11:11:59.923 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.927+0000 7f5dbcc64ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2019-12-09T11:11:59.986 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.991+0000 7f5d8affd700 10 RGWWatcher::handle_notify() notify_id 549755813888 cookie 94346540195472 notifier 4632 bl.length()=637 2019-12-09T11:11:59.986 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.991+0000 7f5d8affd700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-12-09T11:11:59.986 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:11:59.991+0000 7f5d8affd700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-09T11:12:00.396 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:00.400+0000 7f5dbcc64ec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-12-09T11:12:00.396 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:00.400+0000 7f5dbcc64ec0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-12-09T11:12:00.396 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:00.400+0000 7f5dbcc64ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2019-12-09T11:12:00.435 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:00.440+0000 7f5d8affd700 10 RGWWatcher::handle_notify() notify_id 549755813888 cookie 94346540213712 notifier 4632 bl.length()=202 2019-12-09T11:12:00.435 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:00.440+0000 7f5d8affd700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-12-09T11:12:00.435 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:00.440+0000 7f5d8affd700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-12-09T11:12:00.536 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:00.541+0000 7f5dbcc64ec0 10 cache put: name=default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW info.flags=0x7 2019-12-09T11:12:00.536 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:00.541+0000 7f5dbcc64ec0 10 moving default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW to cache LRU end 2019-12-09T11:12:00.536 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:00.541+0000 7f5dbcc64ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=190 2019-12-09T11:12:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:00.610+0000 7f5d8affd700 10 RGWWatcher::handle_notify() notify_id 549755813888 cookie 94346540232544 notifier 4632 bl.length()=190 2019-12-09T11:12:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:00.610+0000 7f5d8affd700 10 cache put: name=default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW info.flags=0x7 2019-12-09T11:12:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:00.610+0000 7f5d8affd700 10 moving default.rgw.meta+users.keys+MUZEKYOJERZMRMTFIIQW to cache LRU end 2019-12-09T11:12:01.021 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2019-12-09T11:12:01.021 INFO:teuthology.orchestra.run.smithi146.stdout: "user_id": "sysuser.client.0", 2019-12-09T11:12:01.021 INFO:teuthology.orchestra.run.smithi146.stdout: "display_name": "Mr. sysuser.client.0", 2019-12-09T11:12:01.022 INFO:teuthology.orchestra.run.smithi146.stdout: "email": "sysuser.client.0+test@test.test", 2019-12-09T11:12:01.022 INFO:teuthology.orchestra.run.smithi146.stdout: "suspended": 0, 2019-12-09T11:12:01.022 INFO:teuthology.orchestra.run.smithi146.stdout: "max_buckets": 1000, 2019-12-09T11:12:01.022 INFO:teuthology.orchestra.run.smithi146.stdout: "subusers": [], 2019-12-09T11:12:01.022 INFO:teuthology.orchestra.run.smithi146.stdout: "keys": [ 2019-12-09T11:12:01.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2019-12-09T11:12:01.022 INFO:teuthology.orchestra.run.smithi146.stdout: "user": "sysuser.client.0", 2019-12-09T11:12:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "access_key": "MUZEKYOJERZMRMTFIIQW", 2019-12-09T11:12:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "secret_key": "feVUjetEgVUjtGMr50T3HWvrbr/6wZaAwqikG6zRNvohOwTglkfkcg==" 2019-12-09T11:12:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: } 2019-12-09T11:12:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2019-12-09T11:12:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "swift_keys": [], 2019-12-09T11:12:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": [], 2019-12-09T11:12:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "op_mask": "read, write, delete", 2019-12-09T11:12:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "system": "true", 2019-12-09T11:12:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "default_placement": "", 2019-12-09T11:12:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "default_storage_class": "", 2019-12-09T11:12:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "placement_tags": [], 2019-12-09T11:12:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "bucket_quota": { 2019-12-09T11:12:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T11:12:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T11:12:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T11:12:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T11:12:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T11:12:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T11:12:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "user_quota": { 2019-12-09T11:12:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T11:12:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T11:12:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T11:12:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T11:12:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T11:12:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T11:12:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "temp_url_keys": [], 2019-12-09T11:12:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "rgw", 2019-12-09T11:12:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: "mfa_ids": [] 2019-12-09T11:12:01.027 INFO:teuthology.orchestra.run.smithi146.stdout:} 2019-12-09T11:12:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:01.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.112+0000 7f5dbcc64ec0 20 remove_watcher() i=0 2019-12-09T11:12:01.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.112+0000 7f5dbcc64ec0 2 removed watcher, disabling cache 2019-12-09T11:12:01.165 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.170+0000 7f5dbcc64ec0 20 remove_watcher() i=1 2019-12-09T11:12:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.221+0000 7f5dbcc64ec0 20 remove_watcher() i=2 2019-12-09T11:12:01.288 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.293+0000 7f5dbcc64ec0 20 remove_watcher() i=3 2019-12-09T11:12:01.332 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.337+0000 7f5dbcc64ec0 20 remove_watcher() i=4 2019-12-09T11:12:01.370 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.375+0000 7f5dbcc64ec0 20 remove_watcher() i=5 2019-12-09T11:12:01.408 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.413+0000 7f5dbcc64ec0 20 remove_watcher() i=6 2019-12-09T11:12:01.448 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.452+0000 7f5dbcc64ec0 20 remove_watcher() i=7 2019-12-09T11:12:01.456 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2019-12-09T11:12:01.457 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key RJHWBNWKKMXDYLDLYTIY --secret mhIFJx0cX5KwfVhUbSEvgH+/p8jo/VPJvPbZgVt9o3HAxNfR/BJgHA== --email ragweed.client.0+test@test.test --system false 2019-12-09T11:12:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.590+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.612 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.617+0000 7fefaed08ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:12:01.613 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.617+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.621 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.626+0000 7fefaed08ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:12:01.621 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.626+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.626 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.631+0000 7fefaed08ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:12:01.626 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.631+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.632 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.637+0000 7fefaed08ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:12:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.863+0000 7fefaed08ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T11:12:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.864+0000 7fefaed08ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T11:12:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.864+0000 7fefaed08ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T11:12:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.864+0000 7fefaed08ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T11:12:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.864+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.874 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.878+0000 7fefaed08ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:12:01.874 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.878+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.891+0000 7fefaed08ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:12:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.891+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.903+0000 7fefaed08ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:12:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.903+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.915 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.919+0000 7fefaed08ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:12:01.915 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.920+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.925+0000 7fefaed08ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:12:01.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.925+0000 7fefaed08ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T11:12:01.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.925+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.926 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.931+0000 7fefaed08ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:12:01.926 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.931+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.938 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.942+0000 7fefaed08ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:12:01.938 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.942+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.957 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.961+0000 7fefaed08ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:12:01.957 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.961+0000 7fefaed08ec0 20 zonegroup default 2019-12-09T11:12:01.957 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.961+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.963 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.968+0000 7fefaed08ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:12:01.964 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.968+0000 7fefaed08ec0 10 Cannot find current period zone using local zone 2019-12-09T11:12:01.964 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.968+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.974+0000 7fefaed08ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:12:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.974+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.982+0000 7fefaed08ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:12:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.982+0000 7fefaed08ec0 20 rados->read ofs=0 len=0 2019-12-09T11:12:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.991+0000 7fefaed08ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:12:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.991+0000 7fefaed08ec0 20 zone default found 2019-12-09T11:12:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.991+0000 7fefaed08ec0 20 started sync module instance, tier type = 2019-12-09T11:12:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:01.991+0000 7fefaed08ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T11:12:02.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:02.399+0000 7fefaed08ec0 20 add_watcher() i=0 2019-12-09T11:12:02.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:02.399+0000 7fefaed08ec0 20 add_watcher() i=1 2019-12-09T11:12:02.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:02.399+0000 7fefaed08ec0 20 add_watcher() i=2 2019-12-09T11:12:02.395 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:02.399+0000 7fefaed08ec0 20 add_watcher() i=3 2019-12-09T11:12:02.395 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:02.399+0000 7fefaed08ec0 20 add_watcher() i=4 2019-12-09T11:12:02.395 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:02.399+0000 7fefaed08ec0 20 add_watcher() i=5 2019-12-09T11:12:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:02.417+0000 7fefaed08ec0 20 add_watcher() i=6 2019-12-09T11:12:02.433 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:02.438+0000 7fefaed08ec0 20 add_watcher() i=7 2019-12-09T11:12:02.433 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:02.438+0000 7fefaed08ec0 2 all 8 watchers are set, enabling cache 2019-12-09T11:12:02.434 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:02.438+0000 7feeeffff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T11:12:02.438 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:02.443+0000 7fef9c733700 0 -- 172.21.15.146:0/2727666736 >> v1:172.21.15.146:6789/0 conn(0x557490470710 legacy=0x557490473d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T11:12:02.495 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:02.499+0000 7fef9b731700 0 -- 172.21.15.146:0/411467863 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x557490488f80 msgr2=0x55749048b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T11:12:04.120 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.124+0000 7feeda7fc700 20 reqs_thread_entry: start 2019-12-09T11:12:04.120 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.124+0000 7feed3fff700 20 reqs_thread_entry: start 2019-12-09T11:12:04.120 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.125+0000 7fefaed08ec0 20 init_complete bucket index max shards: 0 2019-12-09T11:12:04.121 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.125+0000 7feed27fc700 20 reqs_thread_entry: start 2019-12-09T11:12:04.121 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.125+0000 7fefaed08ec0 20 get_system_obj_state: rctx=0x7fff4ed0dfb8 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x5574904f58b0 s->prefetch_data=0 2019-12-09T11:12:04.121 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.125+0000 7fefaed08ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-12-09T11:12:04.126 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.131+0000 7fefaed08ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2019-12-09T11:12:04.126 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.131+0000 7fefaed08ec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-09T11:12:04.126 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.131+0000 7fefaed08ec0 20 get_system_obj_state: rctx=0x7fff4ed0dfc8 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x5574904f7640 s->prefetch_data=0 2019-12-09T11:12:04.126 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.131+0000 7fefaed08ec0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2019-12-09T11:12:04.132 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.136+0000 7fefaed08ec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2019-12-09T11:12:04.132 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.136+0000 7fefaed08ec0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-12-09T11:12:04.132 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.136+0000 7fefaed08ec0 20 get_system_obj_state: rctx=0x7fff4ed0dfc8 obj=default.rgw.meta:users.keys:RJHWBNWKKMXDYLDLYTIY state=0x5574904f7640 s->prefetch_data=0 2019-12-09T11:12:04.132 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.136+0000 7fefaed08ec0 10 cache get: name=default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY : miss 2019-12-09T11:12:04.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.142+0000 7fefaed08ec0 10 cache put: name=default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY info.flags=0x0 2019-12-09T11:12:04.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.142+0000 7fefaed08ec0 10 adding default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY to cache LRU end 2019-12-09T11:12:04.138 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.142+0000 7fefaed08ec0 20 get_system_obj_state: rctx=0x7fff4ed0dbd8 obj=default.rgw.meta:users.keys:RJHWBNWKKMXDYLDLYTIY state=0x5574904f7640 s->prefetch_data=0 2019-12-09T11:12:04.138 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.142+0000 7fefaed08ec0 10 cache get: name=default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY : type miss (requested=0x6, cached=0x0) 2019-12-09T11:12:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.150+0000 7fefaed08ec0 10 cache put: name=default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY info.flags=0x0 2019-12-09T11:12:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.150+0000 7fefaed08ec0 10 moving default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY to cache LRU end 2019-12-09T11:12:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.151+0000 7fefaed08ec0 20 get_system_obj_state: rctx=0x7fff4ed0dd58 obj=default.rgw.meta:users.keys:RJHWBNWKKMXDYLDLYTIY state=0x5574904f7640 s->prefetch_data=0 2019-12-09T11:12:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.151+0000 7fefaed08ec0 10 cache get: name=default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY : type miss (requested=0x6, cached=0x0) 2019-12-09T11:12:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.155+0000 7fefaed08ec0 10 cache put: name=default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY info.flags=0x0 2019-12-09T11:12:04.151 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.155+0000 7fefaed08ec0 10 moving default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY to cache LRU end 2019-12-09T11:12:04.208 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.212+0000 7fefaed08ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-12-09T11:12:04.208 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.212+0000 7fefaed08ec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-09T11:12:04.208 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.212+0000 7fefaed08ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2019-12-09T11:12:04.215 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.220+0000 7fef817fa700 10 RGWWatcher::handle_notify() notify_id 549755813889 cookie 93959125072192 notifier 4487 bl.length()=637 2019-12-09T11:12:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.220+0000 7fef817fa700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-12-09T11:12:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.220+0000 7fef817fa700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-09T11:12:04.431 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.436+0000 7fefaed08ec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-12-09T11:12:04.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.436+0000 7fefaed08ec0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-12-09T11:12:04.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.436+0000 7fefaed08ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2019-12-09T11:12:04.440 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.445+0000 7fef817fa700 10 RGWWatcher::handle_notify() notify_id 549755813889 cookie 93959125054528 notifier 4487 bl.length()=202 2019-12-09T11:12:04.440 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.445+0000 7fef817fa700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-12-09T11:12:04.440 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.445+0000 7fef817fa700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-12-09T11:12:04.639 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.644+0000 7fefaed08ec0 10 cache put: name=default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY info.flags=0x7 2019-12-09T11:12:04.640 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.644+0000 7fefaed08ec0 10 moving default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY to cache LRU end 2019-12-09T11:12:04.640 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.644+0000 7fefaed08ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=190 2019-12-09T11:12:04.702 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.706+0000 7fef817fa700 10 RGWWatcher::handle_notify() notify_id 549755813888 cookie 93959125057472 notifier 4487 bl.length()=190 2019-12-09T11:12:04.702 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.706+0000 7fef817fa700 10 cache put: name=default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY info.flags=0x7 2019-12-09T11:12:04.702 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:04.706+0000 7fef817fa700 10 moving default.rgw.meta+users.keys+RJHWBNWKKMXDYLDLYTIY to cache LRU end 2019-12-09T11:12:05.001 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2019-12-09T11:12:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: "user_id": "ragweed.client.0", 2019-12-09T11:12:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: "display_name": "Mr. ragweed.client.0", 2019-12-09T11:12:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: "email": "ragweed.client.0+test@test.test", 2019-12-09T11:12:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: "suspended": 0, 2019-12-09T11:12:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: "max_buckets": 1000, 2019-12-09T11:12:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: "subusers": [], 2019-12-09T11:12:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: "keys": [ 2019-12-09T11:12:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: { 2019-12-09T11:12:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: "user": "ragweed.client.0", 2019-12-09T11:12:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "access_key": "RJHWBNWKKMXDYLDLYTIY", 2019-12-09T11:12:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "secret_key": "mhIFJx0cX5KwfVhUbSEvgH+/p8jo/VPJvPbZgVt9o3HAxNfR/BJgHA==" 2019-12-09T11:12:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: } 2019-12-09T11:12:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2019-12-09T11:12:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "swift_keys": [], 2019-12-09T11:12:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": [], 2019-12-09T11:12:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: "op_mask": "read, write, delete", 2019-12-09T11:12:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "system": "true", 2019-12-09T11:12:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "default_placement": "", 2019-12-09T11:12:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "default_storage_class": "", 2019-12-09T11:12:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "placement_tags": [], 2019-12-09T11:12:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "bucket_quota": { 2019-12-09T11:12:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T11:12:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T11:12:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T11:12:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T11:12:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T11:12:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T11:12:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "user_quota": { 2019-12-09T11:12:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T11:12:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T11:12:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T11:12:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T11:12:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T11:12:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T11:12:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: "temp_url_keys": [], 2019-12-09T11:12:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "rgw", 2019-12-09T11:12:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: "mfa_ids": [] 2019-12-09T11:12:05.006 INFO:teuthology.orchestra.run.smithi146.stdout:} 2019-12-09T11:12:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:05.068 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:05.072+0000 7fefaed08ec0 20 remove_watcher() i=0 2019-12-09T11:12:05.068 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:05.072+0000 7fefaed08ec0 2 removed watcher, disabling cache 2019-12-09T11:12:05.128 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:05.133+0000 7fefaed08ec0 20 remove_watcher() i=1 2019-12-09T11:12:05.163 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:05.168+0000 7fefaed08ec0 20 remove_watcher() i=2 2019-12-09T11:12:05.229 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:05.234+0000 7fefaed08ec0 20 remove_watcher() i=3 2019-12-09T11:12:05.278 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:05.283+0000 7fefaed08ec0 20 remove_watcher() i=4 2019-12-09T11:12:05.334 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:05.339+0000 7fefaed08ec0 20 remove_watcher() i=5 2019-12-09T11:12:05.405 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:05.410+0000 7fefaed08ec0 20 remove_watcher() i=6 2019-12-09T11:12:05.445 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:12:05.450+0000 7fefaed08ec0 20 remove_watcher() i=7 2019-12-09T11:12:05.453 INFO:tasks.ragweed:Configuring ragweed... 2019-12-09T11:12:05.453 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2019-12-09T11:12:11.679 INFO:teuthology.orchestra.run.smithi146.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-12-09T11:12:11.829 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T11:12:11.869 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T11:12:11.870 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T11:12:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T11:12:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T11:12:11.871 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T11:12:12.544 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T11:12:12.909 INFO:teuthology.orchestra.run.smithi146.stdout:Package python2-pip-8.1.2-10.el7.noarch already installed and latest version 2019-12-09T11:12:13.842 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T11:12:13.842 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:12:13.843 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package libevent-devel.x86_64 0:2.0.21-4.el7 will be installed 2019-12-09T11:12:13.845 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 will be installed 2019-12-09T11:12:13.847 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: xz-devel for package: libxml2-devel-2.9.1-6.el7_2.3.x86_64 2019-12-09T11:12:13.881 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package libxslt-devel.x86_64 0:1.1.28-5.el7 will be installed 2019-12-09T11:12:13.882 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libgcrypt-devel for package: libxslt-devel-1.1.28-5.el7.x86_64 2019-12-09T11:12:13.884 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-12-09T11:12:13.885 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:12:13.885 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package libgcrypt-devel.x86_64 0:1.5.3-14.el7 will be installed 2019-12-09T11:12:13.887 INFO:teuthology.orchestra.run.smithi146.stdout:--> Processing Dependency: libgpg-error-devel for package: libgcrypt-devel-1.5.3-14.el7.x86_64 2019-12-09T11:12:13.890 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package xz-devel.x86_64 0:5.2.2-1.el7 will be installed 2019-12-09T11:12:13.890 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T11:12:13.891 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package libgpg-error-devel.x86_64 0:1.12-3.el7 will be installed 2019-12-09T11:12:14.376 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T11:12:14.653 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:14.653 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T11:12:14.654 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:14.654 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:12:14.655 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2019-12-09T11:12:14.655 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:12:14.655 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T11:12:14.655 INFO:teuthology.orchestra.run.smithi146.stdout: libevent-devel x86_64 2.0.21-4.el7 base 85 k 2019-12-09T11:12:14.655 INFO:teuthology.orchestra.run.smithi146.stdout: libxml2-devel x86_64 2.9.1-6.el7_2.3 base 1.0 M 2019-12-09T11:12:14.655 INFO:teuthology.orchestra.run.smithi146.stdout: libxslt-devel x86_64 1.1.28-5.el7 base 309 k 2019-12-09T11:12:14.656 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.7-18.el7 base 50 k 2019-12-09T11:12:14.656 INFO:teuthology.orchestra.run.smithi146.stdout:Installing for dependencies: 2019-12-09T11:12:14.656 INFO:teuthology.orchestra.run.smithi146.stdout: libgcrypt-devel x86_64 1.5.3-14.el7 base 129 k 2019-12-09T11:12:14.656 INFO:teuthology.orchestra.run.smithi146.stdout: libgpg-error-devel x86_64 1.12-3.el7 base 16 k 2019-12-09T11:12:14.656 INFO:teuthology.orchestra.run.smithi146.stdout: xz-devel x86_64 5.2.2-1.el7 base 46 k 2019-12-09T11:12:14.656 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:14.656 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T11:12:14.657 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T11:12:14.657 INFO:teuthology.orchestra.run.smithi146.stdout:Install 4 Packages (+3 Dependent packages) 2019-12-09T11:12:14.657 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:14.657 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 1.7 M 2019-12-09T11:12:14.658 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 12 M 2019-12-09T11:12:14.658 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T11:12:14.989 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2019-12-09T11:12:14.989 INFO:teuthology.orchestra.run.smithi146.stdout:Total 5.0 MB/s | 1.7 MB 00:00 2019-12-09T11:12:15.002 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T11:12:15.021 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T11:12:15.071 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T11:12:15.071 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T11:12:15.709 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgpg-error-devel-1.12-3.el7.x86_64 1/7 2019-12-09T11:12:16.020 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgcrypt-devel-1.5.3-14.el7.x86_64 2/7 2019-12-09T11:12:16.303 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-12-09T11:12:16.825 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xz-devel-5.2.2-1.el7.x86_64 4/7 2019-12-09T11:12:17.538 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libxml2-devel-2.9.1-6.el7_2.3.x86_64 5/7 2019-12-09T11:12:17.902 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libxslt-devel-1.1.28-5.el7.x86_64 6/7 2019-12-09T11:12:18.171 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libevent-devel-2.0.21-4.el7.x86_64 7/7 2019-12-09T11:12:18.295 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xz-devel-5.2.2-1.el7.x86_64 1/7 2019-12-09T11:12:18.402 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libxml2-devel-2.9.1-6.el7_2.3.x86_64 2/7 2019-12-09T11:12:18.494 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-12-09T11:12:18.611 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libxslt-devel-1.1.28-5.el7.x86_64 4/7 2019-12-09T11:12:18.746 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgpg-error-devel-1.12-3.el7.x86_64 5/7 2019-12-09T11:12:18.854 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libevent-devel-2.0.21-4.el7.x86_64 6/7 2019-12-09T11:12:19.364 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgcrypt-devel-1.5.3-14.el7.x86_64 7/7 2019-12-09T11:12:19.364 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:19.365 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T11:12:19.365 INFO:teuthology.orchestra.run.smithi146.stdout: libevent-devel.x86_64 0:2.0.21-4.el7 libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 2019-12-09T11:12:19.365 INFO:teuthology.orchestra.run.smithi146.stdout: libxslt-devel.x86_64 0:1.1.28-5.el7 zlib-devel.x86_64 0:1.2.7-18.el7 2019-12-09T11:12:19.365 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:19.366 INFO:teuthology.orchestra.run.smithi146.stdout:Dependency Installed: 2019-12-09T11:12:19.366 INFO:teuthology.orchestra.run.smithi146.stdout: libgcrypt-devel.x86_64 0:1.5.3-14.el7 libgpg-error-devel.x86_64 0:1.12-3.el7 2019-12-09T11:12:19.366 INFO:teuthology.orchestra.run.smithi146.stdout: xz-devel.x86_64 0:5.2.2-1.el7 2019-12-09T11:12:19.366 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:19.367 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T11:12:19.574 INFO:teuthology.orchestra.run.smithi146.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2019-12-09T11:12:21.020 INFO:teuthology.orchestra.run.smithi146.stdout:Installing setuptools, pip, wheel...done. 2019-12-09T11:12:21.516 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting pip 2019-12-09T11:12:21.605 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl (1.4MB) 2019-12-09T11:12:21.817 INFO:teuthology.orchestra.run.smithi146.stdout:Installing collected packages: pip 2019-12-09T11:12:21.817 INFO:teuthology.orchestra.run.smithi146.stdout: Found existing installation: pip 9.0.1 2019-12-09T11:12:21.878 INFO:teuthology.orchestra.run.smithi146.stdout: Uninstalling pip-9.0.1: 2019-12-09T11:12:21.922 INFO:teuthology.orchestra.run.smithi146.stdout: Successfully uninstalled pip-9.0.1 2019-12-09T11:12:22.505 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully installed pip-19.3.1 2019-12-09T11:12:23.240 INFO:teuthology.orchestra.run.smithi146.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T11:12:23.296 INFO:teuthology.orchestra.run.smithi146.stdout:Requirement already satisfied: six in /usr/lib/python2.7/site-packages (1.9.0) 2019-12-09T11:12:24.155 INFO:teuthology.orchestra.run.smithi146.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T11:12:24.371 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting nose 2019-12-09T11:12:24.414 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl (154kB) 2019-12-09T11:12:24.560 INFO:teuthology.orchestra.run.smithi146.stdout:Installing collected packages: nose 2019-12-09T11:12:24.635 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully installed nose-1.3.7 2019-12-09T11:12:25.156 INFO:teuthology.orchestra.run.smithi146.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T11:12:25.685 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting setuptools==32.3.1 2019-12-09T11:12:25.741 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (479kB) 2019-12-09T11:12:25.927 INFO:teuthology.orchestra.run.smithi146.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-12-09T11:12:25.927 INFO:teuthology.orchestra.run.smithi146.stdout:Installing collected packages: setuptools 2019-12-09T11:12:25.928 INFO:teuthology.orchestra.run.smithi146.stdout: Found existing installation: setuptools 28.8.0 2019-12-09T11:12:25.951 INFO:teuthology.orchestra.run.smithi146.stdout: Uninstalling setuptools-28.8.0: 2019-12-09T11:12:25.967 INFO:teuthology.orchestra.run.smithi146.stdout: Successfully uninstalled setuptools-28.8.0 2019-12-09T11:12:26.156 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully installed setuptools-32.3.1 2019-12-09T11:12:26.764 INFO:teuthology.orchestra.run.smithi146.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T11:12:27.134 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting PyYAML 2019-12-09T11:12:27.176 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/8d/c9/e5be955a117a1ac548cdd31e37e8fd7b02ce987f9655f5c7563c656d5dcb/PyYAML-5.2.tar.gz (265kB) 2019-12-09T11:12:27.891 INFO:teuthology.orchestra.run.smithi146.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python2.7/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2019-12-09T11:12:28.083 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting boto!=2.46.0,>=2.6.0 2019-12-09T11:12:28.093 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB) 2019-12-09T11:12:28.428 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting bunch>=1.0.0 2019-12-09T11:12:28.439 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz 2019-12-09T11:12:29.381 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting gevent>=1.0 2019-12-09T11:12:29.397 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl (5.0MB) 2019-12-09T11:12:29.819 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting httplib2 2019-12-09T11:12:29.832 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/ce/2e/87461bfbb7e561203b759b3f7f639e2144226604372830d00a8279960ae1/httplib2-0.14.0.tar.gz (219kB) 2019-12-09T11:12:31.144 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting lxml 2019-12-09T11:12:31.154 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl (5.7MB) 2019-12-09T11:12:31.589 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-12-09T11:12:31.602 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T11:12:31.678 INFO:teuthology.orchestra.run.smithi146.stdout:Building wheels for collected packages: PyYAML, bunch, httplib2 2019-12-09T11:12:31.678 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for PyYAML (setup.py): started 2019-12-09T11:12:32.376 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2019-12-09T11:12:32.377 INFO:teuthology.orchestra.run.smithi146.stdout: Created wheel for PyYAML: filename=PyYAML-5.2-cp27-cp27mu-linux_x86_64.whl size=46299 sha256=6240d88bb5c3758f78404beb2cf9abc07f42379cca13f84264c3eb3af28fc752 2019-12-09T11:12:32.378 INFO:teuthology.orchestra.run.smithi146.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/54/b7/c7/2ada654ee54483c9329871665aaf4a6056c3ce36f29cf66e67 2019-12-09T11:12:32.408 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for bunch (setup.py): started 2019-12-09T11:12:32.791 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for bunch (setup.py): finished with status 'done' 2019-12-09T11:12:32.792 INFO:teuthology.orchestra.run.smithi146.stdout: Created wheel for bunch: filename=bunch-1.0.1-cp27-none-any.whl size=8347 sha256=fca0de67314ca943137e6e24138549e97bedae92c4ec124f09beeccd0d5cec69 2019-12-09T11:12:32.792 INFO:teuthology.orchestra.run.smithi146.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c 2019-12-09T11:12:32.798 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for httplib2 (setup.py): started 2019-12-09T11:12:33.160 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for httplib2 (setup.py): finished with status 'done' 2019-12-09T11:12:33.161 INFO:teuthology.orchestra.run.smithi146.stdout: Created wheel for httplib2: filename=httplib2-0.14.0-cp27-none-any.whl size=96742 sha256=513da7274070bbe13c9f2b25de929900e0ff0b7570ff221b97207b3241abe50c 2019-12-09T11:12:33.161 INFO:teuthology.orchestra.run.smithi146.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488 2019-12-09T11:12:33.168 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully built PyYAML bunch httplib2 2019-12-09T11:12:33.336 INFO:teuthology.orchestra.run.smithi146.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-12-09T11:12:33.337 INFO:teuthology.orchestra.run.smithi146.stdout:Installing collected packages: PyYAML, boto, bunch, greenlet, gevent, httplib2, lxml 2019-12-09T11:12:33.337 INFO:teuthology.orchestra.run.smithi146.stdout: Found existing installation: PyYAML 3.10 2019-12-09T11:12:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: Not uninstalling pyyaml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-12-09T11:12:33.338 INFO:teuthology.orchestra.run.smithi146.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2019-12-09T11:12:34.465 INFO:teuthology.orchestra.run.smithi146.stdout: Found existing installation: lxml 3.2.1 2019-12-09T11:12:34.467 INFO:teuthology.orchestra.run.smithi146.stdout: Not uninstalling lxml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-12-09T11:12:34.472 INFO:teuthology.orchestra.run.smithi146.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2019-12-09T11:12:34.568 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully installed PyYAML-5.2 boto-2.49.0 bunch-1.0.1 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 lxml-4.4.2 2019-12-09T11:12:34.987 INFO:teuthology.orchestra.run.smithi146.stdout:running develop 2019-12-09T11:12:35.057 INFO:teuthology.orchestra.run.smithi146.stdout:running egg_info 2019-12-09T11:12:35.057 INFO:teuthology.orchestra.run.smithi146.stdout:creating ragweed.egg-info 2019-12-09T11:12:35.057 INFO:teuthology.orchestra.run.smithi146.stdout:writing requirements to ragweed.egg-info/requires.txt 2019-12-09T11:12:35.057 INFO:teuthology.orchestra.run.smithi146.stdout:writing ragweed.egg-info/PKG-INFO 2019-12-09T11:12:35.058 INFO:teuthology.orchestra.run.smithi146.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2019-12-09T11:12:35.058 INFO:teuthology.orchestra.run.smithi146.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2019-12-09T11:12:35.058 INFO:teuthology.orchestra.run.smithi146.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-12-09T11:12:35.059 INFO:teuthology.orchestra.run.smithi146.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2019-12-09T11:12:35.059 INFO:teuthology.orchestra.run.smithi146.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-12-09T11:12:35.060 INFO:teuthology.orchestra.run.smithi146.stdout:running build_ext 2019-12-09T11:12:35.060 INFO:teuthology.orchestra.run.smithi146.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/ragweed.egg-link (link to .) 2019-12-09T11:12:35.060 INFO:teuthology.orchestra.run.smithi146.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2019-12-09T11:12:35.061 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:35.061 INFO:teuthology.orchestra.run.smithi146.stdout:Installed /home/ubuntu/cephtest/ragweed 2019-12-09T11:12:35.061 INFO:teuthology.orchestra.run.smithi146.stdout:Processing dependencies for ragweed==0.0.1 2019-12-09T11:12:35.065 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for isodate>=0.4.4 2019-12-09T11:12:35.065 INFO:teuthology.orchestra.run.smithi146.stdout:Reading https://pypi.python.org/simple/isodate/ 2019-12-09T11:12:35.170 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading https://files.pythonhosted.org/packages/b1/80/fb8c13a4cd38eb5021dc3741a9e588e4d1de88d895c1910c6fc8a08b7a70/isodate-0.6.0.tar.gz#sha256=2e364a3d5759479cdb2d37cce6b9376ea504db2ff90252a2e5b7cc89cc9ff2d8 2019-12-09T11:12:35.229 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: isodate 0.6.0 2019-12-09T11:12:35.229 INFO:teuthology.orchestra.run.smithi146.stdout:Processing isodate-0.6.0.tar.gz 2019-12-09T11:12:35.236 INFO:teuthology.orchestra.run.smithi146.stdout:Writing /tmp/easy_install-gONFLF/isodate-0.6.0/setup.cfg 2019-12-09T11:12:35.236 INFO:teuthology.orchestra.run.smithi146.stdout:Running isodate-0.6.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-gONFLF/isodate-0.6.0/egg-dist-tmp-WggpxL 2019-12-09T11:12:35.533 INFO:teuthology.orchestra.run.smithi146.stderr:zip_safe flag not set; analyzing archive contents... 2019-12-09T11:12:35.547 INFO:teuthology.orchestra.run.smithi146.stdout:Moving isodate-0.6.0-py2.7.egg to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-09T11:12:35.548 INFO:teuthology.orchestra.run.smithi146.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-12-09T11:12:35.549 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:35.549 INFO:teuthology.orchestra.run.smithi146.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/isodate-0.6.0-py2.7.egg 2019-12-09T11:12:35.572 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for gevent==1.4.0 2019-12-09T11:12:35.572 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: gevent 1.4.0 2019-12-09T11:12:35.572 INFO:teuthology.orchestra.run.smithi146.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-12-09T11:12:35.573 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:35.573 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-09T11:12:35.574 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for bunch==1.0.1 2019-12-09T11:12:35.574 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: bunch 1.0.1 2019-12-09T11:12:35.574 INFO:teuthology.orchestra.run.smithi146.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-12-09T11:12:35.574 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:35.574 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-09T11:12:35.575 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for PyYAML==5.2 2019-12-09T11:12:35.575 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: PyYAML 5.2 2019-12-09T11:12:35.575 INFO:teuthology.orchestra.run.smithi146.stdout:Adding PyYAML 5.2 to easy-install.pth file 2019-12-09T11:12:35.576 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:35.576 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-09T11:12:35.576 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for boto==2.49.0 2019-12-09T11:12:35.576 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: boto 2.49.0 2019-12-09T11:12:35.576 INFO:teuthology.orchestra.run.smithi146.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-12-09T11:12:35.576 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:35.576 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-09T11:12:35.577 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for six==1.9.0 2019-12-09T11:12:35.577 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: six 1.9.0 2019-12-09T11:12:35.577 INFO:teuthology.orchestra.run.smithi146.stdout:Adding six 1.9.0 to easy-install.pth file 2019-12-09T11:12:35.578 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:35.578 INFO:teuthology.orchestra.run.smithi146.stdout:Using /usr/lib/python2.7/site-packages 2019-12-09T11:12:35.584 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for greenlet==0.4.15 2019-12-09T11:12:35.584 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: greenlet 0.4.15 2019-12-09T11:12:35.584 INFO:teuthology.orchestra.run.smithi146.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-12-09T11:12:35.584 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:12:35.585 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-09T11:12:35.585 INFO:teuthology.orchestra.run.smithi146.stdout:Finished processing dependencies for ragweed==0.0.1 2019-12-09T11:12:35.605 INFO:teuthology.orchestra.run.smithi146:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2019-12-09T11:12:35.673 INFO:tasks.ragweed:Configuring boto... 2019-12-09T11:12:35.673 INFO:teuthology.orchestra.run.smithi146:> cat > /home/ubuntu/cephtest/boto.cfg 2019-12-09T11:12:35.776 INFO:teuthology.orchestra.run.smithi146:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2019-12-09T11:13:54.384 INFO:teuthology.orchestra.run.smithi146.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2019-12-09T11:14:45.772 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:09:06.838 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:14:45.847 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:09:06.916 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:14:45.860 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:09:06.926 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:14:45.907 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:09:06.976 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:14:45.927 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:09:06.974 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:14:46.033 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:09:07.076 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:14:46.414 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:09:07.482 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:14:46.426 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:09:07.495 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:14:46.681 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:09:07.728 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:15:03.191 INFO:teuthology.orchestra.run.smithi146.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2019-12-09T11:15:57.163 INFO:teuthology.orchestra.run.smithi146.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2019-12-09T11:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2019-12-09T11:17:06.223 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:11:27.293 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:17:06.236 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:11:27.306 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:17:06.253 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:11:27.302 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:17:06.255 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:11:27.325 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:17:06.259 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:11:27.309 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:17:06.261 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:11:27.331 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:17:06.342 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:11:27.413 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:17:06.370 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:11:27.441 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:17:06.414 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:11:27.464 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:18:35.019 INFO:teuthology.orchestra.run.smithi146.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2019-12-09T11:21:17.113 INFO:teuthology.orchestra.run.smithi146.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2019-12-09T11:22:03.589 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:16:24.663 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:22:03.613 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:16:24.687 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:22:03.638 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:16:24.711 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:22:03.667 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:16:24.741 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:22:03.703 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:16:24.756 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:22:03.706 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:16:24.759 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:22:03.781 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:16:24.855 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:22:03.842 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:16:24.916 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:22:03.944 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:16:24.996 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:12.175 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:17:33.249 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:12.185 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:17:33.259 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:12.222 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:17:33.296 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:12.223 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:17:33.297 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:12.243 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:17:33.293 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:12.247 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:17:33.297 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:12.253 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:17:33.328 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:12.266 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:17:33.340 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:12.337 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:17:33.387 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:41.627 INFO:teuthology.orchestra.run.smithi146.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2019-12-09T11:27:15.801 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:21:36.875 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:27:15.844 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:21:36.918 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:27:15.846 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:21:36.920 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:27:15.851 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:21:36.925 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:27:15.869 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:21:36.912 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:27:15.871 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:21:36.915 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:27:15.992 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:21:37.064 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:27:15.993 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:21:37.067 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:27:16.012 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:21:37.055 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:28:43.745 INFO:teuthology.orchestra.run.smithi146.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2019-12-09T11:29:44.366 INFO:teuthology.orchestra.run.smithi146.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2019-12-09T11:29:44.367 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T11:29:44.367 INFO:teuthology.orchestra.run.smithi146.stderr:---------------------------------------------------------------------- 2019-12-09T11:29:44.367 INFO:teuthology.orchestra.run.smithi146.stderr:Ran 9 tests in 1028.186s 2019-12-09T11:29:44.367 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T11:29:44.367 INFO:teuthology.orchestra.run.smithi146.stderr:OK 2019-12-09T11:29:44.386 INFO:tasks.ragweed:Cleaning up boto... 2019-12-09T11:29:44.386 INFO:teuthology.orchestra.run.smithi146:> rm /home/ubuntu/cephtest/boto.cfg 2019-12-09T11:29:44.440 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2019-12-09T11:29:44.568 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.581+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.594 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.607+0000 7f6a98be8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:44.594 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.607+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.606 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.617+0000 7f6a98be8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:44.606 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.617+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.610 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.622+0000 7f6a98be8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:44.610 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.622+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.621 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.633+0000 7f6a98be8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:29:44.829 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.841+0000 7f6a98be8ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T11:29:44.829 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.841+0000 7f6a98be8ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T11:29:44.830 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.841+0000 7f6a98be8ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T11:29:44.830 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.841+0000 7f6a98be8ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T11:29:44.830 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.842+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.853+0000 7f6a98be8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:29:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.853+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.853 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.865+0000 7f6a98be8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:29:44.853 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.865+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.864 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.877+0000 7f6a98be8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:29:44.864 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.877+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.885 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.898+0000 7f6a98be8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:29:44.885 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.898+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.893 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.906+0000 7f6a98be8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.906+0000 7f6a98be8ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T11:29:44.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.906+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.914+0000 7f6a98be8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:44.901 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.914+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.919 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.932+0000 7f6a98be8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:29:44.919 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.932+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.937 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.949+0000 7f6a98be8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:29:44.937 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.949+0000 7f6a98be8ec0 20 zonegroup default 2019-12-09T11:29:44.937 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.949+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.958+0000 7f6a98be8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.958+0000 7f6a98be8ec0 10 Cannot find current period zone using local zone 2019-12-09T11:29:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.958+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.953 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.965+0000 7f6a98be8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:44.953 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.966+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.963 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.975+0000 7f6a98be8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:29:44.963 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.975+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:44.973 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.985+0000 7f6a98be8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:29:44.973 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.985+0000 7f6a98be8ec0 20 zone default found 2019-12-09T11:29:44.973 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.985+0000 7f6a98be8ec0 20 started sync module instance, tier type = 2019-12-09T11:29:44.973 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:44.985+0000 7f6a98be8ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T11:29:45.327 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:45.339+0000 7f6a98be8ec0 20 add_watcher() i=0 2019-12-09T11:29:45.327 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:45.339+0000 7f6a98be8ec0 20 add_watcher() i=1 2019-12-09T11:29:45.327 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:45.339+0000 7f6a98be8ec0 20 add_watcher() i=2 2019-12-09T11:29:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:45.339+0000 7f6a98be8ec0 20 add_watcher() i=3 2019-12-09T11:29:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:45.339+0000 7f6a98be8ec0 20 add_watcher() i=4 2019-12-09T11:29:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:45.339+0000 7f6a98be8ec0 20 add_watcher() i=5 2019-12-09T11:29:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:45.339+0000 7f6a98be8ec0 20 add_watcher() i=6 2019-12-09T11:29:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:45.373+0000 7f6a98be8ec0 20 add_watcher() i=7 2019-12-09T11:29:45.361 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:45.373+0000 7f6a98be8ec0 2 all 8 watchers are set, enabling cache 2019-12-09T11:29:45.361 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:45.373+0000 7f6a567dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T11:29:45.364 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:45.376+0000 7f6a86613700 0 -- 172.21.15.146:0/2180900853 >> v2:172.21.15.146:3300/0 conn(0x5588d4da14b0 msgr2=0x5588d4da18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T11:29:45.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:45.414+0000 7f6a86613700 0 -- 172.21.15.146:0/1052474385 >> [v2:172.21.15.146:6800/9590,v1:172.21.15.146:6801/9590] conn(0x7f69c80224c0 msgr2=0x7f69c8024990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T11:29:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.756+0000 7f69ccff9700 20 reqs_thread_entry: start 2019-12-09T11:29:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.756+0000 7f69be7fc700 20 reqs_thread_entry: start 2019-12-09T11:29:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.756+0000 7f6a98be8ec0 20 init_complete bucket index max shards: 0 2019-12-09T11:29:46.745 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.757+0000 7f69bcff9700 20 reqs_thread_entry: start 2019-12-09T11:29:46.745 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.757+0000 7f6a98be8ec0 20 get_system_obj_state: rctx=0x7ffe79642958 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x5588d4e265f0 s->prefetch_data=0 2019-12-09T11:29:46.745 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.757+0000 7f6a98be8ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-12-09T11:29:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.773+0000 7f6a98be8ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2019-12-09T11:29:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.773+0000 7f6a98be8ec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-09T11:29:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.773+0000 7f6a98be8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.773+0000 7f6a98be8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.773+0000 7f6a98be8ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T11:29:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.773+0000 7f6a98be8ec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:46.785 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.797+0000 7f6a98be8ec0 20 rados_obj.operate() r=0 bl.length=448 2019-12-09T11:29:46.785 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.797+0000 7f6a98be8ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2019-12-09T11:29:46.785 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.797+0000 7f6a98be8ec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-09T11:29:46.793 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.806+0000 7f6a98be8ec0 10 removing key index: MUZEKYOJERZMRMTFIIQW 2019-12-09T11:29:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.806+0000 7f6a98be8ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=170 2019-12-09T11:29:46.813 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.826+0000 7f6a66ffd700 10 RGWWatcher::handle_notify() notify_id 592705486849 cookie 94046174923584 notifier 4662 bl.length()=170 2019-12-09T11:29:46.897 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.910+0000 7f6a98be8ec0 10 removing email index: sysuser.client.0+test@test.test 2019-12-09T11:29:46.898 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.910+0000 7f6a98be8ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2019-12-09T11:29:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:46.919+0000 7f6a66ffd700 10 RGWWatcher::handle_notify() notify_id 592705486851 cookie 94046174905680 notifier 4662 bl.length()=182 2019-12-09T11:29:47.027 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.039+0000 7f6a98be8ec0 10 removing user buckets index 2019-12-09T11:29:47.027 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.039+0000 7f6a98be8ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2019-12-09T11:29:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.052+0000 7f6a66ffd700 10 RGWWatcher::handle_notify() notify_id 592705486849 cookie 94046174890000 notifier 4662 bl.length()=173 2019-12-09T11:29:47.136 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.148+0000 7f6a98be8ec0 10 removing user index: sysuser.client.0 2019-12-09T11:29:47.136 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.148+0000 7f6a98be8ec0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2019-12-09T11:29:47.136 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.148+0000 7f6a98be8ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2019-12-09T11:29:47.149 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.162+0000 7f6a66ffd700 10 RGWWatcher::handle_notify() notify_id 592705486850 cookie 94046174886704 notifier 4662 bl.length()=165 2019-12-09T11:29:47.659 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.672+0000 7f6a98be8ec0 20 remove_watcher() i=0 2019-12-09T11:29:47.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.672+0000 7f6a98be8ec0 2 removed watcher, disabling cache 2019-12-09T11:29:47.705 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.717+0000 7f6a98be8ec0 20 remove_watcher() i=1 2019-12-09T11:29:47.742 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.754+0000 7f6a98be8ec0 20 remove_watcher() i=2 2019-12-09T11:29:47.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.813+0000 7f6a98be8ec0 20 remove_watcher() i=3 2019-12-09T11:29:47.849 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.862+0000 7f6a98be8ec0 20 remove_watcher() i=4 2019-12-09T11:29:47.906 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.919+0000 7f6a98be8ec0 20 remove_watcher() i=5 2019-12-09T11:29:47.966 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:47.979+0000 7f6a98be8ec0 20 remove_watcher() i=6 2019-12-09T11:29:48.032 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.043+0000 7f6a98be8ec0 20 remove_watcher() i=7 2019-12-09T11:29:48.040 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2019-12-09T11:29:48.184 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.196+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.222 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.235+0000 7fe32d23dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:48.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.235+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.234 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.247+0000 7fe32d23dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:48.234 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.247+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.251+0000 7fe32d23dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.251+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.265+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:29:48.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.442+0000 7fe32d23dec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T11:29:48.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.442+0000 7fe32d23dec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T11:29:48.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.442+0000 7fe32d23dec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T11:29:48.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.442+0000 7fe32d23dec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T11:29:48.431 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.442+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.438 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.451+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:29:48.438 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.451+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.450 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.462+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:29:48.450 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.462+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.458 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.471+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:29:48.458 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.471+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.490+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:29:48.478 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.490+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.483 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.495+0000 7fe32d23dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:48.483 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.495+0000 7fe32d23dec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T11:29:48.483 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.495+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.492 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.500+0000 7fe32d23dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:48.492 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.500+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.510+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:29:48.498 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.510+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.527+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:29:48.516 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.527+0000 7fe32d23dec0 20 zonegroup default 2019-12-09T11:29:48.516 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.527+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.531+0000 7fe32d23dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.531+0000 7fe32d23dec0 10 Cannot find current period zone using local zone 2019-12-09T11:29:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.531+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.523 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.536+0000 7fe32d23dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:29:48.523 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.536+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.544+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:29:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.544+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:48.540 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.552+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:29:48.540 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.552+0000 7fe32d23dec0 20 zone default found 2019-12-09T11:29:48.540 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.552+0000 7fe32d23dec0 20 started sync module instance, tier type = 2019-12-09T11:29:48.541 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.552+0000 7fe32d23dec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T11:29:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.953+0000 7fe32d23dec0 20 add_watcher() i=0 2019-12-09T11:29:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.953+0000 7fe32d23dec0 20 add_watcher() i=1 2019-12-09T11:29:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.953+0000 7fe32d23dec0 20 add_watcher() i=2 2019-12-09T11:29:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.953+0000 7fe32d23dec0 20 add_watcher() i=3 2019-12-09T11:29:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.953+0000 7fe32d23dec0 20 add_watcher() i=4 2019-12-09T11:29:48.942 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.953+0000 7fe32d23dec0 20 add_watcher() i=5 2019-12-09T11:29:48.942 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.953+0000 7fe32d23dec0 20 add_watcher() i=6 2019-12-09T11:29:48.969 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.982+0000 7fe32d23dec0 20 add_watcher() i=7 2019-12-09T11:29:48.970 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.982+0000 7fe32d23dec0 2 all 8 watchers are set, enabling cache 2019-12-09T11:29:48.970 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.982+0000 7fe2eafdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T11:29:48.973 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:48.985+0000 7fe31a467700 0 -- 172.21.15.146:0/2428025852 >> v1:172.21.15.194:6789/0 conn(0x55afeda54e70 legacy=0x55afeda572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T11:29:49.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:49.029+0000 7fe319c66700 0 -- 172.21.15.146:0/1475577715 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x55afeda69f40 msgr2=0x55afeda6c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T11:29:50.341 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.354+0000 7fe2597fa700 20 reqs_thread_entry: start 2019-12-09T11:29:50.342 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.354+0000 7fe252ffd700 20 reqs_thread_entry: start 2019-12-09T11:29:50.342 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.354+0000 7fe32d23dec0 20 init_complete bucket index max shards: 0 2019-12-09T11:29:50.342 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.354+0000 7fe2517fa700 20 reqs_thread_entry: start 2019-12-09T11:29:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.354+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b660b8 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55afedad3d10 s->prefetch_data=0 2019-12-09T11:29:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.354+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-12-09T11:29:50.354 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.366+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2019-12-09T11:29:50.354 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.366+0000 7fe32d23dec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-09T11:29:50.354 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.366+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:50.354 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.366+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:50.354 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.366+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T11:29:50.355 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.366+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:50.365 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.378+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=448 2019-12-09T11:29:50.366 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.378+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2019-12-09T11:29:50.366 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.378+0000 7fe32d23dec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-09T11:29:50.388 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.400+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:test-client.0-conf state=0x55afedad5630 s->prefetch_data=0 2019-12-09T11:29:50.388 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.400+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2019-12-09T11:29:50.399 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.412+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2019-12-09T11:29:50.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.412+0000 7fe32d23dec0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-12-09T11:29:50.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.412+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:50.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.412+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:50.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.412+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2019-12-09T11:29:50.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.412+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:50.417 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.430+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=200 2019-12-09T11:29:50.417 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.430+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2019-12-09T11:29:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.430+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-12-09T11:29:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.430+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 state=0x55afedad7bf0 s->prefetch_data=0 2019-12-09T11:29:50.418 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.430+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 : miss 2019-12-09T11:29:50.428 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.440+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 info.flags=0x16 2019-12-09T11:29:50.428 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.440+0000 7fe32d23dec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 to cache LRU end 2019-12-09T11:29:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.440+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.440+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:29:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.440+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.440+0000 7fe32d23dec0 20 Read xattr: user.rgw.acl 2019-12-09T11:29:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.440+0000 7fe32d23dec0 20 Read xattr: user.rgw.idtag 2019-12-09T11:29:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.440+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 : type miss (requested=0x13, cached=0x16) 2019-12-09T11:29:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.440+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.455+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=292 2019-12-09T11:29:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.455+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 info.flags=0x13 2019-12-09T11:29:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.455+0000 7fe32d23dec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 to cache LRU end 2019-12-09T11:29:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.455+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.455+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:29:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.455+0000 7fe32d23dec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 2019-12-09T11:29:50.456 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.469+0000 7fe32d23dec0 10 cls_bucket_list_unordered :test-client.0-conf[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1]) start [] num_entries 1100 2019-12-09T11:29:50.500 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.513+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2019-12-09T11:29:50.500 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.513+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2019-12-09T11:29:50.501 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.513+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2019-12-09T11:29:50.501 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.513+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2019-12-09T11:29:50.501 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.513+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2019-12-09T11:29:50.501 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.513+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2019-12-09T11:29:50.501 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.513+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2019-12-09T11:29:50.501 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.513+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2019-12-09T11:29:50.501 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.513+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2019-12-09T11:29:50.502 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.513+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.523+0000 7fe32d23dec0 10 manifest: total_size = 3906 2019-12-09T11:29:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.523+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.13 2019-12-09T11:29:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.523+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.523+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedadcdf8 2019-12-09T11:29:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.523+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 2019-12-09T11:29:50.682 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.695+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:50.695 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.707+0000 7fe32d23dec0 10 manifest: total_size = 5946 2019-12-09T11:29:50.695 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.707+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.30 2019-12-09T11:29:50.696 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.707+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:50.696 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.707+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedadcdf8 2019-12-09T11:29:50.696 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.707+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 2019-12-09T11:29:50.902 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.914+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.955+0000 7fe32d23dec0 10 manifest: total_size = 9705 2019-12-09T11:29:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.955+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.56 2019-12-09T11:29:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.955+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:50.944 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.955+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedadcdf8 2019-12-09T11:29:50.944 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:50.955+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 2019-12-09T11:29:51.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.115+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.129+0000 7fe32d23dec0 10 manifest: total_size = 3787 2019-12-09T11:29:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.129+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.72 2019-12-09T11:29:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.129+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.129+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedadcdf8 2019-12-09T11:29:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.129+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 2019-12-09T11:29:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.275+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:51.280 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.293+0000 7fe32d23dec0 10 manifest: total_size = 3922 2019-12-09T11:29:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.293+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.87 2019-12-09T11:29:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.293+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.293+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedadcdf8 2019-12-09T11:29:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.293+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 2019-12-09T11:29:51.461 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.474+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.501+0000 7fe32d23dec0 10 manifest: total_size = 6043 2019-12-09T11:29:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.501+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.120 2019-12-09T11:29:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.501+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.501+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedadcdf8 2019-12-09T11:29:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.501+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 2019-12-09T11:29:51.633 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.645+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:51.648 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.660+0000 7fe32d23dec0 10 manifest: total_size = 11065 2019-12-09T11:29:51.648 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.660+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.189 2019-12-09T11:29:51.649 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.660+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:51.649 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.660+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedadcdf8 2019-12-09T11:29:51.649 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.660+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 2019-12-09T11:29:51.791 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.803+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:51.800 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.813+0000 7fe32d23dec0 10 manifest: total_size = 12956 2019-12-09T11:29:51.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.813+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.246 2019-12-09T11:29:51.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.813+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:51.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.813+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedadcdf8 2019-12-09T11:29:51.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:51.813+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 2019-12-09T11:29:52.004 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.017+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:52.024 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.037+0000 7fe32d23dec0 10 manifest: total_size = 4198 2019-12-09T11:29:52.025 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.037+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.322 2019-12-09T11:29:52.025 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.037+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55afedadcdf8 s->prefetch_data=0 2019-12-09T11:29:52.025 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.037+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedadcdf8 2019-12-09T11:29:52.025 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.037+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 2019-12-09T11:29:52.198 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.210+0000 7fe32d23dec0 10 cls_bucket_list_ordered :test-client.0-conf[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1]) start _multipart_[] num_entries 1001 2019-12-09T11:29:52.198 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.210+0000 7fe32d23dec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T11:29:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.271+0000 7fe32d23dec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1])"; objs.size()=0; is_truncated=0 2019-12-09T11:29:52.334 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.347+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65838 obj=default.rgw.meta:root:test-client.0-conf state=0x55afedad5630 s->prefetch_data=0 2019-12-09T11:29:52.334 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.347+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2019-12-09T11:29:52.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.362+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2019-12-09T11:29:52.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.362+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-12-09T11:29:52.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.362+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:52.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.362+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:52.351 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.362+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2019-12-09T11:29:52.351 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.362+0000 7fe32d23dec0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2019-12-09T11:29:52.351 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.362+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2019-12-09T11:29:52.386 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.399+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486848 cookie 94214094560272 notifier 4672 bl.length()=162 2019-12-09T11:29:52.864 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.877+0000 7fe32d23dec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.1 from cache 2019-12-09T11:29:52.864 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.877+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=219 2019-12-09T11:29:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:52.899+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486849 cookie 94214094560272 notifier 4672 bl.length()=219 2019-12-09T11:29:53.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.532+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55afedad7b80 s->prefetch_data=0 2019-12-09T11:29:53.520 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.532+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2019-12-09T11:29:53.534 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.546+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2019-12-09T11:29:53.534 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.546+0000 7fe32d23dec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-12-09T11:29:53.534 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.546+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:53.534 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.546+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:53.535 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.546+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T11:29:53.535 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.546+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:53.546 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.558+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=229 2019-12-09T11:29:53.546 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.558+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2019-12-09T11:29:53.546 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.558+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-12-09T11:29:53.546 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.558+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2 state=0x55afedaddc00 s->prefetch_data=0 2019-12-09T11:29:53.546 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.558+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2 : miss 2019-12-09T11:29:53.561 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.573+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2 info.flags=0x16 2019-12-09T11:29:53.561 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.573+0000 7fe32d23dec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2 to cache LRU end 2019-12-09T11:29:53.561 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.573+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:53.561 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.573+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:29:53.561 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.573+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:53.562 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.573+0000 7fe32d23dec0 20 Read xattr: user.rgw.acl 2019-12-09T11:29:53.562 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.573+0000 7fe32d23dec0 20 Read xattr: user.rgw.idtag 2019-12-09T11:29:53.562 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.573+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2 : type miss (requested=0x13, cached=0x16) 2019-12-09T11:29:53.562 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.573+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:53.585 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.597+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=321 2019-12-09T11:29:53.585 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.597+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2 info.flags=0x13 2019-12-09T11:29:53.585 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.597+0000 7fe32d23dec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2 to cache LRU end 2019-12-09T11:29:53.585 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.597+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:53.586 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.597+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:29:53.586 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.597+0000 7fe32d23dec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2 2019-12-09T11:29:53.601 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.613+0000 7fe32d23dec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2]) start [] num_entries 1100 2019-12-09T11:29:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.635+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-12-09T11:29:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.635+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55afedadcd68 s->prefetch_data=0 2019-12-09T11:29:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.647+0000 7fe32d23dec0 10 manifest: total_size = 886297 2019-12-09T11:29:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.647+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.20 2019-12-09T11:29:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.647+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55afedadcd68 s->prefetch_data=0 2019-12-09T11:29:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.647+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedadcd68 2019-12-09T11:29:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.647+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2 2019-12-09T11:29:53.771 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-09T11:29:53.771 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2019-12-09T11:29:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-12-09T11:29:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-09T11:29:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2019-12-09T11:29:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2019-12-09T11:29:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-09T11:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2019-12-09T11:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2019-12-09T11:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2019-12-09T11:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2019-12-09T11:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2019-12-09T11:29:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.783+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.20 2019-12-09T11:29:53.875 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.888+0000 7fe32d23dec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-complete.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2]) start _multipart_[] num_entries 1001 2019-12-09T11:29:53.875 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.888+0000 7fe32d23dec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T11:29:53.889 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:53.903+0000 7fe32d23dec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2])"; objs.size()=0; is_truncated=0 2019-12-09T11:29:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.000+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65838 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55afedade1f0 s->prefetch_data=0 2019-12-09T11:29:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.000+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T11:29:54.007 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.020+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2019-12-09T11:29:54.007 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.020+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-12-09T11:29:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.020+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.020+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.020+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2019-12-09T11:29:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.020+0000 7fe32d23dec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2019-12-09T11:29:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.020+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2019-12-09T11:29:54.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.088+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486848 cookie 94214094563728 notifier 4672 bl.length()=191 2019-12-09T11:29:54.386 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.399+0000 7fe32d23dec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2 from cache 2019-12-09T11:29:54.386 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.399+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=248 2019-12-09T11:29:54.403 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.411+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486850 cookie 94214094569120 notifier 4672 bl.length()=248 2019-12-09T11:29:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.663+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55afedad5630 s->prefetch_data=0 2019-12-09T11:29:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.663+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2019-12-09T11:29:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.672+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2019-12-09T11:29:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.672+0000 7fe32d23dec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-12-09T11:29:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.672+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.672+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.672+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T11:29:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.672+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.688+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=236 2019-12-09T11:29:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.688+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2019-12-09T11:29:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.688+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-12-09T11:29:54.676 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.688+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3 state=0x55afedade1f0 s->prefetch_data=0 2019-12-09T11:29:54.676 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.688+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3 : miss 2019-12-09T11:29:54.689 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.702+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3 info.flags=0x16 2019-12-09T11:29:54.689 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.702+0000 7fe32d23dec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3 to cache LRU end 2019-12-09T11:29:54.689 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.702+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.702+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:29:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.702+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.702+0000 7fe32d23dec0 20 Read xattr: user.rgw.acl 2019-12-09T11:29:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.702+0000 7fe32d23dec0 20 Read xattr: user.rgw.idtag 2019-12-09T11:29:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.702+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3 : type miss (requested=0x13, cached=0x16) 2019-12-09T11:29:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.702+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:54.716 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.729+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=328 2019-12-09T11:29:54.716 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.729+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3 info.flags=0x13 2019-12-09T11:29:54.716 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.729+0000 7fe32d23dec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3 to cache LRU end 2019-12-09T11:29:54.716 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.729+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:54.716 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.729+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:29:54.716 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.729+0000 7fe32d23dec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3 2019-12-09T11:29:54.728 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.741+0000 7fe32d23dec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3]) start [] num_entries 1100 2019-12-09T11:29:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.759+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-12-09T11:29:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.759+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55afedadcd68 s->prefetch_data=0 2019-12-09T11:29:54.767 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.780+0000 7fe32d23dec0 10 manifest: total_size = 26082 2019-12-09T11:29:54.767 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.780+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.40 2019-12-09T11:29:54.767 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.780+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55afedadcd68 s->prefetch_data=0 2019-12-09T11:29:54.767 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.780+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedadcd68 2019-12-09T11:29:54.767 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.780+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3 2019-12-09T11:29:54.938 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2019-12-09T11:29:54.938 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7671 2019-12-09T11:29:54.938 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7674 2019-12-09T11:29:54.939 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=4 2019-12-09T11:29:54.939 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4197879 part_ofs=7671 rule->part_size=7674 2019-12-09T11:29:54.939 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=15345 stripe_ofs=15345 part_ofs=15345 rule->part_size=7670 2019-12-09T11:29:54.939 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2019-12-09T11:29:54.939 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4205553 part_ofs=15345 rule->part_size=7670 2019-12-09T11:29:54.939 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=23015 stripe_ofs=23015 part_ofs=23015 rule->part_size=3067 2019-12-09T11:29:54.939 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2019-12-09T11:29:54.940 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4213223 part_ofs=23015 rule->part_size=3067 2019-12-09T11:29:54.940 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=26082 stripe_ofs=26082 part_ofs=26082 rule->part_size=3067 2019-12-09T11:29:54.940 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:54.951+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.40 2019-12-09T11:29:55.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.035+0000 7fe32d23dec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-update-complete.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3]) start _multipart_[] num_entries 1001 2019-12-09T11:29:55.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.035+0000 7fe32d23dec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T11:29:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.047+0000 7fe32d23dec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3])"; objs.size()=0; is_truncated=0 2019-12-09T11:29:55.110 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.123+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65838 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55afedad77c0 s->prefetch_data=0 2019-12-09T11:29:55.110 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.123+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T11:29:55.131 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.144+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2019-12-09T11:29:55.131 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.144+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-12-09T11:29:55.131 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.144+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:55.132 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.144+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:55.132 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.144+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2019-12-09T11:29:55.132 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.144+0000 7fe32d23dec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2019-12-09T11:29:55.132 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.144+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2019-12-09T11:29:55.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.160+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486851 cookie 94214094567216 notifier 4672 bl.length()=198 2019-12-09T11:29:55.572 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.585+0000 7fe32d23dec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3 from cache 2019-12-09T11:29:55.572 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.585+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=255 2019-12-09T11:29:55.581 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.594+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486852 cookie 94214094567216 notifier 4672 bl.length()=255 2019-12-09T11:29:55.783 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.796+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55afedaddc00 s->prefetch_data=0 2019-12-09T11:29:55.783 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.796+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2019-12-09T11:29:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.808+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2019-12-09T11:29:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.808+0000 7fe32d23dec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-12-09T11:29:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.808+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.808+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.808+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T11:29:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.808+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.821+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=231 2019-12-09T11:29:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.821+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2019-12-09T11:29:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.821+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-12-09T11:29:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.821+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 state=0x55afedad77c0 s->prefetch_data=0 2019-12-09T11:29:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.821+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 : miss 2019-12-09T11:29:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.830+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 info.flags=0x16 2019-12-09T11:29:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.830+0000 7fe32d23dec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 to cache LRU end 2019-12-09T11:29:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.830+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.830+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:29:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.830+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.830+0000 7fe32d23dec0 20 Read xattr: user.rgw.acl 2019-12-09T11:29:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.830+0000 7fe32d23dec0 20 Read xattr: user.rgw.idtag 2019-12-09T11:29:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.830+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 : type miss (requested=0x13, cached=0x16) 2019-12-09T11:29:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.830+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.852+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=323 2019-12-09T11:29:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.852+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 info.flags=0x13 2019-12-09T11:29:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.852+0000 7fe32d23dec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 to cache LRU end 2019-12-09T11:29:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.852+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.852+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:29:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.852+0000 7fe32d23dec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 2019-12-09T11:29:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.878+0000 7fe32d23dec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4]) start [] num_entries 1100 2019-12-09T11:29:55.883 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.896+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo[gO8MM0pBESMvO5zsRZxrV3uObJC.zvI] 2019-12-09T11:29:55.883 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.896+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 2019-12-09T11:29:55.917 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.930+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55afedae2b68 s->prefetch_data=0 2019-12-09T11:29:55.928 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.941+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to gib6czphjox7k0siptvgwfih8a9doqzc 2019-12-09T11:29:55.928 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.941+0000 7fe32d23dec0 20 get_obj_state_impl: setting s->olh_tag to 3ivbjt2ikrbzyoeam8c9b9pz9e7oud79 2019-12-09T11:29:55.929 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.941+0000 7fe32d23dec0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3ivbjt2ikrbzyoeam8c9b9pz9e7oud79 2019-12-09T11:29:55.982 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:55.996+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 2019-12-09T11:29:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.093+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 2019-12-09T11:29:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.093+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 2019-12-09T11:29:56.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.108+0000 7fe32d23dec0 20 olh_log_entry: epoch=3 op=2 key=[] 2019-12-09T11:29:56.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.108+0000 7fe32d23dec0 20 olh_log_entry: epoch=3 op=3 key=foo[gO8MM0pBESMvO5zsRZxrV3uObJC.zvI] 2019-12-09T11:29:56.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.108+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-multipart-index-versioning.1:_:gO8MM0pBESMvO5zsRZxrV3uObJC.zvI_foo state=0x55afedae31d8 s->prefetch_data=0 2019-12-09T11:29:56.109 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.121+0000 7fe32d23dec0 10 manifest: total_size = 886297 2019-12-09T11:29:56.109 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.121+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.55 2019-12-09T11:29:56.109 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.121+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-multipart-index-versioning.1:_:gO8MM0pBESMvO5zsRZxrV3uObJC.zvI_foo state=0x55afedae31d8 s->prefetch_data=0 2019-12-09T11:29:56.109 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.121+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae31d8 2019-12-09T11:29:56.109 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.121+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 2019-12-09T11:29:56.222 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-09T11:29:56.222 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2019-12-09T11:29:56.222 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-12-09T11:29:56.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-09T11:29:56.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2019-12-09T11:29:56.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2019-12-09T11:29:56.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-09T11:29:56.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2019-12-09T11:29:56.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2019-12-09T11:29:56.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2019-12-09T11:29:56.224 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2019-12-09T11:29:56.224 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2019-12-09T11:29:56.224 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.235+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.55 2019-12-09T11:29:56.367 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.380+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 2019-12-09T11:29:56.367 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.380+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 2019-12-09T11:29:56.483 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.497+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 2019-12-09T11:29:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.568+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 2019-12-09T11:29:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.568+0000 7fe32d23dec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-index-versioning.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4]) start _multipart_[] num_entries 1001 2019-12-09T11:29:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.568+0000 7fe32d23dec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T11:29:56.578 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.591+0000 7fe32d23dec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4])"; objs.size()=0; is_truncated=0 2019-12-09T11:29:56.650 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.663+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65838 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55afedad77c0 s->prefetch_data=0 2019-12-09T11:29:56.650 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.663+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T11:29:56.663 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.676+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2019-12-09T11:29:56.663 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.676+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-12-09T11:29:56.663 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.676+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:56.663 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.676+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:56.663 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.676+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2019-12-09T11:29:56.663 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.676+0000 7fe32d23dec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2019-12-09T11:29:56.664 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.676+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2019-12-09T11:29:56.676 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:56.689+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486853 cookie 94214094567216 notifier 4672 bl.length()=193 2019-12-09T11:29:57.140 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.153+0000 7fe32d23dec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4 from cache 2019-12-09T11:29:57.141 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.153+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=250 2019-12-09T11:29:57.155 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.168+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486852 cookie 94214094584048 notifier 4672 bl.length()=250 2019-12-09T11:29:57.502 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.516+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55afedad77c0 s->prefetch_data=0 2019-12-09T11:29:57.503 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.516+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2019-12-09T11:29:57.513 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.526+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2019-12-09T11:29:57.513 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.526+0000 7fe32d23dec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-12-09T11:29:57.513 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.526+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:57.514 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.526+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:57.514 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.526+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T11:29:57.514 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.526+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:57.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.544+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-09T11:29:57.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.544+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2019-12-09T11:29:57.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.544+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-12-09T11:29:57.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.544+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5 state=0x55afedade1c0 s->prefetch_data=0 2019-12-09T11:29:57.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.544+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5 : miss 2019-12-09T11:29:57.554 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.567+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5 info.flags=0x16 2019-12-09T11:29:57.555 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.567+0000 7fe32d23dec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5 to cache LRU end 2019-12-09T11:29:57.555 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.567+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:57.555 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.567+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:29:57.555 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.567+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:57.555 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.568+0000 7fe32d23dec0 20 Read xattr: user.rgw.acl 2019-12-09T11:29:57.555 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.568+0000 7fe32d23dec0 20 Read xattr: user.rgw.idtag 2019-12-09T11:29:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.568+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5 : type miss (requested=0x13, cached=0x16) 2019-12-09T11:29:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.568+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:57.586 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.599+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-09T11:29:57.587 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.599+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5 info.flags=0x13 2019-12-09T11:29:57.587 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.599+0000 7fe32d23dec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5 to cache LRU end 2019-12-09T11:29:57.587 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.599+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:57.587 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.599+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:29:57.588 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.599+0000 7fe32d23dec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5 2019-12-09T11:29:57.606 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.619+0000 7fe32d23dec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5]) start [] num_entries 1100 2019-12-09T11:29:57.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.644+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-12-09T11:29:57.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.644+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55afedae2b68 s->prefetch_data=0 2019-12-09T11:29:57.648 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.660+0000 7fe32d23dec0 10 manifest: total_size = 1848 2019-12-09T11:29:57.648 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.660+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.71 2019-12-09T11:29:57.648 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.660+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55afedae2b68 s->prefetch_data=0 2019-12-09T11:29:57.648 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.660+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae2b68 2019-12-09T11:29:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.660+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5 2019-12-09T11:29:57.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-09T11:29:57.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=515 2019-12-09T11:29:57.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-12-09T11:29:57.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-09T11:29:57.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4190723 part_ofs=515 rule->part_size=515 2019-12-09T11:29:57.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2019-12-09T11:29:57.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-09T11:29:57.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4191238 part_ofs=1030 rule->part_size=515 2019-12-09T11:29:57.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2019-12-09T11:29:57.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2019-12-09T11:29:57.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4191753 part_ofs=1545 rule->part_size=303 2019-12-09T11:29:57.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2019-12-09T11:29:57.790 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.801+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.71 2019-12-09T11:29:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.863+0000 7fe32d23dec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-simple.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5]) start _multipart_[] num_entries 1001 2019-12-09T11:29:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.863+0000 7fe32d23dec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T11:29:57.861 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.874+0000 7fe32d23dec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5])"; objs.size()=0; is_truncated=0 2019-12-09T11:29:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.930+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65838 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55afedadd330 s->prefetch_data=0 2019-12-09T11:29:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.930+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T11:29:57.927 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.940+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2019-12-09T11:29:57.928 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.940+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-12-09T11:29:57.928 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.940+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:57.928 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.940+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:57.928 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.940+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2019-12-09T11:29:57.928 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.940+0000 7fe32d23dec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2019-12-09T11:29:57.928 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.940+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2019-12-09T11:29:57.942 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:57.955+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486853 cookie 94214094584048 notifier 4672 bl.length()=183 2019-12-09T11:29:58.277 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:58.290+0000 7fe32d23dec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5 from cache 2019-12-09T11:29:58.277 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:58.290+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=240 2019-12-09T11:29:58.291 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:58.304+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486850 cookie 94214094601792 notifier 4672 bl.length()=240 2019-12-09T11:29:58.974 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:58.987+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55afedad77c0 s->prefetch_data=0 2019-12-09T11:29:58.974 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:58.987+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2019-12-09T11:29:58.989 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.002+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2019-12-09T11:29:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.002+0000 7fe32d23dec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-12-09T11:29:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.002+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:58.990 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.002+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:58.991 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.002+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T11:29:58.991 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.002+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:59.010 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.022+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=227 2019-12-09T11:29:59.010 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.022+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2019-12-09T11:29:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.022+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-12-09T11:29:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.022+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 state=0x55afedade1c0 s->prefetch_data=0 2019-12-09T11:29:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.022+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 : miss 2019-12-09T11:29:59.029 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.041+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 info.flags=0x16 2019-12-09T11:29:59.029 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.041+0000 7fe32d23dec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 to cache LRU end 2019-12-09T11:29:59.029 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.041+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:59.029 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.041+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:29:59.030 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.041+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:29:59.030 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.041+0000 7fe32d23dec0 20 Read xattr: user.rgw.acl 2019-12-09T11:29:59.030 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.041+0000 7fe32d23dec0 20 Read xattr: user.rgw.idtag 2019-12-09T11:29:59.030 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.041+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 : type miss (requested=0x13, cached=0x16) 2019-12-09T11:29:59.030 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.042+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:29:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.064+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=319 2019-12-09T11:29:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.064+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 info.flags=0x13 2019-12-09T11:29:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.064+0000 7fe32d23dec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 to cache LRU end 2019-12-09T11:29:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.064+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:29:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.064+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:29:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.064+0000 7fe32d23dec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:29:59.069 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.082+0000 7fe32d23dec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7]) start [] num_entries 1100 2019-12-09T11:29:59.115 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-09T11:29:59.115 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-12-09T11:29:59.116 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-12-09T11:29:59.116 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-12-09T11:29:59.116 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-09T11:29:59.116 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-12-09T11:29:59.116 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-12-09T11:29:59.116 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-12-09T11:29:59.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-09T11:29:59.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-12-09T11:29:59.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-12-09T11:29:59.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-12-09T11:29:59.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.128+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:29:59.133 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.146+0000 7fe32d23dec0 10 manifest: total_size = 5242880 2019-12-09T11:29:59.133 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.146+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.108 2019-12-09T11:29:59.133 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.146+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:29:59.134 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.146+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae0e18 2019-12-09T11:29:59.134 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.146+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:29:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.292+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:29:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.292+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-09T11:29:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.292+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:29:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.292+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T11:29:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.292+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.108 2019-12-09T11:29:59.353 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.366+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:29:59.362 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.375+0000 7fe32d23dec0 10 manifest: total_size = 5242880 2019-12-09T11:29:59.362 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.375+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.109 2019-12-09T11:29:59.362 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.375+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:29:59.362 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.375+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae0e18 2019-12-09T11:29:59.363 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.375+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:29:59.444 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.456+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:29:59.444 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.456+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-09T11:29:59.444 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.456+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:29:59.445 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.456+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T11:29:59.445 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.456+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.109 2019-12-09T11:29:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.558+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:29:59.559 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.572+0000 7fe32d23dec0 10 manifest: total_size = 5242880 2019-12-09T11:29:59.560 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.572+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to _NjI7EDd_0fN5pdd7rnjDbQSCw0JaIB8 2019-12-09T11:29:59.560 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.572+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:29:59.560 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.572+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae0e18 2019-12-09T11:29:59.560 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.573+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:29:59.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.699+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:29:59.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.699+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-09T11:29:59.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.699+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:29:59.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.699+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T11:29:59.687 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.699+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _NjI7EDd_0fN5pdd7rnjDbQSCw0JaIB8 2019-12-09T11:29:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.804+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:29:59.802 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.815+0000 7fe32d23dec0 10 manifest: total_size = 5242880 2019-12-09T11:29:59.802 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.815+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to _8rF8S_R08hKL9tszdEENJGK9xj96wmU 2019-12-09T11:29:59.802 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.815+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:29:59.802 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.815+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae0e18 2019-12-09T11:29:59.803 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.815+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:29:59.938 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:29:59.938 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.951+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T11:29:59.938 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:29:59.951+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _8rF8S_R08hKL9tszdEENJGK9xj96wmU 2019-12-09T11:30:00.020 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.033+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.041+0000 7fe32d23dec0 10 manifest: total_size = 5242880 2019-12-09T11:30:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.041+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.112 2019-12-09T11:30:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.041+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.041+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae0e18 2019-12-09T11:30:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.041+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:30:00.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.195+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:00.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.195+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-09T11:30:00.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.195+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:00.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.195+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T11:30:00.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.195+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.112 2019-12-09T11:30:00.227 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.240+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:00.242 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.255+0000 7fe32d23dec0 10 manifest: total_size = 5242880 2019-12-09T11:30:00.242 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.255+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to _WTIygmoWPnlawYS2NgLQnj6XCzgnZEx 2019-12-09T11:30:00.242 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.255+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:00.243 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.255+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae0e18 2019-12-09T11:30:00.243 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.255+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:30:00.381 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.394+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:00.381 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.394+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-09T11:30:00.382 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.394+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:00.383 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.394+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T11:30:00.383 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.394+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _WTIygmoWPnlawYS2NgLQnj6XCzgnZEx 2019-12-09T11:30:00.466 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.479+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55afedae2f38 s->prefetch_data=0 2019-12-09T11:30:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.490+0000 7fe32d23dec0 10 manifest: total_size = 5242880 2019-12-09T11:30:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.490+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.114 2019-12-09T11:30:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.490+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55afedae2f38 s->prefetch_data=0 2019-12-09T11:30:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.490+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae2f38 2019-12-09T11:30:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.490+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:30:00.589 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.602+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.602+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-09T11:30:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.602+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.602+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T11:30:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.602+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.114 2019-12-09T11:30:00.684 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.697+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:00.696 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.709+0000 7fe32d23dec0 10 manifest: total_size = 5242880 2019-12-09T11:30:00.696 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.709+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to _N6VQSnCesR1MVTr1mCe2NwX0vrp5zMD 2019-12-09T11:30:00.696 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.709+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:00.697 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.709+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae0e18 2019-12-09T11:30:00.697 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.709+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:30:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.829+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.829+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T11:30:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.829+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _N6VQSnCesR1MVTr1mCe2NwX0vrp5zMD 2019-12-09T11:30:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.906+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:00.903 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.916+0000 7fe32d23dec0 10 manifest: total_size = 324167 2019-12-09T11:30:00.903 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.916+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.116 2019-12-09T11:30:00.903 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.916+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:00.903 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.916+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae0e18 2019-12-09T11:30:00.903 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:00.916+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:30:01.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.088+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.106+0000 7fe32d23dec0 10 manifest: total_size = 324167 2019-12-09T11:30:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.106+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to _XcujJanuzKPs02uhpquVuG-b2CBdrBu 2019-12-09T11:30:01.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.106+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:01.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.106+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae0e18 2019-12-09T11:30:01.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.106+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:30:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.259+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.259+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=324167 stripe_ofs=324167 part_ofs=0 rule->part_size=0 2019-12-09T11:30:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.259+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _XcujJanuzKPs02uhpquVuG-b2CBdrBu 2019-12-09T11:30:01.360 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.373+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:01.368 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.381+0000 7fe32d23dec0 10 manifest: total_size = 324167 2019-12-09T11:30:01.368 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.381+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to _tok3uqHBa5XGYAcxwDDKenjpHocratA 2019-12-09T11:30:01.369 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.381+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:01.369 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.381+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae0e18 2019-12-09T11:30:01.369 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.381+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:30:01.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.490+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:01.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.490+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=324167 stripe_ofs=324167 part_ofs=0 rule->part_size=0 2019-12-09T11:30:01.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.490+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _tok3uqHBa5XGYAcxwDDKenjpHocratA 2019-12-09T11:30:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.594+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:01.597 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.610+0000 7fe32d23dec0 10 manifest: total_size = 324167 2019-12-09T11:30:01.598 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.610+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to __iDExm0zNAGLjAg2cfBChYiGU38JCWB 2019-12-09T11:30:01.598 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.610+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55afedae0e18 s->prefetch_data=0 2019-12-09T11:30:01.598 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.610+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae0e18 2019-12-09T11:30:01.598 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.610+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 2019-12-09T11:30:01.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.784+0000 7fe32d23dec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-copy.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7]) start _multipart_[] num_entries 1001 2019-12-09T11:30:01.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.784+0000 7fe32d23dec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T11:30:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.853+0000 7fe32d23dec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7])"; objs.size()=0; is_truncated=0 2019-12-09T11:30:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.904+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65838 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55afedaddc00 s->prefetch_data=0 2019-12-09T11:30:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.904+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T11:30:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.919+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2019-12-09T11:30:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.919+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-12-09T11:30:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.919+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.919+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.919+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2019-12-09T11:30:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.919+0000 7fe32d23dec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2019-12-09T11:30:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.919+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2019-12-09T11:30:01.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:01.933+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486854 cookie 94214094567216 notifier 4672 bl.length()=189 2019-12-09T11:30:02.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.158+0000 7fe32d23dec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7 from cache 2019-12-09T11:30:02.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.158+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=246 2019-12-09T11:30:02.155 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.167+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486854 cookie 94214094584048 notifier 4672 bl.length()=246 2019-12-09T11:30:02.870 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.881+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55afedaddc00 s->prefetch_data=0 2019-12-09T11:30:02.870 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.881+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2019-12-09T11:30:02.883 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.895+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2019-12-09T11:30:02.884 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.895+0000 7fe32d23dec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-12-09T11:30:02.884 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.895+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:02.884 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.895+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:02.884 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.895+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T11:30:02.885 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.895+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.910+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=237 2019-12-09T11:30:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.910+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2019-12-09T11:30:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.910+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-12-09T11:30:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.910+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 state=0x55afedadcdb0 s->prefetch_data=0 2019-12-09T11:30:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.911+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 : miss 2019-12-09T11:30:02.919 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.931+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 info.flags=0x16 2019-12-09T11:30:02.919 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.931+0000 7fe32d23dec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 to cache LRU end 2019-12-09T11:30:02.920 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.931+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:02.920 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.931+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:30:02.920 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.931+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:02.920 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.931+0000 7fe32d23dec0 20 Read xattr: user.rgw.acl 2019-12-09T11:30:02.920 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.931+0000 7fe32d23dec0 20 Read xattr: user.rgw.idtag 2019-12-09T11:30:02.920 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.931+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 : type miss (requested=0x13, cached=0x16) 2019-12-09T11:30:02.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.931+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:02.953 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.965+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=329 2019-12-09T11:30:02.954 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.965+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 info.flags=0x13 2019-12-09T11:30:02.954 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.965+0000 7fe32d23dec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 to cache LRU end 2019-12-09T11:30:02.954 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.965+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:02.954 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.965+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:30:02.954 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.965+0000 7fe32d23dec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:02.966 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:02.978+0000 7fe32d23dec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9]) start [] num_entries 1100 2019-12-09T11:30:02.992 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-09T11:30:02.992 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-12-09T11:30:02.993 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-12-09T11:30:02.993 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-12-09T11:30:02.993 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-09T11:30:02.994 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-12-09T11:30:02.994 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-12-09T11:30:02.994 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-12-09T11:30:02.994 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-09T11:30:02.995 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-12-09T11:30:02.995 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-12-09T11:30:02.995 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-12-09T11:30:02.996 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.004+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55afedae2228 s->prefetch_data=0 2019-12-09T11:30:03.010 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.017+0000 7fe32d23dec0 10 manifest: total_size = 11534336 2019-12-09T11:30:03.010 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.017+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.224 2019-12-09T11:30:03.015 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.017+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55afedae2228 s->prefetch_data=0 2019-12-09T11:30:03.015 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.017+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae2228 2019-12-09T11:30:03.015 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.018+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:03.145 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:03.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:03.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:03.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:03.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:03.147 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:03.147 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:03.147 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:03.148 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:03.148 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:03.148 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:03.149 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-09T11:30:03.149 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-09T11:30:03.149 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-09T11:30:03.149 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-09T11:30:03.149 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.157+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.224 2019-12-09T11:30:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.244+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55afedae1258 s->prefetch_data=0 2019-12-09T11:30:03.242 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.254+0000 7fe32d23dec0 10 manifest: total_size = 11534336 2019-12-09T11:30:03.242 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.254+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.225 2019-12-09T11:30:03.242 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.254+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55afedae1258 s->prefetch_data=0 2019-12-09T11:30:03.242 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.254+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1258 2019-12-09T11:30:03.242 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.254+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:03.347 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:03.347 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:03.347 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:03.347 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:03.347 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:03.348 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:03.348 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:03.349 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:03.349 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:03.349 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:03.349 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:03.349 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-09T11:30:03.349 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-09T11:30:03.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-09T11:30:03.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-09T11:30:03.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.358+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.225 2019-12-09T11:30:03.423 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.435+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:03.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.444+0000 7fe32d23dec0 10 manifest: total_size = 11534336 2019-12-09T11:30:03.433 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.444+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to _2PzDqP6XVOeary0St7tChC6Z-Ef4Cb1 2019-12-09T11:30:03.433 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.444+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:03.433 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.444+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:03.433 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.444+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:03.520 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.532+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:03.520 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.532+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-09T11:30:03.521 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.532+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:03.521 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.532+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-09T11:30:03.521 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.532+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:03.521 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.532+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-09T11:30:03.521 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.532+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _2PzDqP6XVOeary0St7tChC6Z-Ef4Cb1 2019-12-09T11:30:03.566 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.572+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.581+0000 7fe32d23dec0 10 manifest: total_size = 11534336 2019-12-09T11:30:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.581+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to _xH932Hh5DK9axV2IjHLapa6vWYjy-zJ 2019-12-09T11:30:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.581+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.581+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.581+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:03.724 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.735+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:03.724 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.735+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-09T11:30:03.724 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.735+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:03.724 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.735+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-09T11:30:03.725 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.735+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _xH932Hh5DK9axV2IjHLapa6vWYjy-zJ 2019-12-09T11:30:03.812 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.824+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.834+0000 7fe32d23dec0 10 manifest: total_size = 11534336 2019-12-09T11:30:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.834+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.233 2019-12-09T11:30:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.834+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.834+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.834+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:03.960 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:03.960 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:03.960 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:03.960 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:03.960 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:03.961 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:03.961 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:03.961 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:03.961 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:03.961 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:03.961 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:03.961 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-09T11:30:03.962 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-09T11:30:03.962 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-09T11:30:03.962 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-09T11:30:03.962 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:03.971+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.233 2019-12-09T11:30:04.032 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.042+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:04.045 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.056+0000 7fe32d23dec0 10 manifest: total_size = 11534336 2019-12-09T11:30:04.045 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.056+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to _ev4XAcOfOwQRFtB6wAtEy7NM_q7TgDh 2019-12-09T11:30:04.045 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.056+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:04.045 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.056+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:04.045 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.056+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:04.157 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.168+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:04.157 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.168+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-09T11:30:04.158 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.168+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:04.158 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.168+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-09T11:30:04.158 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.168+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:04.158 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.168+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-09T11:30:04.158 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.169+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _ev4XAcOfOwQRFtB6wAtEy7NM_q7TgDh 2019-12-09T11:30:04.215 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.227+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.235+0000 7fe32d23dec0 10 manifest: total_size = 11534336 2019-12-09T11:30:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.235+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.235 2019-12-09T11:30:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.235+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.235+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.235+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:04.332 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:04.332 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:04.332 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:04.334 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:04.334 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-09T11:30:04.334 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-09T11:30:04.334 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-09T11:30:04.334 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-09T11:30:04.334 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.341+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.235 2019-12-09T11:30:04.408 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.420+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:04.417 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.429+0000 7fe32d23dec0 10 manifest: total_size = 11534336 2019-12-09T11:30:04.417 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.429+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to _Py-8m1CvFXRj0wtG7jkNwxPraMKkpQl 2019-12-09T11:30:04.417 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.429+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:04.417 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.429+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:04.418 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.429+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:04.520 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.531+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:04.520 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.531+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-09T11:30:04.520 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.531+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:04.520 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.531+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-09T11:30:04.520 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.531+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _Py-8m1CvFXRj0wtG7jkNwxPraMKkpQl 2019-12-09T11:30:04.609 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.620+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.641+0000 7fe32d23dec0 10 manifest: total_size = 16378 2019-12-09T11:30:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.641+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.242 2019-12-09T11:30:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.641+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.641+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.641+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:04.746 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.758+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2019-12-09T11:30:04.747 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.758+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7671 2019-12-09T11:30:04.747 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.758+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2019-12-09T11:30:04.747 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.758+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2019-12-09T11:30:04.747 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.758+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4197879 part_ofs=7671 rule->part_size=7672 2019-12-09T11:30:04.747 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.758+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=1035 2019-12-09T11:30:04.747 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.758+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2019-12-09T11:30:04.748 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.758+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4205551 part_ofs=15343 rule->part_size=1035 2019-12-09T11:30:04.748 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.758+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=16378 rule->part_size=1035 2019-12-09T11:30:04.748 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.758+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.242 2019-12-09T11:30:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.805+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:04.804 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.816+0000 7fe32d23dec0 10 manifest: total_size = 16378 2019-12-09T11:30:04.804 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.816+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to _qbgjabFzYe0TlXR30sFF9QVeZHIUQUz 2019-12-09T11:30:04.804 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.816+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:04.805 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.816+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:04.805 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.816+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:04.937 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.949+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:04.937 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.949+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=0 rule->part_size=0 2019-12-09T11:30:04.937 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:04.949+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _qbgjabFzYe0TlXR30sFF9QVeZHIUQUz 2019-12-09T11:30:05.007 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.019+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.027+0000 7fe32d23dec0 10 manifest: total_size = 16378 2019-12-09T11:30:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.027+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to _GieuXIrkKzlZCNpYePuTSIkUAa8d1JJ 2019-12-09T11:30:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.027+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.027+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.027+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:05.124 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.136+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:05.124 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.136+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=0 rule->part_size=0 2019-12-09T11:30:05.124 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.136+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _GieuXIrkKzlZCNpYePuTSIkUAa8d1JJ 2019-12-09T11:30:05.184 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.195+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:05.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.207+0000 7fe32d23dec0 10 manifest: total_size = 16378 2019-12-09T11:30:05.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.207+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.245 2019-12-09T11:30:05.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.207+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:05.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.207+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:05.197 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.207+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 2019-12-09T11:30:05.317 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.328+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2019-12-09T11:30:05.317 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.328+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7671 2019-12-09T11:30:05.317 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.328+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2019-12-09T11:30:05.317 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.328+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2019-12-09T11:30:05.318 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.328+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4197879 part_ofs=7671 rule->part_size=7672 2019-12-09T11:30:05.318 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.328+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=1035 2019-12-09T11:30:05.318 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.328+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2019-12-09T11:30:05.318 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.328+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4205551 part_ofs=15343 rule->part_size=1035 2019-12-09T11:30:05.318 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.328+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=16378 rule->part_size=1035 2019-12-09T11:30:05.318 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.328+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.245 2019-12-09T11:30:05.380 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.391+0000 7fe32d23dec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9]) start _multipart_[] num_entries 1001 2019-12-09T11:30:05.380 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.391+0000 7fe32d23dec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T11:30:05.399 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.411+0000 7fe32d23dec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9])"; objs.size()=0; is_truncated=0 2019-12-09T11:30:05.456 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.468+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65838 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55afedadcdb0 s->prefetch_data=0 2019-12-09T11:30:05.456 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.468+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T11:30:05.467 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.478+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2019-12-09T11:30:05.468 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.479+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-12-09T11:30:05.468 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.479+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:05.468 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.479+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:05.468 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.479+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2019-12-09T11:30:05.468 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.479+0000 7fe32d23dec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2019-12-09T11:30:05.469 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.479+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2019-12-09T11:30:05.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.489+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486851 cookie 94214094569120 notifier 4672 bl.length()=199 2019-12-09T11:30:05.617 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.623+0000 7fe32d23dec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9 from cache 2019-12-09T11:30:05.617 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.623+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=256 2019-12-09T11:30:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:05.636+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486855 cookie 94214094586144 notifier 4672 bl.length()=256 2019-12-09T11:30:06.036 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.047+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55afedadcdb0 s->prefetch_data=0 2019-12-09T11:30:06.036 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.047+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2019-12-09T11:30:06.072 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.083+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2019-12-09T11:30:06.072 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.083+0000 7fe32d23dec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-12-09T11:30:06.072 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.083+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:06.072 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.083+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:06.072 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.083+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T11:30:06.073 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.083+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:06.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.106+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=232 2019-12-09T11:30:06.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.106+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2019-12-09T11:30:06.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.106+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-12-09T11:30:06.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.106+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8 state=0x55afedadd370 s->prefetch_data=0 2019-12-09T11:30:06.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.106+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8 : miss 2019-12-09T11:30:06.106 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.118+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8 info.flags=0x16 2019-12-09T11:30:06.106 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.118+0000 7fe32d23dec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8 to cache LRU end 2019-12-09T11:30:06.106 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.118+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:06.106 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.118+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:30:06.107 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.118+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:06.107 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.118+0000 7fe32d23dec0 20 Read xattr: user.rgw.acl 2019-12-09T11:30:06.107 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.118+0000 7fe32d23dec0 20 Read xattr: user.rgw.idtag 2019-12-09T11:30:06.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.118+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8 : type miss (requested=0x13, cached=0x16) 2019-12-09T11:30:06.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.118+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:06.132 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.136+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=324 2019-12-09T11:30:06.133 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.136+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8 info.flags=0x13 2019-12-09T11:30:06.134 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.136+0000 7fe32d23dec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8 to cache LRU end 2019-12-09T11:30:06.134 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.136+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:06.134 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.136+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:30:06.134 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.136+0000 7fe32d23dec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8 2019-12-09T11:30:06.149 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.160+0000 7fe32d23dec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8]) start [] num_entries 1100 2019-12-09T11:30:06.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.188+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-09T11:30:06.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.188+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-09T11:30:06.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.188+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-09T11:30:06.179 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.188+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:06.193 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.206+0000 7fe32d23dec0 10 manifest: total_size = 11534336 2019-12-09T11:30:06.193 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.206+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.196 2019-12-09T11:30:06.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.206+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:06.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.206+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:06.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.206+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8 2019-12-09T11:30:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:06.359 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:06.359 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:06.359 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-09T11:30:06.359 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-09T11:30:06.359 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-09T11:30:06.359 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-09T11:30:06.359 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.368+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.196 2019-12-09T11:30:06.426 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.439+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.448+0000 7fe32d23dec0 10 manifest: total_size = 11534336 2019-12-09T11:30:06.436 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.448+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.203 2019-12-09T11:30:06.436 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.448+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:06.436 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.448+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:06.436 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.448+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8 2019-12-09T11:30:06.529 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:06.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:06.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:06.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:06.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-09T11:30:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T11:30:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-09T11:30:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-09T11:30:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-09T11:30:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-09T11:30:06.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-09T11:30:06.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.541+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.203 2019-12-09T11:30:06.586 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.591+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:06.587 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.600+0000 7fe32d23dec0 10 manifest: total_size = 1140 2019-12-09T11:30:06.587 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.600+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.210 2019-12-09T11:30:06.587 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.600+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:06.588 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.600+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:06.588 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.600+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8 2019-12-09T11:30:06.685 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.697+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-09T11:30:06.685 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.697+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=515 2019-12-09T11:30:06.685 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.697+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-12-09T11:30:06.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.697+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-09T11:30:06.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.697+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4190723 part_ofs=515 rule->part_size=515 2019-12-09T11:30:06.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.697+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=110 2019-12-09T11:30:06.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.697+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=110 rules.size()=2 2019-12-09T11:30:06.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.697+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): stripe_ofs=4191238 part_ofs=1030 rule->part_size=110 2019-12-09T11:30:06.687 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.697+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=1140 rule->part_size=110 2019-12-09T11:30:06.687 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.697+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.210 2019-12-09T11:30:06.744 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.756+0000 7fe32d23dec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8]) start _multipart_[] num_entries 1001 2019-12-09T11:30:06.744 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.756+0000 7fe32d23dec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T11:30:06.753 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.766+0000 7fe32d23dec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8])"; objs.size()=0; is_truncated=0 2019-12-09T11:30:06.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.835+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65838 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55afedadd070 s->prefetch_data=0 2019-12-09T11:30:06.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.835+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T11:30:06.835 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.847+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2019-12-09T11:30:06.835 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.847+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-12-09T11:30:06.835 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.847+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:06.835 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.847+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:06.836 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.847+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2019-12-09T11:30:06.836 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.847+0000 7fe32d23dec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2019-12-09T11:30:06.836 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.847+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2019-12-09T11:30:06.852 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:06.863+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486856 cookie 94214094586144 notifier 4672 bl.length()=194 2019-12-09T11:30:07.070 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.083+0000 7fe32d23dec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8 from cache 2019-12-09T11:30:07.070 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.083+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=251 2019-12-09T11:30:07.083 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.090+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486857 cookie 94214094586144 notifier 4672 bl.length()=251 2019-12-09T11:30:07.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.509+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55afedadd370 s->prefetch_data=0 2019-12-09T11:30:07.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.509+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2019-12-09T11:30:07.506 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.519+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2019-12-09T11:30:07.506 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.519+0000 7fe32d23dec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-12-09T11:30:07.507 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.519+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:07.507 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.519+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:07.507 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.519+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T11:30:07.507 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.519+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.531+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=222 2019-12-09T11:30:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.531+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2019-12-09T11:30:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.531+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-12-09T11:30:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.531+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6 state=0x55afedadcdb0 s->prefetch_data=0 2019-12-09T11:30:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.531+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6 : miss 2019-12-09T11:30:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.549+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6 info.flags=0x16 2019-12-09T11:30:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.549+0000 7fe32d23dec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6 to cache LRU end 2019-12-09T11:30:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.549+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.549+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:30:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.549+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.549+0000 7fe32d23dec0 20 Read xattr: user.rgw.acl 2019-12-09T11:30:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.549+0000 7fe32d23dec0 20 Read xattr: user.rgw.idtag 2019-12-09T11:30:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.549+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6 : type miss (requested=0x13, cached=0x16) 2019-12-09T11:30:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.549+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:07.554 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.566+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=314 2019-12-09T11:30:07.554 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.566+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6 info.flags=0x13 2019-12-09T11:30:07.554 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.566+0000 7fe32d23dec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6 to cache LRU end 2019-12-09T11:30:07.554 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.566+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:07.554 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.566+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:30:07.555 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.566+0000 7fe32d23dec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6 2019-12-09T11:30:07.571 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.583+0000 7fe32d23dec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6]) start [] num_entries 1100 2019-12-09T11:30:07.596 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.608+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-09T11:30:07.596 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.608+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-09T11:30:07.596 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.608+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-09T11:30:07.596 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.608+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:07.621 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.628+0000 7fe32d23dec0 10 manifest: total_size = 10485760 2019-12-09T11:30:07.621 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.628+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.84 2019-12-09T11:30:07.621 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.628+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:07.621 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.628+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1cc8 2019-12-09T11:30:07.621 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.628+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6 2019-12-09T11:30:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.788+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.788+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-09T11:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.788+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.788+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-09T11:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.788+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.788+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-12-09T11:30:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.788+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.84 2019-12-09T11:30:07.835 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.848+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.860+0000 7fe32d23dec0 10 manifest: total_size = 10485760 2019-12-09T11:30:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.860+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.85 2019-12-09T11:30:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.860+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.860+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1cc8 2019-12-09T11:30:07.849 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.860+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6 2019-12-09T11:30:07.956 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.967+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:07.956 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.967+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-09T11:30:07.956 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.967+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:07.956 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.967+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-09T11:30:07.956 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.967+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T11:30:07.956 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.967+0000 7fe32d23dec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-12-09T11:30:07.957 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:07.967+0000 7fe32d23dec0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.85 2019-12-09T11:30:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.028+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.037+0000 7fe32d23dec0 10 manifest: total_size = 53505 2019-12-09T11:30:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.037+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.86 2019-12-09T11:30:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.037+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.037+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1cc8 2019-12-09T11:30:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.037+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6 2019-12-09T11:30:08.249 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.261+0000 7fe32d23dec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6]) start _multipart_[] num_entries 1001 2019-12-09T11:30:08.249 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.261+0000 7fe32d23dec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T11:30:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.323+0000 7fe32d23dec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6])"; objs.size()=0; is_truncated=0 2019-12-09T11:30:08.365 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.377+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65838 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55afedadcdb0 s->prefetch_data=0 2019-12-09T11:30:08.365 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.378+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T11:30:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.387+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2019-12-09T11:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.387+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-12-09T11:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.387+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.387+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.387+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2019-12-09T11:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.387+0000 7fe32d23dec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2019-12-09T11:30:08.375 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.387+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2019-12-09T11:30:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.396+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486858 cookie 94214094567216 notifier 4672 bl.length()=184 2019-12-09T11:30:08.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.792+0000 7fe32d23dec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6 from cache 2019-12-09T11:30:08.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.792+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=241 2019-12-09T11:30:08.790 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:08.802+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486859 cookie 94214094567216 notifier 4672 bl.length()=241 2019-12-09T11:30:09.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.532+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55afedadcdb0 s->prefetch_data=0 2019-12-09T11:30:09.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.532+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2019-12-09T11:30:09.529 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.542+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2019-12-09T11:30:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.542+0000 7fe32d23dec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-12-09T11:30:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.542+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.542+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.542+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T11:30:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.542+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.555+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-09T11:30:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.555+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2019-12-09T11:30:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.555+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-12-09T11:30:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.555+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 state=0x55afedadd370 s->prefetch_data=0 2019-12-09T11:30:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.555+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 : miss 2019-12-09T11:30:09.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.588+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 info.flags=0x16 2019-12-09T11:30:09.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.588+0000 7fe32d23dec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 to cache LRU end 2019-12-09T11:30:09.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.588+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:09.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.588+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:30:09.577 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.588+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:09.577 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.588+0000 7fe32d23dec0 20 Read xattr: user.rgw.acl 2019-12-09T11:30:09.577 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.588+0000 7fe32d23dec0 20 Read xattr: user.rgw.idtag 2019-12-09T11:30:09.577 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.588+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 : type miss (requested=0x13, cached=0x16) 2019-12-09T11:30:09.577 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.588+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:09.617 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.630+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-09T11:30:09.618 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.630+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 info.flags=0x13 2019-12-09T11:30:09.618 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.630+0000 7fe32d23dec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 to cache LRU end 2019-12-09T11:30:09.618 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.630+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:09.618 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.630+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:30:09.618 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.630+0000 7fe32d23dec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 2019-12-09T11:30:09.640 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.652+0000 7fe32d23dec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10]) start [] num_entries 1100 2019-12-09T11:30:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.678+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-12-09T11:30:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.678+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-12-09T11:30:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.678+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-12-09T11:30:09.667 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.678+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-12-09T11:30:09.667 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.678+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.698+0000 7fe32d23dec0 10 manifest: total_size = 4134 2019-12-09T11:30:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.698+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.305 2019-12-09T11:30:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.698+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.698+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1cc8 2019-12-09T11:30:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.698+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 2019-12-09T11:30:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.859+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.887+0000 7fe32d23dec0 10 manifest: total_size = 1035 2019-12-09T11:30:09.875 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.887+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.307 2019-12-09T11:30:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.887+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.887+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1cc8 2019-12-09T11:30:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:09.887+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 2019-12-09T11:30:09.998 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.010+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:10.010 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.021+0000 7fe32d23dec0 10 manifest: total_size = 1048576 2019-12-09T11:30:10.011 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.021+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.306 2019-12-09T11:30:10.011 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.021+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:10.011 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.021+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1cc8 2019-12-09T11:30:10.011 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.021+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 2019-12-09T11:30:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.154+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:10.152 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.165+0000 7fe32d23dec0 10 manifest: total_size = 110 2019-12-09T11:30:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.165+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.304 2019-12-09T11:30:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.165+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55afedae1cc8 s->prefetch_data=0 2019-12-09T11:30:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.165+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1cc8 2019-12-09T11:30:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.165+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 2019-12-09T11:30:10.287 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.299+0000 7fe32d23dec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10]) start _multipart_[] num_entries 1001 2019-12-09T11:30:10.287 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.299+0000 7fe32d23dec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T11:30:10.335 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.347+0000 7fe32d23dec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10])"; objs.size()=0; is_truncated=0 2019-12-09T11:30:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.399+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65838 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55afedadcdb0 s->prefetch_data=0 2019-12-09T11:30:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.399+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T11:30:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.423+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2019-12-09T11:30:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.423+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-12-09T11:30:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.423+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.423+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.423+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2019-12-09T11:30:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.424+0000 7fe32d23dec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2019-12-09T11:30:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.424+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-12-09T11:30:10.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.443+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486849 cookie 94214094563728 notifier 4672 bl.length()=181 2019-12-09T11:30:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.823+0000 7fe32d23dec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.10 from cache 2019-12-09T11:30:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.823+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=239 2019-12-09T11:30:10.820 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.832+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486860 cookie 94214094567216 notifier 4672 bl.length()=239 2019-12-09T11:30:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:10.983+0000 7fe2eafdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T11:30:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.821+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55afedadcdb0 s->prefetch_data=0 2019-12-09T11:30:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.821+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2019-12-09T11:30:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.835+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2019-12-09T11:30:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.835+0000 7fe32d23dec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-12-09T11:30:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.835+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.835+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.835+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2019-12-09T11:30:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.835+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.848+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-09T11:30:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.848+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2019-12-09T11:30:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.848+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-12-09T11:30:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.848+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 state=0x55afedadd370 s->prefetch_data=0 2019-12-09T11:30:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.848+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 : miss 2019-12-09T11:30:11.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.871+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 info.flags=0x16 2019-12-09T11:30:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.871+0000 7fe32d23dec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 to cache LRU end 2019-12-09T11:30:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.871+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.871+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:30:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.871+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.871+0000 7fe32d23dec0 20 Read xattr: user.rgw.acl 2019-12-09T11:30:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.871+0000 7fe32d23dec0 20 Read xattr: user.rgw.idtag 2019-12-09T11:30:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.871+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 : type miss (requested=0x13, cached=0x16) 2019-12-09T11:30:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.871+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:11.887 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.899+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-09T11:30:11.887 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.899+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 info.flags=0x13 2019-12-09T11:30:11.887 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.899+0000 7fe32d23dec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 to cache LRU end 2019-12-09T11:30:11.887 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.899+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:11.887 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.899+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:30:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.899+0000 7fe32d23dec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 2019-12-09T11:30:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.916+0000 7fe32d23dec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11]) start [] num_entries 1100 2019-12-09T11:30:11.936 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.948+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-12-09T11:30:11.936 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.948+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-12-09T11:30:11.936 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.948+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-12-09T11:30:11.936 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.948+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-12-09T11:30:11.936 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.948+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:11.955 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.966+0000 7fe32d23dec0 10 manifest: total_size = 527 2019-12-09T11:30:11.955 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.966+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.312 2019-12-09T11:30:11.955 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.966+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:11.955 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.966+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:11.955 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:11.966+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 2019-12-09T11:30:12.119 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.131+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:12.145 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.157+0000 7fe32d23dec0 10 manifest: total_size = 2078 2019-12-09T11:30:12.145 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.157+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.314 2019-12-09T11:30:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.157+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.157+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.157+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 2019-12-09T11:30:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.304+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:12.305 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.317+0000 7fe32d23dec0 10 manifest: total_size = 527 2019-12-09T11:30:12.306 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.317+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.313 2019-12-09T11:30:12.306 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.317+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:12.306 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.317+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:12.306 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.317+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 2019-12-09T11:30:12.451 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.463+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:12.481 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.486+0000 7fe32d23dec0 10 manifest: total_size = 527 2019-12-09T11:30:12.481 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.486+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.311 2019-12-09T11:30:12.481 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.486+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55afedae1958 s->prefetch_data=0 2019-12-09T11:30:12.481 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.486+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afedae1958 2019-12-09T11:30:12.481 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.486+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 2019-12-09T11:30:12.588 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.600+0000 7fe32d23dec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.2[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11]) start _multipart_[] num_entries 1001 2019-12-09T11:30:12.588 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.600+0000 7fe32d23dec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T11:30:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.654+0000 7fe32d23dec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11])"; objs.size()=0; is_truncated=0 2019-12-09T11:30:12.701 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.713+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65838 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55afedae1530 s->prefetch_data=0 2019-12-09T11:30:12.702 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.713+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2019-12-09T11:30:12.713 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.725+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2019-12-09T11:30:12.714 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.725+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-12-09T11:30:12.714 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.725+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:12.714 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.725+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:12.714 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.725+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2019-12-09T11:30:12.714 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.725+0000 7fe32d23dec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2019-12-09T11:30:12.714 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.725+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-12-09T11:30:12.725 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.737+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486850 cookie 94214094563728 notifier 4672 bl.length()=181 2019-12-09T11:30:12.804 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.816+0000 7fe32d23dec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.11 from cache 2019-12-09T11:30:12.804 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.816+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=239 2019-12-09T11:30:12.818 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:12.830+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486861 cookie 94214094567216 notifier 4672 bl.length()=239 2019-12-09T11:30:13.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.441+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55afedae1530 s->prefetch_data=0 2019-12-09T11:30:13.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.441+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2019-12-09T11:30:13.439 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.449+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2019-12-09T11:30:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.449+0000 7fe32d23dec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-12-09T11:30:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.449+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.449+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.449+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2019-12-09T11:30:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.450+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.463+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-09T11:30:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.463+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2019-12-09T11:30:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.463+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-12-09T11:30:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.463+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65e80 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 state=0x55afedae31f0 s->prefetch_data=0 2019-12-09T11:30:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.463+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 : miss 2019-12-09T11:30:13.461 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.474+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 info.flags=0x16 2019-12-09T11:30:13.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.474+0000 7fe32d23dec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 to cache LRU end 2019-12-09T11:30:13.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.474+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:13.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.474+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:30:13.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.474+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:13.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.474+0000 7fe32d23dec0 20 Read xattr: user.rgw.acl 2019-12-09T11:30:13.463 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.474+0000 7fe32d23dec0 20 Read xattr: user.rgw.idtag 2019-12-09T11:30:13.463 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.474+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 : type miss (requested=0x13, cached=0x16) 2019-12-09T11:30:13.463 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.474+0000 7fe32d23dec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:13.487 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.500+0000 7fe32d23dec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-09T11:30:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.500+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 info.flags=0x13 2019-12-09T11:30:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.500+0000 7fe32d23dec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 to cache LRU end 2019-12-09T11:30:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.500+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.500+0000 7fe32d23dec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T11:30:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.500+0000 7fe32d23dec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 2019-12-09T11:30:13.508 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.520+0000 7fe32d23dec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12]) start [] num_entries 1100 2019-12-09T11:30:13.544 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.556+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-12-09T11:30:13.544 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.556+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-12-09T11:30:13.545 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.556+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-12-09T11:30:13.545 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.556+0000 7fe32d23dec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-12-09T11:30:13.545 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.556+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55afeda44e18 s->prefetch_data=0 2019-12-09T11:30:13.564 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.576+0000 7fe32d23dec0 10 manifest: total_size = 0 2019-12-09T11:30:13.564 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.576+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.319 2019-12-09T11:30:13.564 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.576+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55afeda44e18 s->prefetch_data=0 2019-12-09T11:30:13.564 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.576+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afeda44e18 2019-12-09T11:30:13.564 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.576+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 2019-12-09T11:30:13.744 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.756+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55afeda44e18 s->prefetch_data=0 2019-12-09T11:30:13.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.769+0000 7fe32d23dec0 10 manifest: total_size = 0 2019-12-09T11:30:13.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.769+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.321 2019-12-09T11:30:13.758 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.769+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55afeda44e18 s->prefetch_data=0 2019-12-09T11:30:13.758 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.769+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afeda44e18 2019-12-09T11:30:13.758 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.769+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 2019-12-09T11:30:13.945 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.958+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55afeda44e18 s->prefetch_data=0 2019-12-09T11:30:13.959 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.971+0000 7fe32d23dec0 10 manifest: total_size = 0 2019-12-09T11:30:13.959 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.971+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.320 2019-12-09T11:30:13.959 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.971+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55afeda44e18 s->prefetch_data=0 2019-12-09T11:30:13.959 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.971+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afeda44e18 2019-12-09T11:30:13.959 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:13.971+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 2019-12-09T11:30:14.126 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.138+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55afeda44e18 s->prefetch_data=0 2019-12-09T11:30:14.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.149+0000 7fe32d23dec0 10 manifest: total_size = 0 2019-12-09T11:30:14.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.149+0000 7fe32d23dec0 20 get_obj_state: setting s->obj_tag to eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.318 2019-12-09T11:30:14.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.149+0000 7fe32d23dec0 20 get_obj_state: rctx=0x7fffc7b65ea0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55afeda44e18 s->prefetch_data=0 2019-12-09T11:30:14.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.149+0000 7fe32d23dec0 20 prepare_atomic_modification: state is not atomic. state=0x55afeda44e18 2019-12-09T11:30:14.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.149+0000 7fe32d23dec0 20 bucket index object: default.rgw.buckets.index:.dir.eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 2019-12-09T11:30:14.276 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.287+0000 7fe32d23dec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.3[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12]) start _multipart_[] num_entries 1001 2019-12-09T11:30:14.276 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.287+0000 7fe32d23dec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T11:30:14.351 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.362+0000 7fe32d23dec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12])"; objs.size()=0; is_truncated=0 2019-12-09T11:30:14.411 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.422+0000 7fe32d23dec0 20 get_system_obj_state: rctx=0x7fffc7b65838 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55afedae1530 s->prefetch_data=0 2019-12-09T11:30:14.411 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.422+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2019-12-09T11:30:14.419 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.430+0000 7fe32d23dec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2019-12-09T11:30:14.420 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.430+0000 7fe32d23dec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-12-09T11:30:14.420 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.430+0000 7fe32d23dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T11:30:14.420 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.430+0000 7fe32d23dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T11:30:14.420 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.430+0000 7fe32d23dec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2019-12-09T11:30:14.420 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.430+0000 7fe32d23dec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2019-12-09T11:30:14.420 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.430+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-12-09T11:30:14.436 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.438+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486851 cookie 94214094563728 notifier 4672 bl.length()=181 2019-12-09T11:30:14.987 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.998+0000 7fe32d23dec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.12 from cache 2019-12-09T11:30:14.987 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:14.998+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=239 2019-12-09T11:30:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:15.009+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486862 cookie 94214094567216 notifier 4672 bl.length()=239 2019-12-09T11:30:15.730 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:15.733+0000 7fe32d23dec0 10 removing key index: RJHWBNWKKMXDYLDLYTIY 2019-12-09T11:30:15.730 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:15.733+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=170 2019-12-09T11:30:15.735 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:15.745+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486852 cookie 94214094569120 notifier 4672 bl.length()=170 2019-12-09T11:30:15.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:15.904+0000 7fe32d23dec0 10 removing email index: ragweed.client.0+test@test.test 2019-12-09T11:30:15.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:15.904+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2019-12-09T11:30:15.918 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:15.913+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486863 cookie 94214094567216 notifier 4672 bl.length()=182 2019-12-09T11:30:16.229 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:16.240+0000 7fe32d23dec0 10 removing user buckets index 2019-12-09T11:30:16.230 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:16.240+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2019-12-09T11:30:16.240 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:16.251+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486864 cookie 94214094586144 notifier 4672 bl.length()=173 2019-12-09T11:30:16.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:16.654+0000 7fe32d23dec0 10 removing user index: ragweed.client.0 2019-12-09T11:30:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:16.654+0000 7fe32d23dec0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2019-12-09T11:30:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:16.654+0000 7fe32d23dec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2019-12-09T11:30:16.658 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:16.669+0000 7fe2fb7fe700 10 RGWWatcher::handle_notify() notify_id 592705486855 cookie 94214094584048 notifier 4672 bl.length()=165 2019-12-09T11:30:17.076 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:17.087+0000 7fe32d23dec0 20 remove_watcher() i=0 2019-12-09T11:30:17.076 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:17.087+0000 7fe32d23dec0 2 removed watcher, disabling cache 2019-12-09T11:30:17.107 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:17.118+0000 7fe32d23dec0 20 remove_watcher() i=1 2019-12-09T11:30:17.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:17.148+0000 7fe32d23dec0 20 remove_watcher() i=2 2019-12-09T11:30:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:17.209+0000 7fe32d23dec0 20 remove_watcher() i=3 2019-12-09T11:30:17.241 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:17.251+0000 7fe32d23dec0 20 remove_watcher() i=4 2019-12-09T11:30:17.288 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:17.299+0000 7fe32d23dec0 20 remove_watcher() i=5 2019-12-09T11:30:17.329 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:17.340+0000 7fe32d23dec0 20 remove_watcher() i=6 2019-12-09T11:30:17.378 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:17.389+0000 7fe32d23dec0 20 remove_watcher() i=7 2019-12-09T11:30:17.385 INFO:tasks.ragweed:Removing ragweed... 2019-12-09T11:30:17.386 INFO:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/ragweed 2019-12-09T11:30:17.481 INFO:teuthology.run_tasks:Running task s3tests-java... 2019-12-09T11:30:17.670 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2019-12-09T11:30:17.671 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2019-12-09T11:30:17.671 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2019-12-09T11:30:17.671 INFO:teuthology.orchestra.run.smithi146:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2019-12-09T11:30:17.732 INFO:teuthology.orchestra.run.smithi146.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2019-12-09T11:30:21.581 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2019-12-09T11:30:21.581 INFO:teuthology.orchestra.run.smithi146:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2019-12-09T11:30:23.856 INFO:teuthology.orchestra.run.smithi146.stdout: Gradle will be installed under /opt/gradle 2019-12-09T11:30:23.913 INFO:teuthology.orchestra.run.smithi146.stderr:--2019-12-09 11:30:23-- https://services.gradle.org/distributions/gradle-4.7-bin.zip 2019-12-09T11:30:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.191.9, 104.18.190.9, 2606:4700::6812:be09, ... 2019-12-09T11:30:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.191.9|:443... connected. 2019-12-09T11:30:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2019-12-09T11:30:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip [following] 2019-12-09T11:30:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:--2019-12-09 11:30:23-- https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip 2019-12-09T11:30:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.160.20, 104.17.159.20, 2606:4700::6811:a014, ... 2019-12-09T11:30:24.001 INFO:teuthology.orchestra.run.smithi146.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.160.20|:443... connected. 2019-12-09T11:30:24.036 INFO:teuthology.orchestra.run.smithi146.stderr:HTTP request sent, awaiting response... 200 OK 2019-12-09T11:30:24.036 INFO:teuthology.orchestra.run.smithi146.stderr:Length: 75323957 (72M) [application/zip] 2019-12-09T11:30:24.036 INFO:teuthology.orchestra.run.smithi146.stderr:Saving to: ‘gradle-4.7-bin.zip’ 2019-12-09T11:30:24.036 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T11:30:24.043 INFO:teuthology.orchestra.run.smithi146.stderr: 0K .......... .......... .......... .......... .......... 0% 6.84M 10s 2019-12-09T11:30:24.047 INFO:teuthology.orchestra.run.smithi146.stderr: 50K .......... .......... .......... .......... .......... 0% 101M 6s 2019-12-09T11:30:24.049 INFO:teuthology.orchestra.run.smithi146.stderr: 100K .......... .......... .......... .......... .......... 0% 7.28M 7s 2019-12-09T11:30:24.049 INFO:teuthology.orchestra.run.smithi146.stderr: 150K .......... .......... .......... .......... .......... 0% 61.8M 6s 2019-12-09T11:30:24.051 INFO:teuthology.orchestra.run.smithi146.stderr: 200K .......... .......... .......... .......... .......... 0% 170M 5s 2019-12-09T11:30:24.052 INFO:teuthology.orchestra.run.smithi146.stderr: 250K .......... .......... .......... .......... .......... 0% 228M 4s 2019-12-09T11:30:24.063 INFO:teuthology.orchestra.run.smithi146.stderr: 300K .......... .......... .......... .......... .......... 0% 7.53M 5s 2019-12-09T11:30:24.063 INFO:teuthology.orchestra.run.smithi146.stderr: 350K .......... .......... .......... .......... .......... 0% 110M 4s 2019-12-09T11:30:24.063 INFO:teuthology.orchestra.run.smithi146.stderr: 400K .......... .......... .......... .......... .......... 0% 141M 4s 2019-12-09T11:30:24.063 INFO:teuthology.orchestra.run.smithi146.stderr: 450K .......... .......... .......... .......... .......... 0% 159M 3s 2019-12-09T11:30:24.064 INFO:teuthology.orchestra.run.smithi146.stderr: 500K .......... .......... .......... .......... .......... 0% 153M 3s 2019-12-09T11:30:24.073 INFO:teuthology.orchestra.run.smithi146.stderr: 550K .......... .......... .......... .......... .......... 0% 113M 3s 2019-12-09T11:30:24.073 INFO:teuthology.orchestra.run.smithi146.stderr: 600K .......... .......... .......... .......... .......... 0% 136M 3s 2019-12-09T11:30:24.073 INFO:teuthology.orchestra.run.smithi146.stderr: 650K .......... .......... .......... .......... .......... 0% 142M 3s 2019-12-09T11:30:24.073 INFO:teuthology.orchestra.run.smithi146.stderr: 700K .......... .......... .......... .......... .......... 1% 10.7M 3s 2019-12-09T11:30:24.074 INFO:teuthology.orchestra.run.smithi146.stderr: 750K .......... .......... .......... .......... .......... 1% 118M 3s 2019-12-09T11:30:24.074 INFO:teuthology.orchestra.run.smithi146.stderr: 800K .......... .......... .......... .......... .......... 1% 135M 3s 2019-12-09T11:30:24.074 INFO:teuthology.orchestra.run.smithi146.stderr: 850K .......... .......... .......... .......... .......... 1% 119M 2s 2019-12-09T11:30:24.074 INFO:teuthology.orchestra.run.smithi146.stderr: 900K .......... .......... .......... .......... .......... 1% 139M 2s 2019-12-09T11:30:24.074 INFO:teuthology.orchestra.run.smithi146.stderr: 950K .......... .......... .......... .......... .......... 1% 147M 2s 2019-12-09T11:30:24.074 INFO:teuthology.orchestra.run.smithi146.stderr: 1000K .......... .......... .......... .......... .......... 1% 124M 2s 2019-12-09T11:30:24.074 INFO:teuthology.orchestra.run.smithi146.stderr: 1050K .......... .......... .......... .......... .......... 1% 115M 2s 2019-12-09T11:30:24.075 INFO:teuthology.orchestra.run.smithi146.stderr: 1100K .......... .......... .......... .......... .......... 1% 143M 2s 2019-12-09T11:30:25.419 INFO:teuthology.orchestra.run.smithi146.stderr: 1150K .......... .......... .......... .......... .......... 1% 99.7M 2s 2019-12-09T11:30:25.419 INFO:teuthology.orchestra.run.smithi146.stderr: 1200K .......... .......... .......... .......... .......... 1% 128M 2s 2019-12-09T11:30:25.419 INFO:teuthology.orchestra.run.smithi146.stderr: 1250K .......... .......... .......... .......... .......... 1% 146M 2s 2019-12-09T11:30:25.419 INFO:teuthology.orchestra.run.smithi146.stderr: 1300K .......... .......... .......... .......... .......... 1% 116M 2s 2019-12-09T11:30:25.419 INFO:teuthology.orchestra.run.smithi146.stderr: 1350K .......... .......... .......... .......... .......... 1% 145M 2s 2019-12-09T11:30:25.420 INFO:teuthology.orchestra.run.smithi146.stderr: 1400K .......... .......... .......... .......... .......... 1% 118M 2s 2019-12-09T11:30:25.420 INFO:teuthology.orchestra.run.smithi146.stderr: 1450K .......... .......... .......... .......... .......... 2% 132M 2s 2019-12-09T11:30:25.420 INFO:teuthology.orchestra.run.smithi146.stderr: 1500K .......... .......... .......... .......... .......... 2% 176M 2s 2019-12-09T11:30:25.420 INFO:teuthology.orchestra.run.smithi146.stderr: 1550K .......... .......... .......... .......... .......... 2% 32.4M 2s 2019-12-09T11:30:25.420 INFO:teuthology.orchestra.run.smithi146.stderr: 1600K .......... .......... .......... .......... .......... 2% 100M 2s 2019-12-09T11:30:25.420 INFO:teuthology.orchestra.run.smithi146.stderr: 1650K .......... .......... .......... .......... .......... 2% 220M 2s 2019-12-09T11:30:25.421 INFO:teuthology.orchestra.run.smithi146.stderr: 1700K .......... .......... .......... .......... .......... 2% 138M 2s 2019-12-09T11:30:25.421 INFO:teuthology.orchestra.run.smithi146.stderr: 1750K .......... .......... .......... .......... .......... 2% 133M 2s 2019-12-09T11:30:25.421 INFO:teuthology.orchestra.run.smithi146.stderr: 1800K .......... .......... .......... .......... .......... 2% 101M 2s 2019-12-09T11:30:25.421 INFO:teuthology.orchestra.run.smithi146.stderr: 1850K .......... .......... .......... .......... .......... 2% 190M 1s 2019-12-09T11:30:25.421 INFO:teuthology.orchestra.run.smithi146.stderr: 1900K .......... .......... .......... .......... .......... 2% 133M 1s 2019-12-09T11:30:25.421 INFO:teuthology.orchestra.run.smithi146.stderr: 1950K .......... .......... .......... .......... .......... 2% 165M 1s 2019-12-09T11:30:25.421 INFO:teuthology.orchestra.run.smithi146.stderr: 2000K .......... .......... .......... .......... .......... 2% 210M 1s 2019-12-09T11:30:25.422 INFO:teuthology.orchestra.run.smithi146.stderr: 2050K .......... .......... .......... .......... .......... 2% 250M 1s 2019-12-09T11:30:25.422 INFO:teuthology.orchestra.run.smithi146.stderr: 2100K .......... .......... .......... .......... .......... 2% 164M 1s 2019-12-09T11:30:25.422 INFO:teuthology.orchestra.run.smithi146.stderr: 2150K .......... .......... .......... .......... .......... 2% 209M 1s 2019-12-09T11:30:25.422 INFO:teuthology.orchestra.run.smithi146.stderr: 2200K .......... .......... .......... .......... .......... 3% 175M 1s 2019-12-09T11:30:25.422 INFO:teuthology.orchestra.run.smithi146.stderr: 2250K .......... .......... .......... .......... .......... 3% 196M 1s 2019-12-09T11:30:25.422 INFO:teuthology.orchestra.run.smithi146.stderr: 2300K .......... .......... .......... .......... .......... 3% 165M 1s 2019-12-09T11:30:25.422 INFO:teuthology.orchestra.run.smithi146.stderr: 2350K .......... .......... .......... .......... .......... 3% 118M 1s 2019-12-09T11:30:25.423 INFO:teuthology.orchestra.run.smithi146.stderr: 2400K .......... .......... .......... .......... .......... 3% 192M 1s 2019-12-09T11:30:25.423 INFO:teuthology.orchestra.run.smithi146.stderr: 2450K .......... .......... .......... .......... .......... 3% 171M 1s 2019-12-09T11:30:25.423 INFO:teuthology.orchestra.run.smithi146.stderr: 2500K .......... .......... .......... .......... .......... 3% 164M 1s 2019-12-09T11:30:25.423 INFO:teuthology.orchestra.run.smithi146.stderr: 2550K .......... .......... .......... .......... .......... 3% 170M 1s 2019-12-09T11:30:25.423 INFO:teuthology.orchestra.run.smithi146.stderr: 2600K .......... .......... .......... .......... .......... 3% 201M 1s 2019-12-09T11:30:25.423 INFO:teuthology.orchestra.run.smithi146.stderr: 2650K .......... .......... .......... .......... .......... 3% 209M 1s 2019-12-09T11:30:25.423 INFO:teuthology.orchestra.run.smithi146.stderr: 2700K .......... .......... .......... .......... .......... 3% 200M 1s 2019-12-09T11:30:25.423 INFO:teuthology.orchestra.run.smithi146.stderr: 2750K .......... .......... .......... .......... .......... 3% 164M 1s 2019-12-09T11:30:25.424 INFO:teuthology.orchestra.run.smithi146.stderr: 2800K .......... .......... .......... .......... .......... 3% 220M 1s 2019-12-09T11:30:25.424 INFO:teuthology.orchestra.run.smithi146.stderr: 2850K .......... .......... .......... .......... .......... 3% 203M 1s 2019-12-09T11:30:25.424 INFO:teuthology.orchestra.run.smithi146.stderr: 2900K .......... .......... .......... .......... .......... 4% 211M 1s 2019-12-09T11:30:25.424 INFO:teuthology.orchestra.run.smithi146.stderr: 2950K .......... .......... .......... .......... .......... 4% 179M 1s 2019-12-09T11:30:25.424 INFO:teuthology.orchestra.run.smithi146.stderr: 3000K .......... .......... .......... .......... .......... 4% 206M 1s 2019-12-09T11:30:25.424 INFO:teuthology.orchestra.run.smithi146.stderr: 3050K .......... .......... .......... .......... .......... 4% 224M 1s 2019-12-09T11:30:25.424 INFO:teuthology.orchestra.run.smithi146.stderr: 3100K .......... .......... .......... .......... .......... 4% 206M 1s 2019-12-09T11:30:25.425 INFO:teuthology.orchestra.run.smithi146.stderr: 3150K .......... .......... .......... .......... .......... 4% 145M 1s 2019-12-09T11:30:25.425 INFO:teuthology.orchestra.run.smithi146.stderr: 3200K .......... .......... .......... .......... .......... 4% 184M 1s 2019-12-09T11:30:25.425 INFO:teuthology.orchestra.run.smithi146.stderr: 3250K .......... .......... .......... .......... .......... 4% 175M 1s 2019-12-09T11:30:25.425 INFO:teuthology.orchestra.run.smithi146.stderr: 3300K .......... .......... .......... .......... .......... 4% 172M 1s 2019-12-09T11:30:25.425 INFO:teuthology.orchestra.run.smithi146.stderr: 3350K .......... .......... .......... .......... .......... 4% 156M 1s 2019-12-09T11:30:25.425 INFO:teuthology.orchestra.run.smithi146.stderr: 3400K .......... .......... .......... .......... .......... 4% 168M 1s 2019-12-09T11:30:25.425 INFO:teuthology.orchestra.run.smithi146.stderr: 3450K .......... .......... .......... .......... .......... 4% 133M 1s 2019-12-09T11:30:25.426 INFO:teuthology.orchestra.run.smithi146.stderr: 3500K .......... .......... .......... .......... .......... 4% 126M 1s 2019-12-09T11:30:25.426 INFO:teuthology.orchestra.run.smithi146.stderr: 3550K .......... .......... .......... .......... .......... 4% 95.3M 1s 2019-12-09T11:30:25.426 INFO:teuthology.orchestra.run.smithi146.stderr: 3600K .......... .......... .......... .......... .......... 4% 123M 1s 2019-12-09T11:30:25.426 INFO:teuthology.orchestra.run.smithi146.stderr: 3650K .......... .......... .......... .......... .......... 5% 125M 1s 2019-12-09T11:30:25.426 INFO:teuthology.orchestra.run.smithi146.stderr: 3700K .......... .......... .......... .......... .......... 5% 122M 1s 2019-12-09T11:30:25.426 INFO:teuthology.orchestra.run.smithi146.stderr: 3750K .......... .......... .......... .......... .......... 5% 111M 1s 2019-12-09T11:30:25.427 INFO:teuthology.orchestra.run.smithi146.stderr: 3800K .......... .......... .......... .......... .......... 5% 148M 1s 2019-12-09T11:30:25.427 INFO:teuthology.orchestra.run.smithi146.stderr: 3850K .......... .......... .......... .......... .......... 5% 153M 1s 2019-12-09T11:30:25.427 INFO:teuthology.orchestra.run.smithi146.stderr: 3900K .......... .......... .......... .......... .......... 5% 187M 1s 2019-12-09T11:30:25.427 INFO:teuthology.orchestra.run.smithi146.stderr: 3950K .......... .......... .......... .......... .......... 5% 172M 1s 2019-12-09T11:30:25.427 INFO:teuthology.orchestra.run.smithi146.stderr: 4000K .......... .......... .......... .......... .......... 5% 202M 1s 2019-12-09T11:30:25.427 INFO:teuthology.orchestra.run.smithi146.stderr: 4050K .......... .......... .......... .......... .......... 5% 171M 1s 2019-12-09T11:30:25.427 INFO:teuthology.orchestra.run.smithi146.stderr: 4100K .......... .......... .......... .......... .......... 5% 206M 1s 2019-12-09T11:30:25.428 INFO:teuthology.orchestra.run.smithi146.stderr: 4150K .......... .......... .......... .......... .......... 5% 189M 1s 2019-12-09T11:30:25.428 INFO:teuthology.orchestra.run.smithi146.stderr: 4200K .......... .......... .......... .......... .......... 5% 188M 1s 2019-12-09T11:30:25.428 INFO:teuthology.orchestra.run.smithi146.stderr: 4250K .......... .......... .......... .......... .......... 5% 218M 1s 2019-12-09T11:30:25.428 INFO:teuthology.orchestra.run.smithi146.stderr: 4300K .......... .......... .......... .......... .......... 5% 208M 1s 2019-12-09T11:30:25.428 INFO:teuthology.orchestra.run.smithi146.stderr: 4350K .......... .......... .......... .......... .......... 5% 160M 1s 2019-12-09T11:30:25.428 INFO:teuthology.orchestra.run.smithi146.stderr: 4400K .......... .......... .......... .......... .......... 6% 200M 1s 2019-12-09T11:30:25.428 INFO:teuthology.orchestra.run.smithi146.stderr: 4450K .......... .......... .......... .......... .......... 6% 204M 1s 2019-12-09T11:30:25.429 INFO:teuthology.orchestra.run.smithi146.stderr: 4500K .......... .......... .......... .......... .......... 6% 217M 1s 2019-12-09T11:30:25.429 INFO:teuthology.orchestra.run.smithi146.stderr: 4550K .......... .......... .......... .......... .......... 6% 188M 1s 2019-12-09T11:30:25.429 INFO:teuthology.orchestra.run.smithi146.stderr: 4600K .......... .......... .......... .......... .......... 6% 174M 1s 2019-12-09T11:30:25.429 INFO:teuthology.orchestra.run.smithi146.stderr: 4650K .......... .......... .......... .......... .......... 6% 182M 1s 2019-12-09T11:30:25.429 INFO:teuthology.orchestra.run.smithi146.stderr: 4700K .......... .......... .......... .......... .......... 6% 215M 1s 2019-12-09T11:30:25.429 INFO:teuthology.orchestra.run.smithi146.stderr: 4750K .......... .......... .......... .......... .......... 6% 182M 1s 2019-12-09T11:30:25.429 INFO:teuthology.orchestra.run.smithi146.stderr: 4800K .......... .......... .......... .......... .......... 6% 203M 1s 2019-12-09T11:30:25.430 INFO:teuthology.orchestra.run.smithi146.stderr: 4850K .......... .......... .......... .......... .......... 6% 184M 1s 2019-12-09T11:30:25.430 INFO:teuthology.orchestra.run.smithi146.stderr: 4900K .......... .......... .......... .......... .......... 6% 201M 1s 2019-12-09T11:30:25.430 INFO:teuthology.orchestra.run.smithi146.stderr: 4950K .......... .......... .......... .......... .......... 6% 186M 1s 2019-12-09T11:30:25.430 INFO:teuthology.orchestra.run.smithi146.stderr: 5000K .......... .......... .......... .......... .......... 6% 196M 1s 2019-12-09T11:30:25.430 INFO:teuthology.orchestra.run.smithi146.stderr: 5050K .......... .......... .......... .......... .......... 6% 204M 1s 2019-12-09T11:30:25.430 INFO:teuthology.orchestra.run.smithi146.stderr: 5100K .......... .......... .......... .......... .......... 7% 207M 1s 2019-12-09T11:30:25.431 INFO:teuthology.orchestra.run.smithi146.stderr: 5150K .......... .......... .......... .......... .......... 7% 178M 1s 2019-12-09T11:30:25.431 INFO:teuthology.orchestra.run.smithi146.stderr: 5200K .......... .......... .......... .......... .......... 7% 211M 1s 2019-12-09T11:30:25.431 INFO:teuthology.orchestra.run.smithi146.stderr: 5250K .......... .......... .......... .......... .......... 7% 211M 1s 2019-12-09T11:30:25.431 INFO:teuthology.orchestra.run.smithi146.stderr: 5300K .......... .......... .......... .......... .......... 7% 199M 1s 2019-12-09T11:30:25.431 INFO:teuthology.orchestra.run.smithi146.stderr: 5350K .......... .......... .......... .......... .......... 7% 182M 1s 2019-12-09T11:30:25.431 INFO:teuthology.orchestra.run.smithi146.stderr: 5400K .......... .......... .......... .......... .......... 7% 214M 1s 2019-12-09T11:30:25.431 INFO:teuthology.orchestra.run.smithi146.stderr: 5450K .......... .......... .......... .......... .......... 7% 212M 1s 2019-12-09T11:30:25.432 INFO:teuthology.orchestra.run.smithi146.stderr: 5500K .......... .......... .......... .......... .......... 7% 214M 1s 2019-12-09T11:30:25.432 INFO:teuthology.orchestra.run.smithi146.stderr: 5550K .......... .......... .......... .......... .......... 7% 184M 1s 2019-12-09T11:30:25.432 INFO:teuthology.orchestra.run.smithi146.stderr: 5600K .......... .......... .......... .......... .......... 7% 215M 1s 2019-12-09T11:30:25.432 INFO:teuthology.orchestra.run.smithi146.stderr: 5650K .......... .......... .......... .......... .......... 7% 226M 1s 2019-12-09T11:30:25.432 INFO:teuthology.orchestra.run.smithi146.stderr: 5700K .......... .......... .......... .......... .......... 7% 223M 1s 2019-12-09T11:30:25.432 INFO:teuthology.orchestra.run.smithi146.stderr: 5750K .......... .......... .......... .......... .......... 7% 182M 1s 2019-12-09T11:30:25.432 INFO:teuthology.orchestra.run.smithi146.stderr: 5800K .......... .......... .......... .......... .......... 7% 222M 1s 2019-12-09T11:30:25.433 INFO:teuthology.orchestra.run.smithi146.stderr: 5850K .......... .......... .......... .......... .......... 8% 222M 1s 2019-12-09T11:30:25.433 INFO:teuthology.orchestra.run.smithi146.stderr: 5900K .......... .......... .......... .......... .......... 8% 226M 1s 2019-12-09T11:30:25.433 INFO:teuthology.orchestra.run.smithi146.stderr: 5950K .......... .......... .......... .......... .......... 8% 203M 1s 2019-12-09T11:30:25.433 INFO:teuthology.orchestra.run.smithi146.stderr: 6000K .......... .......... .......... .......... .......... 8% 226M 1s 2019-12-09T11:30:25.433 INFO:teuthology.orchestra.run.smithi146.stderr: 6050K .......... .......... .......... .......... .......... 8% 214M 1s 2019-12-09T11:30:25.433 INFO:teuthology.orchestra.run.smithi146.stderr: 6100K .......... .......... .......... .......... .......... 8% 213M 1s 2019-12-09T11:30:25.434 INFO:teuthology.orchestra.run.smithi146.stderr: 6150K .......... .......... .......... .......... .......... 8% 185M 1s 2019-12-09T11:30:25.434 INFO:teuthology.orchestra.run.smithi146.stderr: 6200K .......... .......... .......... .......... .......... 8% 215M 1s 2019-12-09T11:30:25.434 INFO:teuthology.orchestra.run.smithi146.stderr: 6250K .......... .......... .......... .......... .......... 8% 195M 1s 2019-12-09T11:30:25.434 INFO:teuthology.orchestra.run.smithi146.stderr: 6300K .......... .......... .......... .......... .......... 8% 220M 1s 2019-12-09T11:30:25.434 INFO:teuthology.orchestra.run.smithi146.stderr: 6350K .......... .......... .......... .......... .......... 8% 195M 1s 2019-12-09T11:30:25.434 INFO:teuthology.orchestra.run.smithi146.stderr: 6400K .......... .......... .......... .......... .......... 8% 227M 1s 2019-12-09T11:30:25.435 INFO:teuthology.orchestra.run.smithi146.stderr: 6450K .......... .......... .......... .......... .......... 8% 204M 1s 2019-12-09T11:30:25.435 INFO:teuthology.orchestra.run.smithi146.stderr: 6500K .......... .......... .......... .......... .......... 8% 211M 1s 2019-12-09T11:30:25.435 INFO:teuthology.orchestra.run.smithi146.stderr: 6550K .......... .......... .......... .......... .......... 8% 161M 1s 2019-12-09T11:30:25.435 INFO:teuthology.orchestra.run.smithi146.stderr: 6600K .......... .......... .......... .......... .......... 9% 196M 1s 2019-12-09T11:30:25.435 INFO:teuthology.orchestra.run.smithi146.stderr: 6650K .......... .......... .......... .......... .......... 9% 198M 1s 2019-12-09T11:30:25.435 INFO:teuthology.orchestra.run.smithi146.stderr: 6700K .......... .......... .......... .......... .......... 9% 220M 1s 2019-12-09T11:30:25.435 INFO:teuthology.orchestra.run.smithi146.stderr: 6750K .......... .......... .......... .......... .......... 9% 187M 1s 2019-12-09T11:30:25.436 INFO:teuthology.orchestra.run.smithi146.stderr: 6800K .......... .......... .......... .......... .......... 9% 218M 1s 2019-12-09T11:30:25.436 INFO:teuthology.orchestra.run.smithi146.stderr: 6850K .......... .......... .......... .......... .......... 9% 208M 1s 2019-12-09T11:30:25.436 INFO:teuthology.orchestra.run.smithi146.stderr: 6900K .......... .......... .......... .......... .......... 9% 215M 1s 2019-12-09T11:30:25.436 INFO:teuthology.orchestra.run.smithi146.stderr: 6950K .......... .......... .......... .......... .......... 9% 184M 1s 2019-12-09T11:30:25.436 INFO:teuthology.orchestra.run.smithi146.stderr: 7000K .......... .......... .......... .......... .......... 9% 239M 1s 2019-12-09T11:30:25.436 INFO:teuthology.orchestra.run.smithi146.stderr: 7050K .......... .......... .......... .......... .......... 9% 223M 1s 2019-12-09T11:30:25.436 INFO:teuthology.orchestra.run.smithi146.stderr: 7100K .......... .......... .......... .......... .......... 9% 225M 1s 2019-12-09T11:30:25.437 INFO:teuthology.orchestra.run.smithi146.stderr: 7150K .......... .......... .......... .......... .......... 9% 188M 1s 2019-12-09T11:30:25.437 INFO:teuthology.orchestra.run.smithi146.stderr: 7200K .......... .......... .......... .......... .......... 9% 217M 1s 2019-12-09T11:30:25.437 INFO:teuthology.orchestra.run.smithi146.stderr: 7250K .......... .......... .......... .......... .......... 9% 238M 1s 2019-12-09T11:30:25.437 INFO:teuthology.orchestra.run.smithi146.stderr: 7300K .......... .......... .......... .......... .......... 9% 201M 1s 2019-12-09T11:30:25.437 INFO:teuthology.orchestra.run.smithi146.stderr: 7350K .......... .......... .......... .......... .......... 10% 191M 1s 2019-12-09T11:30:25.437 INFO:teuthology.orchestra.run.smithi146.stderr: 7400K .......... .......... .......... .......... .......... 10% 243M 1s 2019-12-09T11:30:25.437 INFO:teuthology.orchestra.run.smithi146.stderr: 7450K .......... .......... .......... .......... .......... 10% 241M 1s 2019-12-09T11:30:25.438 INFO:teuthology.orchestra.run.smithi146.stderr: 7500K .......... .......... .......... .......... .......... 10% 241M 1s 2019-12-09T11:30:25.438 INFO:teuthology.orchestra.run.smithi146.stderr: 7550K .......... .......... .......... .......... .......... 10% 198M 1s 2019-12-09T11:30:25.438 INFO:teuthology.orchestra.run.smithi146.stderr: 7600K .......... .......... .......... .......... .......... 10% 204M 1s 2019-12-09T11:30:25.438 INFO:teuthology.orchestra.run.smithi146.stderr: 7650K .......... .......... .......... .......... .......... 10% 206M 1s 2019-12-09T11:30:25.438 INFO:teuthology.orchestra.run.smithi146.stderr: 7700K .......... .......... .......... .......... .......... 10% 236M 1s 2019-12-09T11:30:25.438 INFO:teuthology.orchestra.run.smithi146.stderr: 7750K .......... .......... .......... .......... .......... 10% 170M 1s 2019-12-09T11:30:25.438 INFO:teuthology.orchestra.run.smithi146.stderr: 7800K .......... .......... .......... .......... .......... 10% 194M 1s 2019-12-09T11:30:25.439 INFO:teuthology.orchestra.run.smithi146.stderr: 7850K .......... .......... .......... .......... .......... 10% 236M 1s 2019-12-09T11:30:25.439 INFO:teuthology.orchestra.run.smithi146.stderr: 7900K .......... .......... .......... .......... .......... 10% 238M 1s 2019-12-09T11:30:25.439 INFO:teuthology.orchestra.run.smithi146.stderr: 7950K .......... .......... .......... .......... .......... 10% 188M 1s 2019-12-09T11:30:25.439 INFO:teuthology.orchestra.run.smithi146.stderr: 8000K .......... .......... .......... .......... .......... 10% 231M 1s 2019-12-09T11:30:25.439 INFO:teuthology.orchestra.run.smithi146.stderr: 8050K .......... .......... .......... .......... .......... 11% 225M 1s 2019-12-09T11:30:25.439 INFO:teuthology.orchestra.run.smithi146.stderr: 8100K .......... .......... .......... .......... .......... 11% 239M 1s 2019-12-09T11:30:25.439 INFO:teuthology.orchestra.run.smithi146.stderr: 8150K .......... .......... .......... .......... .......... 11% 195M 1s 2019-12-09T11:30:25.439 INFO:teuthology.orchestra.run.smithi146.stderr: 8200K .......... .......... .......... .......... .......... 11% 221M 1s 2019-12-09T11:30:25.440 INFO:teuthology.orchestra.run.smithi146.stderr: 8250K .......... .......... .......... .......... .......... 11% 237M 1s 2019-12-09T11:30:25.440 INFO:teuthology.orchestra.run.smithi146.stderr: 8300K .......... .......... .......... .......... .......... 11% 231M 1s 2019-12-09T11:30:25.440 INFO:teuthology.orchestra.run.smithi146.stderr: 8350K .......... .......... .......... .......... .......... 11% 213M 1s 2019-12-09T11:30:25.440 INFO:teuthology.orchestra.run.smithi146.stderr: 8400K .......... .......... .......... .......... .......... 11% 230M 1s 2019-12-09T11:30:25.440 INFO:teuthology.orchestra.run.smithi146.stderr: 8450K .......... .......... .......... .......... .......... 11% 215M 1s 2019-12-09T11:30:25.440 INFO:teuthology.orchestra.run.smithi146.stderr: 8500K .......... .......... .......... .......... .......... 11% 214M 1s 2019-12-09T11:30:25.440 INFO:teuthology.orchestra.run.smithi146.stderr: 8550K .......... .......... .......... .......... .......... 11% 176M 1s 2019-12-09T11:30:25.441 INFO:teuthology.orchestra.run.smithi146.stderr: 8600K .......... .......... .......... .......... .......... 11% 238M 1s 2019-12-09T11:30:25.441 INFO:teuthology.orchestra.run.smithi146.stderr: 8650K .......... .......... .......... .......... .......... 11% 226M 1s 2019-12-09T11:30:25.441 INFO:teuthology.orchestra.run.smithi146.stderr: 8700K .......... .......... .......... .......... .......... 11% 224M 1s 2019-12-09T11:30:25.441 INFO:teuthology.orchestra.run.smithi146.stderr: 8750K .......... .......... .......... .......... .......... 11% 195M 1s 2019-12-09T11:30:25.441 INFO:teuthology.orchestra.run.smithi146.stderr: 8800K .......... .......... .......... .......... .......... 12% 222M 1s 2019-12-09T11:30:25.441 INFO:teuthology.orchestra.run.smithi146.stderr: 8850K .......... .......... .......... .......... .......... 12% 214M 1s 2019-12-09T11:30:25.441 INFO:teuthology.orchestra.run.smithi146.stderr: 8900K .......... .......... .......... .......... .......... 12% 204M 1s 2019-12-09T11:30:25.442 INFO:teuthology.orchestra.run.smithi146.stderr: 8950K .......... .......... .......... .......... .......... 12% 182M 1s 2019-12-09T11:30:25.442 INFO:teuthology.orchestra.run.smithi146.stderr: 9000K .......... .......... .......... .......... .......... 12% 193M 1s 2019-12-09T11:30:25.442 INFO:teuthology.orchestra.run.smithi146.stderr: 9050K .......... .......... .......... .......... .......... 12% 210M 1s 2019-12-09T11:30:25.442 INFO:teuthology.orchestra.run.smithi146.stderr: 9100K .......... .......... .......... .......... .......... 12% 187M 1s 2019-12-09T11:30:25.442 INFO:teuthology.orchestra.run.smithi146.stderr: 9150K .......... .......... .......... .......... .......... 12% 175M 1s 2019-12-09T11:30:25.442 INFO:teuthology.orchestra.run.smithi146.stderr: 9200K .......... .......... .......... .......... .......... 12% 175M 1s 2019-12-09T11:30:25.442 INFO:teuthology.orchestra.run.smithi146.stderr: 9250K .......... .......... .......... .......... .......... 12% 219M 1s 2019-12-09T11:30:25.443 INFO:teuthology.orchestra.run.smithi146.stderr: 9300K .......... .......... .......... .......... .......... 12% 258M 1s 2019-12-09T11:30:25.443 INFO:teuthology.orchestra.run.smithi146.stderr: 9350K .......... .......... .......... .......... .......... 12% 191M 1s 2019-12-09T11:30:25.443 INFO:teuthology.orchestra.run.smithi146.stderr: 9400K .......... .......... .......... .......... .......... 12% 217M 1s 2019-12-09T11:30:25.443 INFO:teuthology.orchestra.run.smithi146.stderr: 9450K .......... .......... .......... .......... .......... 12% 226M 1s 2019-12-09T11:30:25.443 INFO:teuthology.orchestra.run.smithi146.stderr: 9500K .......... .......... .......... .......... .......... 12% 245M 1s 2019-12-09T11:30:25.443 INFO:teuthology.orchestra.run.smithi146.stderr: 9550K .......... .......... .......... .......... .......... 13% 219M 1s 2019-12-09T11:30:25.443 INFO:teuthology.orchestra.run.smithi146.stderr: 9600K .......... .......... .......... .......... .......... 13% 250M 1s 2019-12-09T11:30:25.443 INFO:teuthology.orchestra.run.smithi146.stderr: 9650K .......... .......... .......... .......... .......... 13% 222M 1s 2019-12-09T11:30:25.444 INFO:teuthology.orchestra.run.smithi146.stderr: 9700K .......... .......... .......... .......... .......... 13% 237M 1s 2019-12-09T11:30:25.444 INFO:teuthology.orchestra.run.smithi146.stderr: 9750K .......... .......... .......... .......... .......... 13% 182M 1s 2019-12-09T11:30:25.444 INFO:teuthology.orchestra.run.smithi146.stderr: 9800K .......... .......... .......... .......... .......... 13% 230M 1s 2019-12-09T11:30:25.444 INFO:teuthology.orchestra.run.smithi146.stderr: 9850K .......... .......... .......... .......... .......... 13% 232M 1s 2019-12-09T11:30:25.444 INFO:teuthology.orchestra.run.smithi146.stderr: 9900K .......... .......... .......... .......... .......... 13% 245M 1s 2019-12-09T11:30:25.444 INFO:teuthology.orchestra.run.smithi146.stderr: 9950K .......... .......... .......... .......... .......... 13% 215M 1s 2019-12-09T11:30:25.444 INFO:teuthology.orchestra.run.smithi146.stderr: 10000K .......... .......... .......... .......... .......... 13% 249M 1s 2019-12-09T11:30:25.445 INFO:teuthology.orchestra.run.smithi146.stderr: 10050K .......... .......... .......... .......... .......... 13% 236M 1s 2019-12-09T11:30:25.445 INFO:teuthology.orchestra.run.smithi146.stderr: 10100K .......... .......... .......... .......... .......... 13% 251M 1s 2019-12-09T11:30:25.445 INFO:teuthology.orchestra.run.smithi146.stderr: 10150K .......... .......... .......... .......... .......... 13% 201M 1s 2019-12-09T11:30:25.445 INFO:teuthology.orchestra.run.smithi146.stderr: 10200K .......... .......... .......... .......... .......... 13% 238M 0s 2019-12-09T11:30:25.445 INFO:teuthology.orchestra.run.smithi146.stderr: 10250K .......... .......... .......... .......... .......... 14% 246M 0s 2019-12-09T11:30:25.445 INFO:teuthology.orchestra.run.smithi146.stderr: 10300K .......... .......... .......... .......... .......... 14% 248M 0s 2019-12-09T11:30:25.445 INFO:teuthology.orchestra.run.smithi146.stderr: 10350K .......... .......... .......... .......... .......... 14% 210M 0s 2019-12-09T11:30:25.446 INFO:teuthology.orchestra.run.smithi146.stderr: 10400K .......... .......... .......... .......... .......... 14% 231M 0s 2019-12-09T11:30:25.446 INFO:teuthology.orchestra.run.smithi146.stderr: 10450K .......... .......... .......... .......... .......... 14% 252M 0s 2019-12-09T11:30:25.446 INFO:teuthology.orchestra.run.smithi146.stderr: 10500K .......... .......... .......... .......... .......... 14% 251M 0s 2019-12-09T11:30:25.446 INFO:teuthology.orchestra.run.smithi146.stderr: 10550K .......... .......... .......... .......... .......... 14% 201M 0s 2019-12-09T11:30:25.446 INFO:teuthology.orchestra.run.smithi146.stderr: 10600K .......... .......... .......... .......... .......... 14% 225M 0s 2019-12-09T11:30:25.446 INFO:teuthology.orchestra.run.smithi146.stderr: 10650K .......... .......... .......... .......... .......... 14% 238M 0s 2019-12-09T11:30:25.446 INFO:teuthology.orchestra.run.smithi146.stderr: 10700K .......... .......... .......... .......... .......... 14% 245M 0s 2019-12-09T11:30:25.447 INFO:teuthology.orchestra.run.smithi146.stderr: 10750K .......... .......... .......... .......... .......... 14% 206M 0s 2019-12-09T11:30:25.447 INFO:teuthology.orchestra.run.smithi146.stderr: 10800K .......... .......... .......... .......... .......... 14% 172M 0s 2019-12-09T11:30:25.447 INFO:teuthology.orchestra.run.smithi146.stderr: 10850K .......... .......... .......... .......... .......... 14% 225M 0s 2019-12-09T11:30:25.447 INFO:teuthology.orchestra.run.smithi146.stderr: 10900K .......... .......... .......... .......... .......... 14% 183M 0s 2019-12-09T11:30:25.447 INFO:teuthology.orchestra.run.smithi146.stderr: 10950K .......... .......... .......... .......... .......... 14% 147M 0s 2019-12-09T11:30:25.447 INFO:teuthology.orchestra.run.smithi146.stderr: 11000K .......... .......... .......... .......... .......... 15% 221M 0s 2019-12-09T11:30:25.447 INFO:teuthology.orchestra.run.smithi146.stderr: 11050K .......... .......... .......... .......... .......... 15% 232M 0s 2019-12-09T11:30:25.447 INFO:teuthology.orchestra.run.smithi146.stderr: 11100K .......... .......... .......... .......... .......... 15% 253M 0s 2019-12-09T11:30:25.448 INFO:teuthology.orchestra.run.smithi146.stderr: 11150K .......... .......... .......... .......... .......... 15% 230M 0s 2019-12-09T11:30:25.448 INFO:teuthology.orchestra.run.smithi146.stderr: 11200K .......... .......... .......... .......... .......... 15% 237M 0s 2019-12-09T11:30:25.448 INFO:teuthology.orchestra.run.smithi146.stderr: 11250K .......... .......... .......... .......... .......... 15% 233M 0s 2019-12-09T11:30:25.448 INFO:teuthology.orchestra.run.smithi146.stderr: 11300K .......... .......... .......... .......... .......... 15% 228M 0s 2019-12-09T11:30:25.448 INFO:teuthology.orchestra.run.smithi146.stderr: 11350K .......... .......... .......... .......... .......... 15% 144M 0s 2019-12-09T11:30:25.448 INFO:teuthology.orchestra.run.smithi146.stderr: 11400K .......... .......... .......... .......... .......... 15% 205M 0s 2019-12-09T11:30:25.448 INFO:teuthology.orchestra.run.smithi146.stderr: 11450K .......... .......... .......... .......... .......... 15% 224M 0s 2019-12-09T11:30:25.449 INFO:teuthology.orchestra.run.smithi146.stderr: 11500K .......... .......... .......... .......... .......... 15% 216M 0s 2019-12-09T11:30:25.449 INFO:teuthology.orchestra.run.smithi146.stderr: 11550K .......... .......... .......... .......... .......... 15% 208M 0s 2019-12-09T11:30:25.449 INFO:teuthology.orchestra.run.smithi146.stderr: 11600K .......... .......... .......... .......... .......... 15% 254M 0s 2019-12-09T11:30:25.449 INFO:teuthology.orchestra.run.smithi146.stderr: 11650K .......... .......... .......... .......... .......... 15% 253M 0s 2019-12-09T11:30:25.449 INFO:teuthology.orchestra.run.smithi146.stderr: 11700K .......... .......... .......... .......... .......... 15% 227M 0s 2019-12-09T11:30:25.449 INFO:teuthology.orchestra.run.smithi146.stderr: 11750K .......... .......... .......... .......... .......... 16% 192M 0s 2019-12-09T11:30:25.449 INFO:teuthology.orchestra.run.smithi146.stderr: 11800K .......... .......... .......... .......... .......... 16% 228M 0s 2019-12-09T11:30:25.450 INFO:teuthology.orchestra.run.smithi146.stderr: 11850K .......... .......... .......... .......... .......... 16% 235M 0s 2019-12-09T11:30:25.450 INFO:teuthology.orchestra.run.smithi146.stderr: 11900K .......... .......... .......... .......... .......... 16% 249M 0s 2019-12-09T11:30:25.450 INFO:teuthology.orchestra.run.smithi146.stderr: 11950K .......... .......... .......... .......... .......... 16% 216M 0s 2019-12-09T11:30:25.450 INFO:teuthology.orchestra.run.smithi146.stderr: 12000K .......... .......... .......... .......... .......... 16% 244M 0s 2019-12-09T11:30:25.450 INFO:teuthology.orchestra.run.smithi146.stderr: 12050K .......... .......... .......... .......... .......... 16% 251M 0s 2019-12-09T11:30:25.450 INFO:teuthology.orchestra.run.smithi146.stderr: 12100K .......... .......... .......... .......... .......... 16% 260M 0s 2019-12-09T11:30:25.450 INFO:teuthology.orchestra.run.smithi146.stderr: 12150K .......... .......... .......... .......... .......... 16% 209M 0s 2019-12-09T11:30:25.451 INFO:teuthology.orchestra.run.smithi146.stderr: 12200K .......... .......... .......... .......... .......... 16% 248M 0s 2019-12-09T11:30:25.451 INFO:teuthology.orchestra.run.smithi146.stderr: 12250K .......... .......... .......... .......... .......... 16% 258M 0s 2019-12-09T11:30:25.451 INFO:teuthology.orchestra.run.smithi146.stderr: 12300K .......... .......... .......... .......... .......... 16% 257M 0s 2019-12-09T11:30:25.451 INFO:teuthology.orchestra.run.smithi146.stderr: 12350K .......... .......... .......... .......... .......... 16% 233M 0s 2019-12-09T11:30:25.451 INFO:teuthology.orchestra.run.smithi146.stderr: 12400K .......... .......... .......... .......... .......... 16% 258M 0s 2019-12-09T11:30:25.451 INFO:teuthology.orchestra.run.smithi146.stderr: 12450K .......... .......... .......... .......... .......... 16% 260M 0s 2019-12-09T11:30:25.451 INFO:teuthology.orchestra.run.smithi146.stderr: 12500K .......... .......... .......... .......... .......... 17% 259M 0s 2019-12-09T11:30:25.452 INFO:teuthology.orchestra.run.smithi146.stderr: 12550K .......... .......... .......... .......... .......... 17% 215M 0s 2019-12-09T11:30:25.452 INFO:teuthology.orchestra.run.smithi146.stderr: 12600K .......... .......... .......... .......... .......... 17% 261M 0s 2019-12-09T11:30:25.452 INFO:teuthology.orchestra.run.smithi146.stderr: 12650K .......... .......... .......... .......... .......... 17% 238M 0s 2019-12-09T11:30:25.452 INFO:teuthology.orchestra.run.smithi146.stderr: 12700K .......... .......... .......... .......... .......... 17% 247M 0s 2019-12-09T11:30:25.452 INFO:teuthology.orchestra.run.smithi146.stderr: 12750K .......... .......... .......... .......... .......... 17% 209M 0s 2019-12-09T11:30:25.452 INFO:teuthology.orchestra.run.smithi146.stderr: 12800K .......... .......... .......... .......... .......... 17% 213M 0s 2019-12-09T11:30:25.452 INFO:teuthology.orchestra.run.smithi146.stderr: 12850K .......... .......... .......... .......... .......... 17% 256M 0s 2019-12-09T11:30:25.453 INFO:teuthology.orchestra.run.smithi146.stderr: 12900K .......... .......... .......... .......... .......... 17% 264M 0s 2019-12-09T11:30:25.453 INFO:teuthology.orchestra.run.smithi146.stderr: 12950K .......... .......... .......... .......... .......... 17% 212M 0s 2019-12-09T11:30:25.453 INFO:teuthology.orchestra.run.smithi146.stderr: 13000K .......... .......... .......... .......... .......... 17% 247M 0s 2019-12-09T11:30:25.453 INFO:teuthology.orchestra.run.smithi146.stderr: 13050K .......... .......... .......... .......... .......... 17% 250M 0s 2019-12-09T11:30:25.453 INFO:teuthology.orchestra.run.smithi146.stderr: 13100K .......... .......... .......... .......... .......... 17% 253M 0s 2019-12-09T11:30:25.453 INFO:teuthology.orchestra.run.smithi146.stderr: 13150K .......... .......... .......... .......... .......... 17% 219M 0s 2019-12-09T11:30:25.453 INFO:teuthology.orchestra.run.smithi146.stderr: 13200K .......... .......... .......... .......... .......... 18% 178M 0s 2019-12-09T11:30:25.453 INFO:teuthology.orchestra.run.smithi146.stderr: 13250K .......... .......... .......... .......... .......... 18% 220M 0s 2019-12-09T11:30:25.454 INFO:teuthology.orchestra.run.smithi146.stderr: 13300K .......... .......... .......... .......... .......... 18% 229M 0s 2019-12-09T11:30:25.454 INFO:teuthology.orchestra.run.smithi146.stderr: 13350K .......... .......... .......... .......... .......... 18% 210M 0s 2019-12-09T11:30:25.454 INFO:teuthology.orchestra.run.smithi146.stderr: 13400K .......... .......... .......... .......... .......... 18% 263M 0s 2019-12-09T11:30:25.454 INFO:teuthology.orchestra.run.smithi146.stderr: 13450K .......... .......... .......... .......... .......... 18% 274M 0s 2019-12-09T11:30:25.454 INFO:teuthology.orchestra.run.smithi146.stderr: 13500K .......... .......... .......... .......... .......... 18% 274M 0s 2019-12-09T11:30:25.454 INFO:teuthology.orchestra.run.smithi146.stderr: 13550K .......... .......... .......... .......... .......... 18% 240M 0s 2019-12-09T11:30:25.455 INFO:teuthology.orchestra.run.smithi146.stderr: 13600K .......... .......... .......... .......... .......... 18% 262M 0s 2019-12-09T11:30:25.455 INFO:teuthology.orchestra.run.smithi146.stderr: 13650K .......... .......... .......... .......... .......... 18% 248M 0s 2019-12-09T11:30:25.455 INFO:teuthology.orchestra.run.smithi146.stderr: 13700K .......... .......... .......... .......... .......... 18% 204M 0s 2019-12-09T11:30:25.455 INFO:teuthology.orchestra.run.smithi146.stderr: 13750K .......... .......... .......... .......... .......... 18% 196M 0s 2019-12-09T11:30:25.455 INFO:teuthology.orchestra.run.smithi146.stderr: 13800K .......... .......... .......... .......... .......... 18% 243M 0s 2019-12-09T11:30:25.455 INFO:teuthology.orchestra.run.smithi146.stderr: 13850K .......... .......... .......... .......... .......... 18% 241M 0s 2019-12-09T11:30:25.455 INFO:teuthology.orchestra.run.smithi146.stderr: 13900K .......... .......... .......... .......... .......... 18% 234M 0s 2019-12-09T11:30:25.456 INFO:teuthology.orchestra.run.smithi146.stderr: 13950K .......... .......... .......... .......... .......... 19% 226M 0s 2019-12-09T11:30:25.456 INFO:teuthology.orchestra.run.smithi146.stderr: 14000K .......... .......... .......... .......... .......... 19% 222M 0s 2019-12-09T11:30:25.456 INFO:teuthology.orchestra.run.smithi146.stderr: 14050K .......... .......... .......... .......... .......... 19% 252M 0s 2019-12-09T11:30:25.456 INFO:teuthology.orchestra.run.smithi146.stderr: 14100K .......... .......... .......... .......... .......... 19% 239M 0s 2019-12-09T11:30:25.456 INFO:teuthology.orchestra.run.smithi146.stderr: 14150K .......... .......... .......... .......... .......... 19% 213M 0s 2019-12-09T11:30:25.456 INFO:teuthology.orchestra.run.smithi146.stderr: 14200K .......... .......... .......... .......... .......... 19% 261M 0s 2019-12-09T11:30:25.456 INFO:teuthology.orchestra.run.smithi146.stderr: 14250K .......... .......... .......... .......... .......... 19% 259M 0s 2019-12-09T11:30:25.456 INFO:teuthology.orchestra.run.smithi146.stderr: 14300K .......... .......... .......... .......... .......... 19% 286M 0s 2019-12-09T11:30:25.457 INFO:teuthology.orchestra.run.smithi146.stderr: 14350K .......... .......... .......... .......... .......... 19% 245M 0s 2019-12-09T11:30:25.457 INFO:teuthology.orchestra.run.smithi146.stderr: 14400K .......... .......... .......... .......... .......... 19% 262M 0s 2019-12-09T11:30:25.457 INFO:teuthology.orchestra.run.smithi146.stderr: 14450K .......... .......... .......... .......... .......... 19% 270M 0s 2019-12-09T11:30:25.457 INFO:teuthology.orchestra.run.smithi146.stderr: 14500K .......... .......... .......... .......... .......... 19% 266M 0s 2019-12-09T11:30:25.457 INFO:teuthology.orchestra.run.smithi146.stderr: 14550K .......... .......... .......... .......... .......... 19% 228M 0s 2019-12-09T11:30:25.457 INFO:teuthology.orchestra.run.smithi146.stderr: 14600K .......... .......... .......... .......... .......... 19% 278M 0s 2019-12-09T11:30:25.457 INFO:teuthology.orchestra.run.smithi146.stderr: 14650K .......... .......... .......... .......... .......... 19% 260M 0s 2019-12-09T11:30:25.458 INFO:teuthology.orchestra.run.smithi146.stderr: 14700K .......... .......... .......... .......... .......... 20% 260M 0s 2019-12-09T11:30:25.458 INFO:teuthology.orchestra.run.smithi146.stderr: 14750K .......... .......... .......... .......... .......... 20% 243M 0s 2019-12-09T11:30:25.458 INFO:teuthology.orchestra.run.smithi146.stderr: 14800K .......... .......... .......... .......... .......... 20% 270M 0s 2019-12-09T11:30:25.458 INFO:teuthology.orchestra.run.smithi146.stderr: 14850K .......... .......... .......... .......... .......... 20% 251M 0s 2019-12-09T11:30:25.458 INFO:teuthology.orchestra.run.smithi146.stderr: 14900K .......... .......... .......... .......... .......... 20% 242M 0s 2019-12-09T11:30:25.458 INFO:teuthology.orchestra.run.smithi146.stderr: 14950K .......... .......... .......... .......... .......... 20% 209M 0s 2019-12-09T11:30:25.458 INFO:teuthology.orchestra.run.smithi146.stderr: 15000K .......... .......... .......... .......... .......... 20% 261M 0s 2019-12-09T11:30:25.459 INFO:teuthology.orchestra.run.smithi146.stderr: 15050K .......... .......... .......... .......... .......... 20% 269M 0s 2019-12-09T11:30:25.459 INFO:teuthology.orchestra.run.smithi146.stderr: 15100K .......... .......... .......... .......... .......... 20% 255M 0s 2019-12-09T11:30:25.459 INFO:teuthology.orchestra.run.smithi146.stderr: 15150K .......... .......... .......... .......... .......... 20% 236M 0s 2019-12-09T11:30:25.459 INFO:teuthology.orchestra.run.smithi146.stderr: 15200K .......... .......... .......... .......... .......... 20% 263M 0s 2019-12-09T11:30:25.459 INFO:teuthology.orchestra.run.smithi146.stderr: 15250K .......... .......... .......... .......... .......... 20% 265M 0s 2019-12-09T11:30:25.459 INFO:teuthology.orchestra.run.smithi146.stderr: 15300K .......... .......... .......... .......... .......... 20% 258M 0s 2019-12-09T11:30:25.459 INFO:teuthology.orchestra.run.smithi146.stderr: 15350K .......... .......... .......... .......... .......... 20% 214M 0s 2019-12-09T11:30:25.460 INFO:teuthology.orchestra.run.smithi146.stderr: 15400K .......... .......... .......... .......... .......... 21% 241M 0s 2019-12-09T11:30:25.460 INFO:teuthology.orchestra.run.smithi146.stderr: 15450K .......... .......... .......... .......... .......... 21% 253M 0s 2019-12-09T11:30:25.460 INFO:teuthology.orchestra.run.smithi146.stderr: 15500K .......... .......... .......... .......... .......... 21% 260M 0s 2019-12-09T11:30:25.460 INFO:teuthology.orchestra.run.smithi146.stderr: 15550K .......... .......... .......... .......... .......... 21% 241M 0s 2019-12-09T11:30:25.460 INFO:teuthology.orchestra.run.smithi146.stderr: 15600K .......... .......... .......... .......... .......... 21% 274M 0s 2019-12-09T11:30:25.460 INFO:teuthology.orchestra.run.smithi146.stderr: 15650K .......... .......... .......... .......... .......... 21% 267M 0s 2019-12-09T11:30:25.460 INFO:teuthology.orchestra.run.smithi146.stderr: 15700K .......... .......... .......... .......... .......... 21% 248M 0s 2019-12-09T11:30:25.461 INFO:teuthology.orchestra.run.smithi146.stderr: 15750K .......... .......... .......... .......... .......... 21% 227M 0s 2019-12-09T11:30:25.461 INFO:teuthology.orchestra.run.smithi146.stderr: 15800K .......... .......... .......... .......... .......... 21% 287M 0s 2019-12-09T11:30:25.461 INFO:teuthology.orchestra.run.smithi146.stderr: 15850K .......... .......... .......... .......... .......... 21% 244M 0s 2019-12-09T11:30:25.461 INFO:teuthology.orchestra.run.smithi146.stderr: 15900K .......... .......... .......... .......... .......... 21% 274M 0s 2019-12-09T11:30:25.461 INFO:teuthology.orchestra.run.smithi146.stderr: 15950K .......... .......... .......... .......... .......... 21% 230M 0s 2019-12-09T11:30:25.461 INFO:teuthology.orchestra.run.smithi146.stderr: 16000K .......... .......... .......... .......... .......... 21% 259M 0s 2019-12-09T11:30:25.462 INFO:teuthology.orchestra.run.smithi146.stderr: 16050K .......... .......... .......... .......... .......... 21% 253M 0s 2019-12-09T11:30:25.462 INFO:teuthology.orchestra.run.smithi146.stderr: 16100K .......... .......... .......... .......... .......... 21% 266M 0s 2019-12-09T11:30:25.462 INFO:teuthology.orchestra.run.smithi146.stderr: 16150K .......... .......... .......... .......... .......... 22% 224M 0s 2019-12-09T11:30:25.462 INFO:teuthology.orchestra.run.smithi146.stderr: 16200K .......... .......... .......... .......... .......... 22% 246M 0s 2019-12-09T11:30:25.463 INFO:teuthology.orchestra.run.smithi146.stderr: 16250K .......... .......... .......... .......... .......... 22% 273M 0s 2019-12-09T11:30:25.463 INFO:teuthology.orchestra.run.smithi146.stderr: 16300K .......... .......... .......... .......... .......... 22% 272M 0s 2019-12-09T11:30:25.463 INFO:teuthology.orchestra.run.smithi146.stderr: 16350K .......... .......... .......... .......... .......... 22% 215M 0s 2019-12-09T11:30:25.463 INFO:teuthology.orchestra.run.smithi146.stderr: 16400K .......... .......... .......... .......... .......... 22% 262M 0s 2019-12-09T11:30:25.463 INFO:teuthology.orchestra.run.smithi146.stderr: 16450K .......... .......... .......... .......... .......... 22% 260M 0s 2019-12-09T11:30:25.463 INFO:teuthology.orchestra.run.smithi146.stderr: 16500K .......... .......... .......... .......... .......... 22% 273M 0s 2019-12-09T11:30:25.463 INFO:teuthology.orchestra.run.smithi146.stderr: 16550K .......... .......... .......... .......... .......... 22% 228M 0s 2019-12-09T11:30:25.464 INFO:teuthology.orchestra.run.smithi146.stderr: 16600K .......... .......... .......... .......... .......... 22% 274M 0s 2019-12-09T11:30:25.464 INFO:teuthology.orchestra.run.smithi146.stderr: 16650K .......... .......... .......... .......... .......... 22% 267M 0s 2019-12-09T11:30:25.464 INFO:teuthology.orchestra.run.smithi146.stderr: 16700K .......... .......... .......... .......... .......... 22% 278M 0s 2019-12-09T11:30:25.464 INFO:teuthology.orchestra.run.smithi146.stderr: 16750K .......... .......... .......... .......... .......... 22% 242M 0s 2019-12-09T11:30:25.464 INFO:teuthology.orchestra.run.smithi146.stderr: 16800K .......... .......... .......... .......... .......... 22% 267M 0s 2019-12-09T11:30:25.465 INFO:teuthology.orchestra.run.smithi146.stderr: 16850K .......... .......... .......... .......... .......... 22% 258M 0s 2019-12-09T11:30:25.465 INFO:teuthology.orchestra.run.smithi146.stderr: 16900K .......... .......... .......... .......... .......... 23% 276M 0s 2019-12-09T11:30:25.465 INFO:teuthology.orchestra.run.smithi146.stderr: 16950K .......... .......... .......... .......... .......... 23% 228M 0s 2019-12-09T11:30:25.465 INFO:teuthology.orchestra.run.smithi146.stderr: 17000K .......... .......... .......... .......... .......... 23% 237M 0s 2019-12-09T11:30:25.465 INFO:teuthology.orchestra.run.smithi146.stderr: 17050K .......... .......... .......... .......... .......... 23% 244M 0s 2019-12-09T11:30:25.465 INFO:teuthology.orchestra.run.smithi146.stderr: 17100K .......... .......... .......... .......... .......... 23% 237M 0s 2019-12-09T11:30:25.465 INFO:teuthology.orchestra.run.smithi146.stderr: 17150K .......... .......... .......... .......... .......... 23% 237M 0s 2019-12-09T11:30:25.466 INFO:teuthology.orchestra.run.smithi146.stderr: 17200K .......... .......... .......... .......... .......... 23% 257M 0s 2019-12-09T11:30:25.466 INFO:teuthology.orchestra.run.smithi146.stderr: 17250K .......... .......... .......... .......... .......... 23% 255M 0s 2019-12-09T11:30:25.466 INFO:teuthology.orchestra.run.smithi146.stderr: 17300K .......... .......... .......... .......... .......... 23% 245M 0s 2019-12-09T11:30:25.466 INFO:teuthology.orchestra.run.smithi146.stderr: 17350K .......... .......... .......... .......... .......... 23% 233M 0s 2019-12-09T11:30:25.466 INFO:teuthology.orchestra.run.smithi146.stderr: 17400K .......... .......... .......... .......... .......... 23% 265M 0s 2019-12-09T11:30:25.466 INFO:teuthology.orchestra.run.smithi146.stderr: 17450K .......... .......... .......... .......... .......... 23% 271M 0s 2019-12-09T11:30:25.466 INFO:teuthology.orchestra.run.smithi146.stderr: 17500K .......... .......... .......... .......... .......... 23% 266M 0s 2019-12-09T11:30:25.467 INFO:teuthology.orchestra.run.smithi146.stderr: 17550K .......... .......... .......... .......... .......... 23% 242M 0s 2019-12-09T11:30:25.467 INFO:teuthology.orchestra.run.smithi146.stderr: 17600K .......... .......... .......... .......... .......... 23% 275M 0s 2019-12-09T11:30:25.467 INFO:teuthology.orchestra.run.smithi146.stderr: 17650K .......... .......... .......... .......... .......... 24% 277M 0s 2019-12-09T11:30:25.467 INFO:teuthology.orchestra.run.smithi146.stderr: 17700K .......... .......... .......... .......... .......... 24% 287M 0s 2019-12-09T11:30:25.467 INFO:teuthology.orchestra.run.smithi146.stderr: 17750K .......... .......... .......... .......... .......... 24% 212M 0s 2019-12-09T11:30:25.467 INFO:teuthology.orchestra.run.smithi146.stderr: 17800K .......... .......... .......... .......... .......... 24% 273M 0s 2019-12-09T11:30:25.467 INFO:teuthology.orchestra.run.smithi146.stderr: 17850K .......... .......... .......... .......... .......... 24% 264M 0s 2019-12-09T11:30:25.468 INFO:teuthology.orchestra.run.smithi146.stderr: 17900K .......... .......... .......... .......... .......... 24% 270M 0s 2019-12-09T11:30:25.468 INFO:teuthology.orchestra.run.smithi146.stderr: 17950K .......... .......... .......... .......... .......... 24% 250M 0s 2019-12-09T11:30:25.468 INFO:teuthology.orchestra.run.smithi146.stderr: 18000K .......... .......... .......... .......... .......... 24% 269M 0s 2019-12-09T11:30:25.468 INFO:teuthology.orchestra.run.smithi146.stderr: 18050K .......... .......... .......... .......... .......... 24% 250M 0s 2019-12-09T11:30:25.468 INFO:teuthology.orchestra.run.smithi146.stderr: 18100K .......... .......... .......... .......... .......... 24% 257M 0s 2019-12-09T11:30:25.468 INFO:teuthology.orchestra.run.smithi146.stderr: 18150K .......... .......... .......... .......... .......... 24% 210M 0s 2019-12-09T11:30:25.468 INFO:teuthology.orchestra.run.smithi146.stderr: 18200K .......... .......... .......... .......... .......... 24% 267M 0s 2019-12-09T11:30:25.469 INFO:teuthology.orchestra.run.smithi146.stderr: 18250K .......... .......... .......... .......... .......... 24% 222M 0s 2019-12-09T11:30:25.469 INFO:teuthology.orchestra.run.smithi146.stderr: 18300K .......... .......... .......... .......... .......... 24% 217M 0s 2019-12-09T11:30:25.469 INFO:teuthology.orchestra.run.smithi146.stderr: 18350K .......... .......... .......... .......... .......... 25% 169M 0s 2019-12-09T11:30:25.469 INFO:teuthology.orchestra.run.smithi146.stderr: 18400K .......... .......... .......... .......... .......... 25% 199M 0s 2019-12-09T11:30:25.469 INFO:teuthology.orchestra.run.smithi146.stderr: 18450K .......... .......... .......... .......... .......... 25% 174M 0s 2019-12-09T11:30:25.469 INFO:teuthology.orchestra.run.smithi146.stderr: 18500K .......... .......... .......... .......... .......... 25% 190M 0s 2019-12-09T11:30:25.470 INFO:teuthology.orchestra.run.smithi146.stderr: 18550K .......... .......... .......... .......... .......... 25% 192M 0s 2019-12-09T11:30:25.470 INFO:teuthology.orchestra.run.smithi146.stderr: 18600K .......... .......... .......... .......... .......... 25% 275M 0s 2019-12-09T11:30:25.470 INFO:teuthology.orchestra.run.smithi146.stderr: 18650K .......... .......... .......... .......... .......... 25% 269M 0s 2019-12-09T11:30:25.470 INFO:teuthology.orchestra.run.smithi146.stderr: 18700K .......... .......... .......... .......... .......... 25% 249M 0s 2019-12-09T11:30:25.470 INFO:teuthology.orchestra.run.smithi146.stderr: 18750K .......... .......... .......... .......... .......... 25% 265M 0s 2019-12-09T11:30:25.471 INFO:teuthology.orchestra.run.smithi146.stderr: 18800K .......... .......... .......... .......... .......... 25% 284M 0s 2019-12-09T11:30:25.471 INFO:teuthology.orchestra.run.smithi146.stderr: 18850K .......... .......... .......... .......... .......... 25% 279M 0s 2019-12-09T11:30:25.471 INFO:teuthology.orchestra.run.smithi146.stderr: 18900K .......... .......... .......... .......... .......... 25% 296M 0s 2019-12-09T11:30:25.471 INFO:teuthology.orchestra.run.smithi146.stderr: 18950K .......... .......... .......... .......... .......... 25% 227M 0s 2019-12-09T11:30:25.471 INFO:teuthology.orchestra.run.smithi146.stderr: 19000K .......... .......... .......... .......... .......... 25% 286M 0s 2019-12-09T11:30:25.472 INFO:teuthology.orchestra.run.smithi146.stderr: 19050K .......... .......... .......... .......... .......... 25% 300M 0s 2019-12-09T11:30:25.472 INFO:teuthology.orchestra.run.smithi146.stderr: 19100K .......... .......... .......... .......... .......... 26% 276M 0s 2019-12-09T11:30:25.472 INFO:teuthology.orchestra.run.smithi146.stderr: 19150K .......... .......... .......... .......... .......... 26% 224M 0s 2019-12-09T11:30:25.472 INFO:teuthology.orchestra.run.smithi146.stderr: 19200K .......... .......... .......... .......... .......... 26% 232M 0s 2019-12-09T11:30:25.472 INFO:teuthology.orchestra.run.smithi146.stderr: 19250K .......... .......... .......... .......... .......... 26% 202M 0s 2019-12-09T11:30:25.472 INFO:teuthology.orchestra.run.smithi146.stderr: 19300K .......... .......... .......... .......... .......... 26% 224M 0s 2019-12-09T11:30:25.472 INFO:teuthology.orchestra.run.smithi146.stderr: 19350K .......... .......... .......... .......... .......... 26% 190M 0s 2019-12-09T11:30:25.473 INFO:teuthology.orchestra.run.smithi146.stderr: 19400K .......... .......... .......... .......... .......... 26% 231M 0s 2019-12-09T11:30:25.473 INFO:teuthology.orchestra.run.smithi146.stderr: 19450K .......... .......... .......... .......... .......... 26% 201M 0s 2019-12-09T11:30:25.473 INFO:teuthology.orchestra.run.smithi146.stderr: 19500K .......... .......... .......... .......... .......... 26% 212M 0s 2019-12-09T11:30:25.473 INFO:teuthology.orchestra.run.smithi146.stderr: 19550K .......... .......... .......... .......... .......... 26% 198M 0s 2019-12-09T11:30:25.473 INFO:teuthology.orchestra.run.smithi146.stderr: 19600K .......... .......... .......... .......... .......... 26% 226M 0s 2019-12-09T11:30:25.473 INFO:teuthology.orchestra.run.smithi146.stderr: 19650K .......... .......... .......... .......... .......... 26% 230M 0s 2019-12-09T11:30:25.473 INFO:teuthology.orchestra.run.smithi146.stderr: 19700K .......... .......... .......... .......... .......... 26% 215M 0s 2019-12-09T11:30:25.474 INFO:teuthology.orchestra.run.smithi146.stderr: 19750K .......... .......... .......... .......... .......... 26% 187M 0s 2019-12-09T11:30:25.474 INFO:teuthology.orchestra.run.smithi146.stderr: 19800K .......... .......... .......... .......... .......... 26% 188M 0s 2019-12-09T11:30:25.474 INFO:teuthology.orchestra.run.smithi146.stderr: 19850K .......... .......... .......... .......... .......... 27% 193M 0s 2019-12-09T11:30:25.474 INFO:teuthology.orchestra.run.smithi146.stderr: 19900K .......... .......... .......... .......... .......... 27% 258M 0s 2019-12-09T11:30:25.474 INFO:teuthology.orchestra.run.smithi146.stderr: 19950K .......... .......... .......... .......... .......... 27% 213M 0s 2019-12-09T11:30:25.474 INFO:teuthology.orchestra.run.smithi146.stderr: 20000K .......... .......... .......... .......... .......... 27% 268M 0s 2019-12-09T11:30:25.474 INFO:teuthology.orchestra.run.smithi146.stderr: 20050K .......... .......... .......... .......... .......... 27% 278M 0s 2019-12-09T11:30:25.475 INFO:teuthology.orchestra.run.smithi146.stderr: 20100K .......... .......... .......... .......... .......... 27% 244M 0s 2019-12-09T11:30:25.475 INFO:teuthology.orchestra.run.smithi146.stderr: 20150K .......... .......... .......... .......... .......... 27% 234M 0s 2019-12-09T11:30:25.475 INFO:teuthology.orchestra.run.smithi146.stderr: 20200K .......... .......... .......... .......... .......... 27% 281M 0s 2019-12-09T11:30:25.475 INFO:teuthology.orchestra.run.smithi146.stderr: 20250K .......... .......... .......... .......... .......... 27% 294M 0s 2019-12-09T11:30:25.475 INFO:teuthology.orchestra.run.smithi146.stderr: 20300K .......... .......... .......... .......... .......... 27% 298M 0s 2019-12-09T11:30:25.475 INFO:teuthology.orchestra.run.smithi146.stderr: 20350K .......... .......... .......... .......... .......... 27% 235M 0s 2019-12-09T11:30:25.476 INFO:teuthology.orchestra.run.smithi146.stderr: 20400K .......... .......... .......... .......... .......... 27% 279M 0s 2019-12-09T11:30:25.476 INFO:teuthology.orchestra.run.smithi146.stderr: 20450K .......... .......... .......... .......... .......... 27% 272M 0s 2019-12-09T11:30:25.476 INFO:teuthology.orchestra.run.smithi146.stderr: 20500K .......... .......... .......... .......... .......... 27% 296M 0s 2019-12-09T11:30:25.476 INFO:teuthology.orchestra.run.smithi146.stderr: 20550K .......... .......... .......... .......... .......... 28% 234M 0s 2019-12-09T11:30:25.476 INFO:teuthology.orchestra.run.smithi146.stderr: 20600K .......... .......... .......... .......... .......... 28% 288M 0s 2019-12-09T11:30:25.476 INFO:teuthology.orchestra.run.smithi146.stderr: 20650K .......... .......... .......... .......... .......... 28% 280M 0s 2019-12-09T11:30:25.477 INFO:teuthology.orchestra.run.smithi146.stderr: 20700K .......... .......... .......... .......... .......... 28% 279M 0s 2019-12-09T11:30:25.477 INFO:teuthology.orchestra.run.smithi146.stderr: 20750K .......... .......... .......... .......... .......... 28% 260M 0s 2019-12-09T11:30:25.477 INFO:teuthology.orchestra.run.smithi146.stderr: 20800K .......... .......... .......... .......... .......... 28% 274M 0s 2019-12-09T11:30:25.477 INFO:teuthology.orchestra.run.smithi146.stderr: 20850K .......... .......... .......... .......... .......... 28% 279M 0s 2019-12-09T11:30:25.477 INFO:teuthology.orchestra.run.smithi146.stderr: 20900K .......... .......... .......... .......... .......... 28% 290M 0s 2019-12-09T11:30:25.477 INFO:teuthology.orchestra.run.smithi146.stderr: 20950K .......... .......... .......... .......... .......... 28% 230M 0s 2019-12-09T11:30:25.477 INFO:teuthology.orchestra.run.smithi146.stderr: 21000K .......... .......... .......... .......... .......... 28% 285M 0s 2019-12-09T11:30:25.478 INFO:teuthology.orchestra.run.smithi146.stderr: 21050K .......... .......... .......... .......... .......... 28% 302M 0s 2019-12-09T11:30:25.478 INFO:teuthology.orchestra.run.smithi146.stderr: 21100K .......... .......... .......... .......... .......... 28% 295M 0s 2019-12-09T11:30:25.478 INFO:teuthology.orchestra.run.smithi146.stderr: 21150K .......... .......... .......... .......... .......... 28% 265M 0s 2019-12-09T11:30:25.478 INFO:teuthology.orchestra.run.smithi146.stderr: 21200K .......... .......... .......... .......... .......... 28% 306M 0s 2019-12-09T11:30:25.478 INFO:teuthology.orchestra.run.smithi146.stderr: 21250K .......... .......... .......... .......... .......... 28% 298M 0s 2019-12-09T11:30:25.478 INFO:teuthology.orchestra.run.smithi146.stderr: 21300K .......... .......... .......... .......... .......... 29% 293M 0s 2019-12-09T11:30:25.479 INFO:teuthology.orchestra.run.smithi146.stderr: 21350K .......... .......... .......... .......... .......... 29% 214M 0s 2019-12-09T11:30:25.479 INFO:teuthology.orchestra.run.smithi146.stderr: 21400K .......... .......... .......... .......... .......... 29% 239M 0s 2019-12-09T11:30:25.479 INFO:teuthology.orchestra.run.smithi146.stderr: 21450K .......... .......... .......... .......... .......... 29% 259M 0s 2019-12-09T11:30:25.479 INFO:teuthology.orchestra.run.smithi146.stderr: 21500K .......... .......... .......... .......... .......... 29% 241M 0s 2019-12-09T11:30:25.479 INFO:teuthology.orchestra.run.smithi146.stderr: 21550K .......... .......... .......... .......... .......... 29% 246M 0s 2019-12-09T11:30:25.479 INFO:teuthology.orchestra.run.smithi146.stderr: 21600K .......... .......... .......... .......... .......... 29% 275M 0s 2019-12-09T11:30:25.479 INFO:teuthology.orchestra.run.smithi146.stderr: 21650K .......... .......... .......... .......... .......... 29% 236M 0s 2019-12-09T11:30:25.480 INFO:teuthology.orchestra.run.smithi146.stderr: 21700K .......... .......... .......... .......... .......... 29% 248M 0s 2019-12-09T11:30:25.480 INFO:teuthology.orchestra.run.smithi146.stderr: 21750K .......... .......... .......... .......... .......... 29% 230M 0s 2019-12-09T11:30:25.480 INFO:teuthology.orchestra.run.smithi146.stderr: 21800K .......... .......... .......... .......... .......... 29% 285M 0s 2019-12-09T11:30:25.480 INFO:teuthology.orchestra.run.smithi146.stderr: 21850K .......... .......... .......... .......... .......... 29% 291M 0s 2019-12-09T11:30:25.480 INFO:teuthology.orchestra.run.smithi146.stderr: 21900K .......... .......... .......... .......... .......... 29% 254M 0s 2019-12-09T11:30:25.480 INFO:teuthology.orchestra.run.smithi146.stderr: 21950K .......... .......... .......... .......... .......... 29% 274M 0s 2019-12-09T11:30:25.480 INFO:teuthology.orchestra.run.smithi146.stderr: 22000K .......... .......... .......... .......... .......... 29% 294M 0s 2019-12-09T11:30:25.481 INFO:teuthology.orchestra.run.smithi146.stderr: 22050K .......... .......... .......... .......... .......... 30% 279M 0s 2019-12-09T11:30:25.481 INFO:teuthology.orchestra.run.smithi146.stderr: 22100K .......... .......... .......... .......... .......... 30% 302M 0s 2019-12-09T11:30:25.481 INFO:teuthology.orchestra.run.smithi146.stderr: 22150K .......... .......... .......... .......... .......... 30% 250M 0s 2019-12-09T11:30:25.481 INFO:teuthology.orchestra.run.smithi146.stderr: 22200K .......... .......... .......... .......... .......... 30% 316M 0s 2019-12-09T11:30:25.481 INFO:teuthology.orchestra.run.smithi146.stderr: 22250K .......... .......... .......... .......... .......... 30% 285M 0s 2019-12-09T11:30:25.481 INFO:teuthology.orchestra.run.smithi146.stderr: 22300K .......... .......... .......... .......... .......... 30% 306M 0s 2019-12-09T11:30:25.481 INFO:teuthology.orchestra.run.smithi146.stderr: 22350K .......... .......... .......... .......... .......... 30% 252M 0s 2019-12-09T11:30:25.481 INFO:teuthology.orchestra.run.smithi146.stderr: 22400K .......... .......... .......... .......... .......... 30% 277M 0s 2019-12-09T11:30:25.482 INFO:teuthology.orchestra.run.smithi146.stderr: 22450K .......... .......... .......... .......... .......... 30% 287M 0s 2019-12-09T11:30:25.482 INFO:teuthology.orchestra.run.smithi146.stderr: 22500K .......... .......... .......... .......... .......... 30% 303M 0s 2019-12-09T11:30:25.482 INFO:teuthology.orchestra.run.smithi146.stderr: 22550K .......... .......... .......... .......... .......... 30% 208M 0s 2019-12-09T11:30:25.482 INFO:teuthology.orchestra.run.smithi146.stderr: 22600K .......... .......... .......... .......... .......... 30% 274M 0s 2019-12-09T11:30:25.482 INFO:teuthology.orchestra.run.smithi146.stderr: 22650K .......... .......... .......... .......... .......... 30% 304M 0s 2019-12-09T11:30:25.482 INFO:teuthology.orchestra.run.smithi146.stderr: 22700K .......... .......... .......... .......... .......... 30% 306M 0s 2019-12-09T11:30:25.483 INFO:teuthology.orchestra.run.smithi146.stderr: 22750K .......... .......... .......... .......... .......... 30% 232M 0s 2019-12-09T11:30:25.483 INFO:teuthology.orchestra.run.smithi146.stderr: 22800K .......... .......... .......... .......... .......... 31% 300M 0s 2019-12-09T11:30:25.483 INFO:teuthology.orchestra.run.smithi146.stderr: 22850K .......... .......... .......... .......... .......... 31% 290M 0s 2019-12-09T11:30:25.483 INFO:teuthology.orchestra.run.smithi146.stderr: 22900K .......... .......... .......... .......... .......... 31% 291M 0s 2019-12-09T11:30:25.483 INFO:teuthology.orchestra.run.smithi146.stderr: 22950K .......... .......... .......... .......... .......... 31% 243M 0s 2019-12-09T11:30:25.483 INFO:teuthology.orchestra.run.smithi146.stderr: 23000K .......... .......... .......... .......... .......... 31% 298M 0s 2019-12-09T11:30:25.483 INFO:teuthology.orchestra.run.smithi146.stderr: 23050K .......... .......... .......... .......... .......... 31% 279M 0s 2019-12-09T11:30:25.484 INFO:teuthology.orchestra.run.smithi146.stderr: 23100K .......... .......... .......... .......... .......... 31% 289M 0s 2019-12-09T11:30:25.484 INFO:teuthology.orchestra.run.smithi146.stderr: 23150K .......... .......... .......... .......... .......... 31% 246M 0s 2019-12-09T11:30:25.484 INFO:teuthology.orchestra.run.smithi146.stderr: 23200K .......... .......... .......... .......... .......... 31% 285M 0s 2019-12-09T11:30:25.484 INFO:teuthology.orchestra.run.smithi146.stderr: 23250K .......... .......... .......... .......... .......... 31% 301M 0s 2019-12-09T11:30:25.484 INFO:teuthology.orchestra.run.smithi146.stderr: 23300K .......... .......... .......... .......... .......... 31% 289M 0s 2019-12-09T11:30:25.484 INFO:teuthology.orchestra.run.smithi146.stderr: 23350K .......... .......... .......... .......... .......... 31% 237M 0s 2019-12-09T11:30:25.484 INFO:teuthology.orchestra.run.smithi146.stderr: 23400K .......... .......... .......... .......... .......... 31% 224M 0s 2019-12-09T11:30:25.485 INFO:teuthology.orchestra.run.smithi146.stderr: 23450K .......... .......... .......... .......... .......... 31% 275M 0s 2019-12-09T11:30:25.485 INFO:teuthology.orchestra.run.smithi146.stderr: 23500K .......... .......... .......... .......... .......... 32% 309M 0s 2019-12-09T11:30:25.485 INFO:teuthology.orchestra.run.smithi146.stderr: 23550K .......... .......... .......... .......... .......... 32% 240M 0s 2019-12-09T11:30:25.485 INFO:teuthology.orchestra.run.smithi146.stderr: 23600K .......... .......... .......... .......... .......... 32% 316M 0s 2019-12-09T11:30:25.485 INFO:teuthology.orchestra.run.smithi146.stderr: 23650K .......... .......... .......... .......... .......... 32% 294M 0s 2019-12-09T11:30:25.485 INFO:teuthology.orchestra.run.smithi146.stderr: 23700K .......... .......... .......... .......... .......... 32% 318M 0s 2019-12-09T11:30:25.485 INFO:teuthology.orchestra.run.smithi146.stderr: 23750K .......... .......... .......... .......... .......... 32% 154M 0s 2019-12-09T11:30:25.486 INFO:teuthology.orchestra.run.smithi146.stderr: 23800K .......... .......... .......... .......... .......... 32% 213M 0s 2019-12-09T11:30:25.486 INFO:teuthology.orchestra.run.smithi146.stderr: 23850K .......... .......... .......... .......... .......... 32% 210M 0s 2019-12-09T11:30:25.486 INFO:teuthology.orchestra.run.smithi146.stderr: 23900K .......... .......... .......... .......... .......... 32% 217M 0s 2019-12-09T11:30:25.486 INFO:teuthology.orchestra.run.smithi146.stderr: 23950K .......... .......... .......... .......... .......... 32% 186M 0s 2019-12-09T11:30:25.486 INFO:teuthology.orchestra.run.smithi146.stderr: 24000K .......... .......... .......... .......... .......... 32% 216M 0s 2019-12-09T11:30:25.486 INFO:teuthology.orchestra.run.smithi146.stderr: 24050K .......... .......... .......... .......... .......... 32% 210M 0s 2019-12-09T11:30:25.486 INFO:teuthology.orchestra.run.smithi146.stderr: 24100K .......... .......... .......... .......... .......... 32% 217M 0s 2019-12-09T11:30:25.487 INFO:teuthology.orchestra.run.smithi146.stderr: 24150K .......... .......... .......... .......... .......... 32% 172M 0s 2019-12-09T11:30:25.487 INFO:teuthology.orchestra.run.smithi146.stderr: 24200K .......... .......... .......... .......... .......... 32% 212M 0s 2019-12-09T11:30:25.487 INFO:teuthology.orchestra.run.smithi146.stderr: 24250K .......... .......... .......... .......... .......... 33% 207M 0s 2019-12-09T11:30:25.487 INFO:teuthology.orchestra.run.smithi146.stderr: 24300K .......... .......... .......... .......... .......... 33% 209M 0s 2019-12-09T11:30:25.487 INFO:teuthology.orchestra.run.smithi146.stderr: 24350K .......... .......... .......... .......... .......... 33% 192M 0s 2019-12-09T11:30:25.487 INFO:teuthology.orchestra.run.smithi146.stderr: 24400K .......... .......... .......... .......... .......... 33% 224M 0s 2019-12-09T11:30:25.487 INFO:teuthology.orchestra.run.smithi146.stderr: 24450K .......... .......... .......... .......... .......... 33% 210M 0s 2019-12-09T11:30:25.488 INFO:teuthology.orchestra.run.smithi146.stderr: 24500K .......... .......... .......... .......... .......... 33% 220M 0s 2019-12-09T11:30:25.488 INFO:teuthology.orchestra.run.smithi146.stderr: 24550K .......... .......... .......... .......... .......... 33% 170M 0s 2019-12-09T11:30:25.488 INFO:teuthology.orchestra.run.smithi146.stderr: 24600K .......... .......... .......... .......... .......... 33% 210M 0s 2019-12-09T11:30:25.488 INFO:teuthology.orchestra.run.smithi146.stderr: 24650K .......... .......... .......... .......... .......... 33% 215M 0s 2019-12-09T11:30:25.488 INFO:teuthology.orchestra.run.smithi146.stderr: 24700K .......... .......... .......... .......... .......... 33% 207M 0s 2019-12-09T11:30:25.488 INFO:teuthology.orchestra.run.smithi146.stderr: 24750K .......... .......... .......... .......... .......... 33% 185M 0s 2019-12-09T11:30:25.488 INFO:teuthology.orchestra.run.smithi146.stderr: 24800K .......... .......... .......... .......... .......... 33% 215M 0s 2019-12-09T11:30:25.489 INFO:teuthology.orchestra.run.smithi146.stderr: 24850K .......... .......... .......... .......... .......... 33% 199M 0s 2019-12-09T11:30:25.489 INFO:teuthology.orchestra.run.smithi146.stderr: 24900K .......... .......... .......... .......... .......... 33% 215M 0s 2019-12-09T11:30:25.489 INFO:teuthology.orchestra.run.smithi146.stderr: 24950K .......... .......... .......... .......... .......... 33% 177M 0s 2019-12-09T11:30:25.489 INFO:teuthology.orchestra.run.smithi146.stderr: 25000K .......... .......... .......... .......... .......... 34% 209M 0s 2019-12-09T11:30:25.489 INFO:teuthology.orchestra.run.smithi146.stderr: 25050K .......... .......... .......... .......... .......... 34% 222M 0s 2019-12-09T11:30:25.489 INFO:teuthology.orchestra.run.smithi146.stderr: 25100K .......... .......... .......... .......... .......... 34% 218M 0s 2019-12-09T11:30:25.490 INFO:teuthology.orchestra.run.smithi146.stderr: 25150K .......... .......... .......... .......... .......... 34% 197M 0s 2019-12-09T11:30:25.490 INFO:teuthology.orchestra.run.smithi146.stderr: 25200K .......... .......... .......... .......... .......... 34% 217M 0s 2019-12-09T11:30:25.490 INFO:teuthology.orchestra.run.smithi146.stderr: 25250K .......... .......... .......... .......... .......... 34% 211M 0s 2019-12-09T11:30:25.490 INFO:teuthology.orchestra.run.smithi146.stderr: 25300K .......... .......... .......... .......... .......... 34% 212M 0s 2019-12-09T11:30:25.490 INFO:teuthology.orchestra.run.smithi146.stderr: 25350K .......... .......... .......... .......... .......... 34% 180M 0s 2019-12-09T11:30:25.491 INFO:teuthology.orchestra.run.smithi146.stderr: 25400K .......... .......... .......... .......... .......... 34% 213M 0s 2019-12-09T11:30:25.491 INFO:teuthology.orchestra.run.smithi146.stderr: 25450K .......... .......... .......... .......... .......... 34% 222M 0s 2019-12-09T11:30:25.491 INFO:teuthology.orchestra.run.smithi146.stderr: 25500K .......... .......... .......... .......... .......... 34% 213M 0s 2019-12-09T11:30:25.491 INFO:teuthology.orchestra.run.smithi146.stderr: 25550K .......... .......... .......... .......... .......... 34% 192M 0s 2019-12-09T11:30:25.491 INFO:teuthology.orchestra.run.smithi146.stderr: 25600K .......... .......... .......... .......... .......... 34% 200M 0s 2019-12-09T11:30:25.491 INFO:teuthology.orchestra.run.smithi146.stderr: 25650K .......... .......... .......... .......... .......... 34% 206M 0s 2019-12-09T11:30:25.491 INFO:teuthology.orchestra.run.smithi146.stderr: 25700K .......... .......... .......... .......... .......... 35% 214M 0s 2019-12-09T11:30:25.492 INFO:teuthology.orchestra.run.smithi146.stderr: 25750K .......... .......... .......... .......... .......... 35% 170M 0s 2019-12-09T11:30:25.492 INFO:teuthology.orchestra.run.smithi146.stderr: 25800K .......... .......... .......... .......... .......... 35% 203M 0s 2019-12-09T11:30:25.492 INFO:teuthology.orchestra.run.smithi146.stderr: 25850K .......... .......... .......... .......... .......... 35% 199M 0s 2019-12-09T11:30:25.492 INFO:teuthology.orchestra.run.smithi146.stderr: 25900K .......... .......... .......... .......... .......... 35% 209M 0s 2019-12-09T11:30:25.492 INFO:teuthology.orchestra.run.smithi146.stderr: 25950K .......... .......... .......... .......... .......... 35% 183M 0s 2019-12-09T11:30:25.492 INFO:teuthology.orchestra.run.smithi146.stderr: 26000K .......... .......... .......... .......... .......... 35% 218M 0s 2019-12-09T11:30:25.492 INFO:teuthology.orchestra.run.smithi146.stderr: 26050K .......... .......... .......... .......... .......... 35% 238M 0s 2019-12-09T11:30:25.493 INFO:teuthology.orchestra.run.smithi146.stderr: 26100K .......... .......... .......... .......... .......... 35% 227M 0s 2019-12-09T11:30:25.493 INFO:teuthology.orchestra.run.smithi146.stderr: 26150K .......... .......... .......... .......... .......... 35% 193M 0s 2019-12-09T11:30:25.493 INFO:teuthology.orchestra.run.smithi146.stderr: 26200K .......... .......... .......... .......... .......... 35% 226M 0s 2019-12-09T11:30:25.493 INFO:teuthology.orchestra.run.smithi146.stderr: 26250K .......... .......... .......... .......... .......... 35% 213M 0s 2019-12-09T11:30:25.493 INFO:teuthology.orchestra.run.smithi146.stderr: 26300K .......... .......... .......... .......... .......... 35% 228M 0s 2019-12-09T11:30:25.493 INFO:teuthology.orchestra.run.smithi146.stderr: 26350K .......... .......... .......... .......... .......... 35% 204M 0s 2019-12-09T11:30:25.493 INFO:teuthology.orchestra.run.smithi146.stderr: 26400K .......... .......... .......... .......... .......... 35% 225M 0s 2019-12-09T11:30:25.494 INFO:teuthology.orchestra.run.smithi146.stderr: 26450K .......... .......... .......... .......... .......... 36% 219M 0s 2019-12-09T11:30:25.494 INFO:teuthology.orchestra.run.smithi146.stderr: 26500K .......... .......... .......... .......... .......... 36% 222M 0s 2019-12-09T11:30:25.494 INFO:teuthology.orchestra.run.smithi146.stderr: 26550K .......... .......... .......... .......... .......... 36% 187M 0s 2019-12-09T11:30:25.494 INFO:teuthology.orchestra.run.smithi146.stderr: 26600K .......... .......... .......... .......... .......... 36% 227M 0s 2019-12-09T11:30:25.494 INFO:teuthology.orchestra.run.smithi146.stderr: 26650K .......... .......... .......... .......... .......... 36% 220M 0s 2019-12-09T11:30:25.494 INFO:teuthology.orchestra.run.smithi146.stderr: 26700K .......... .......... .......... .......... .......... 36% 208M 0s 2019-12-09T11:30:25.494 INFO:teuthology.orchestra.run.smithi146.stderr: 26750K .......... .......... .......... .......... .......... 36% 198M 0s 2019-12-09T11:30:25.495 INFO:teuthology.orchestra.run.smithi146.stderr: 26800K .......... .......... .......... .......... .......... 36% 217M 0s 2019-12-09T11:30:25.495 INFO:teuthology.orchestra.run.smithi146.stderr: 26850K .......... .......... .......... .......... .......... 36% 218M 0s 2019-12-09T11:30:25.495 INFO:teuthology.orchestra.run.smithi146.stderr: 26900K .......... .......... .......... .......... .......... 36% 212M 0s 2019-12-09T11:30:25.495 INFO:teuthology.orchestra.run.smithi146.stderr: 26950K .......... .......... .......... .......... .......... 36% 178M 0s 2019-12-09T11:30:25.495 INFO:teuthology.orchestra.run.smithi146.stderr: 27000K .......... .......... .......... .......... .......... 36% 210M 0s 2019-12-09T11:30:25.495 INFO:teuthology.orchestra.run.smithi146.stderr: 27050K .......... .......... .......... .......... .......... 36% 224M 0s 2019-12-09T11:30:25.495 INFO:teuthology.orchestra.run.smithi146.stderr: 27100K .......... .......... .......... .......... .......... 36% 210M 0s 2019-12-09T11:30:25.495 INFO:teuthology.orchestra.run.smithi146.stderr: 27150K .......... .......... .......... .......... .......... 36% 184M 0s 2019-12-09T11:30:25.496 INFO:teuthology.orchestra.run.smithi146.stderr: 27200K .......... .......... .......... .......... .......... 37% 219M 0s 2019-12-09T11:30:25.496 INFO:teuthology.orchestra.run.smithi146.stderr: 27250K .......... .......... .......... .......... .......... 37% 225M 0s 2019-12-09T11:30:25.496 INFO:teuthology.orchestra.run.smithi146.stderr: 27300K .......... .......... .......... .......... .......... 37% 218M 0s 2019-12-09T11:30:25.496 INFO:teuthology.orchestra.run.smithi146.stderr: 27350K .......... .......... .......... .......... .......... 37% 174M 0s 2019-12-09T11:30:25.496 INFO:teuthology.orchestra.run.smithi146.stderr: 27400K .......... .......... .......... .......... .......... 37% 222M 0s 2019-12-09T11:30:25.496 INFO:teuthology.orchestra.run.smithi146.stderr: 27450K .......... .......... .......... .......... .......... 37% 224M 0s 2019-12-09T11:30:25.496 INFO:teuthology.orchestra.run.smithi146.stderr: 27500K .......... .......... .......... .......... .......... 37% 220M 0s 2019-12-09T11:30:25.497 INFO:teuthology.orchestra.run.smithi146.stderr: 27550K .......... .......... .......... .......... .......... 37% 198M 0s 2019-12-09T11:30:25.497 INFO:teuthology.orchestra.run.smithi146.stderr: 27600K .......... .......... .......... .......... .......... 37% 228M 0s 2019-12-09T11:30:25.497 INFO:teuthology.orchestra.run.smithi146.stderr: 27650K .......... .......... .......... .......... .......... 37% 231M 0s 2019-12-09T11:30:25.497 INFO:teuthology.orchestra.run.smithi146.stderr: 27700K .......... .......... .......... .......... .......... 37% 229M 0s 2019-12-09T11:30:25.497 INFO:teuthology.orchestra.run.smithi146.stderr: 27750K .......... .......... .......... .......... .......... 37% 179M 0s 2019-12-09T11:30:25.497 INFO:teuthology.orchestra.run.smithi146.stderr: 27800K .......... .......... .......... .......... .......... 37% 228M 0s 2019-12-09T11:30:25.497 INFO:teuthology.orchestra.run.smithi146.stderr: 27850K .......... .......... .......... .......... .......... 37% 232M 0s 2019-12-09T11:30:25.498 INFO:teuthology.orchestra.run.smithi146.stderr: 27900K .......... .......... .......... .......... .......... 37% 232M 0s 2019-12-09T11:30:25.498 INFO:teuthology.orchestra.run.smithi146.stderr: 27950K .......... .......... .......... .......... .......... 38% 214M 0s 2019-12-09T11:30:25.498 INFO:teuthology.orchestra.run.smithi146.stderr: 28000K .......... .......... .......... .......... .......... 38% 228M 0s 2019-12-09T11:30:25.498 INFO:teuthology.orchestra.run.smithi146.stderr: 28050K .......... .......... .......... .......... .......... 38% 298M 0s 2019-12-09T11:30:25.498 INFO:teuthology.orchestra.run.smithi146.stderr: 28100K .......... .......... .......... .......... .......... 38% 315M 0s 2019-12-09T11:30:25.498 INFO:teuthology.orchestra.run.smithi146.stderr: 28150K .......... .......... .......... .......... .......... 38% 193M 0s 2019-12-09T11:30:25.498 INFO:teuthology.orchestra.run.smithi146.stderr: 28200K .......... .......... .......... .......... .......... 38% 230M 0s 2019-12-09T11:30:25.499 INFO:teuthology.orchestra.run.smithi146.stderr: 28250K .......... .......... .......... .......... .......... 38% 270M 0s 2019-12-09T11:30:25.499 INFO:teuthology.orchestra.run.smithi146.stderr: 28300K .......... .......... .......... .......... .......... 38% 316M 0s 2019-12-09T11:30:25.499 INFO:teuthology.orchestra.run.smithi146.stderr: 28350K .......... .......... .......... .......... .......... 38% 288M 0s 2019-12-09T11:30:25.499 INFO:teuthology.orchestra.run.smithi146.stderr: 28400K .......... .......... .......... .......... .......... 38% 281M 0s 2019-12-09T11:30:25.499 INFO:teuthology.orchestra.run.smithi146.stderr: 28450K .......... .......... .......... .......... .......... 38% 325M 0s 2019-12-09T11:30:25.499 INFO:teuthology.orchestra.run.smithi146.stderr: 28500K .......... .......... .......... .......... .......... 38% 290M 0s 2019-12-09T11:30:25.499 INFO:teuthology.orchestra.run.smithi146.stderr: 28550K .......... .......... .......... .......... .......... 38% 204M 0s 2019-12-09T11:30:25.500 INFO:teuthology.orchestra.run.smithi146.stderr: 28600K .......... .......... .......... .......... .......... 38% 216M 0s 2019-12-09T11:30:25.500 INFO:teuthology.orchestra.run.smithi146.stderr: 28650K .......... .......... .......... .......... .......... 39% 216M 0s 2019-12-09T11:30:25.500 INFO:teuthology.orchestra.run.smithi146.stderr: 28700K .......... .......... .......... .......... .......... 39% 219M 0s 2019-12-09T11:30:25.500 INFO:teuthology.orchestra.run.smithi146.stderr: 28750K .......... .......... .......... .......... .......... 39% 194M 0s 2019-12-09T11:30:25.500 INFO:teuthology.orchestra.run.smithi146.stderr: 28800K .......... .......... .......... .......... .......... 39% 220M 0s 2019-12-09T11:30:25.500 INFO:teuthology.orchestra.run.smithi146.stderr: 28850K .......... .......... .......... .......... .......... 39% 231M 0s 2019-12-09T11:30:25.500 INFO:teuthology.orchestra.run.smithi146.stderr: 28900K .......... .......... .......... .......... .......... 39% 220M 0s 2019-12-09T11:30:25.500 INFO:teuthology.orchestra.run.smithi146.stderr: 28950K .......... .......... .......... .......... .......... 39% 180M 0s 2019-12-09T11:30:25.501 INFO:teuthology.orchestra.run.smithi146.stderr: 29000K .......... .......... .......... .......... .......... 39% 230M 0s 2019-12-09T11:30:25.501 INFO:teuthology.orchestra.run.smithi146.stderr: 29050K .......... .......... .......... .......... .......... 39% 222M 0s 2019-12-09T11:30:25.501 INFO:teuthology.orchestra.run.smithi146.stderr: 29100K .......... .......... .......... .......... .......... 39% 222M 0s 2019-12-09T11:30:25.501 INFO:teuthology.orchestra.run.smithi146.stderr: 29150K .......... .......... .......... .......... .......... 39% 202M 0s 2019-12-09T11:30:25.501 INFO:teuthology.orchestra.run.smithi146.stderr: 29200K .......... .......... .......... .......... .......... 39% 214M 0s 2019-12-09T11:30:25.501 INFO:teuthology.orchestra.run.smithi146.stderr: 29250K .......... .......... .......... .......... .......... 39% 230M 0s 2019-12-09T11:30:25.501 INFO:teuthology.orchestra.run.smithi146.stderr: 29300K .......... .......... .......... .......... .......... 39% 229M 0s 2019-12-09T11:30:25.502 INFO:teuthology.orchestra.run.smithi146.stderr: 29350K .......... .......... .......... .......... .......... 39% 184M 0s 2019-12-09T11:30:25.502 INFO:teuthology.orchestra.run.smithi146.stderr: 29400K .......... .......... .......... .......... .......... 40% 225M 0s 2019-12-09T11:30:25.502 INFO:teuthology.orchestra.run.smithi146.stderr: 29450K .......... .......... .......... .......... .......... 40% 230M 0s 2019-12-09T11:30:25.502 INFO:teuthology.orchestra.run.smithi146.stderr: 29500K .......... .......... .......... .......... .......... 40% 239M 0s 2019-12-09T11:30:25.502 INFO:teuthology.orchestra.run.smithi146.stderr: 29550K .......... .......... .......... .......... .......... 40% 211M 0s 2019-12-09T11:30:25.502 INFO:teuthology.orchestra.run.smithi146.stderr: 29600K .......... .......... .......... .......... .......... 40% 215M 0s 2019-12-09T11:30:25.502 INFO:teuthology.orchestra.run.smithi146.stderr: 29650K .......... .......... .......... .......... .......... 40% 228M 0s 2019-12-09T11:30:25.503 INFO:teuthology.orchestra.run.smithi146.stderr: 29700K .......... .......... .......... .......... .......... 40% 234M 0s 2019-12-09T11:30:25.503 INFO:teuthology.orchestra.run.smithi146.stderr: 29750K .......... .......... .......... .......... .......... 40% 189M 0s 2019-12-09T11:30:25.503 INFO:teuthology.orchestra.run.smithi146.stderr: 29800K .......... .......... .......... .......... .......... 40% 235M 0s 2019-12-09T11:30:25.503 INFO:teuthology.orchestra.run.smithi146.stderr: 29850K .......... .......... .......... .......... .......... 40% 229M 0s 2019-12-09T11:30:25.503 INFO:teuthology.orchestra.run.smithi146.stderr: 29900K .......... .......... .......... .......... .......... 40% 242M 0s 2019-12-09T11:30:25.503 INFO:teuthology.orchestra.run.smithi146.stderr: 29950K .......... .......... .......... .......... .......... 40% 207M 0s 2019-12-09T11:30:25.503 INFO:teuthology.orchestra.run.smithi146.stderr: 30000K .......... .......... .......... .......... .......... 40% 206M 0s 2019-12-09T11:30:25.503 INFO:teuthology.orchestra.run.smithi146.stderr: 30050K .......... .......... .......... .......... .......... 40% 217M 0s 2019-12-09T11:30:25.504 INFO:teuthology.orchestra.run.smithi146.stderr: 30100K .......... .......... .......... .......... .......... 40% 209M 0s 2019-12-09T11:30:25.504 INFO:teuthology.orchestra.run.smithi146.stderr: 30150K .......... .......... .......... .......... .......... 41% 180M 0s 2019-12-09T11:30:25.504 INFO:teuthology.orchestra.run.smithi146.stderr: 30200K .......... .......... .......... .......... .......... 41% 227M 0s 2019-12-09T11:30:25.504 INFO:teuthology.orchestra.run.smithi146.stderr: 30250K .......... .......... .......... .......... .......... 41% 224M 0s 2019-12-09T11:30:25.504 INFO:teuthology.orchestra.run.smithi146.stderr: 30300K .......... .......... .......... .......... .......... 41% 215M 0s 2019-12-09T11:30:25.504 INFO:teuthology.orchestra.run.smithi146.stderr: 30350K .......... .......... .......... .......... .......... 41% 221M 0s 2019-12-09T11:30:25.504 INFO:teuthology.orchestra.run.smithi146.stderr: 30400K .......... .......... .......... .......... .......... 41% 227M 0s 2019-12-09T11:30:25.505 INFO:teuthology.orchestra.run.smithi146.stderr: 30450K .......... .......... .......... .......... .......... 41% 237M 0s 2019-12-09T11:30:25.505 INFO:teuthology.orchestra.run.smithi146.stderr: 30500K .......... .......... .......... .......... .......... 41% 228M 0s 2019-12-09T11:30:25.505 INFO:teuthology.orchestra.run.smithi146.stderr: 30550K .......... .......... .......... .......... .......... 41% 202M 0s 2019-12-09T11:30:25.505 INFO:teuthology.orchestra.run.smithi146.stderr: 30600K .......... .......... .......... .......... .......... 41% 236M 0s 2019-12-09T11:30:25.505 INFO:teuthology.orchestra.run.smithi146.stderr: 30650K .......... .......... .......... .......... .......... 41% 234M 0s 2019-12-09T11:30:25.505 INFO:teuthology.orchestra.run.smithi146.stderr: 30700K .......... .......... .......... .......... .......... 41% 240M 0s 2019-12-09T11:30:25.505 INFO:teuthology.orchestra.run.smithi146.stderr: 30750K .......... .......... .......... .......... .......... 41% 197M 0s 2019-12-09T11:30:25.506 INFO:teuthology.orchestra.run.smithi146.stderr: 30800K .......... .......... .......... .......... .......... 41% 223M 0s 2019-12-09T11:30:25.506 INFO:teuthology.orchestra.run.smithi146.stderr: 30850K .......... .......... .......... .......... .......... 42% 226M 0s 2019-12-09T11:30:25.506 INFO:teuthology.orchestra.run.smithi146.stderr: 30900K .......... .......... .......... .......... .......... 42% 221M 0s 2019-12-09T11:30:25.506 INFO:teuthology.orchestra.run.smithi146.stderr: 30950K .......... .......... .......... .......... .......... 42% 185M 0s 2019-12-09T11:30:25.506 INFO:teuthology.orchestra.run.smithi146.stderr: 31000K .......... .......... .......... .......... .......... 42% 229M 0s 2019-12-09T11:30:25.506 INFO:teuthology.orchestra.run.smithi146.stderr: 31050K .......... .......... .......... .......... .......... 42% 212M 0s 2019-12-09T11:30:25.506 INFO:teuthology.orchestra.run.smithi146.stderr: 31100K .......... .......... .......... .......... .......... 42% 215M 0s 2019-12-09T11:30:25.507 INFO:teuthology.orchestra.run.smithi146.stderr: 31150K .......... .......... .......... .......... .......... 42% 213M 0s 2019-12-09T11:30:25.507 INFO:teuthology.orchestra.run.smithi146.stderr: 31200K .......... .......... .......... .......... .......... 42% 235M 0s 2019-12-09T11:30:25.507 INFO:teuthology.orchestra.run.smithi146.stderr: 31250K .......... .......... .......... .......... .......... 42% 233M 0s 2019-12-09T11:30:25.507 INFO:teuthology.orchestra.run.smithi146.stderr: 31300K .......... .......... .......... .......... .......... 42% 228M 0s 2019-12-09T11:30:25.507 INFO:teuthology.orchestra.run.smithi146.stderr: 31350K .......... .......... .......... .......... .......... 42% 193M 0s 2019-12-09T11:30:25.507 INFO:teuthology.orchestra.run.smithi146.stderr: 31400K .......... .......... .......... .......... .......... 42% 226M 0s 2019-12-09T11:30:25.508 INFO:teuthology.orchestra.run.smithi146.stderr: 31450K .......... .......... .......... .......... .......... 42% 239M 0s 2019-12-09T11:30:25.508 INFO:teuthology.orchestra.run.smithi146.stderr: 31500K .......... .......... .......... .......... .......... 42% 240M 0s 2019-12-09T11:30:25.508 INFO:teuthology.orchestra.run.smithi146.stderr: 31550K .......... .......... .......... .......... .......... 42% 218M 0s 2019-12-09T11:30:25.508 INFO:teuthology.orchestra.run.smithi146.stderr: 31600K .......... .......... .......... .......... .......... 43% 246M 0s 2019-12-09T11:30:25.508 INFO:teuthology.orchestra.run.smithi146.stderr: 31650K .......... .......... .......... .......... .......... 43% 228M 0s 2019-12-09T11:30:25.508 INFO:teuthology.orchestra.run.smithi146.stderr: 31700K .......... .......... .......... .......... .......... 43% 232M 0s 2019-12-09T11:30:25.509 INFO:teuthology.orchestra.run.smithi146.stderr: 31750K .......... .......... .......... .......... .......... 43% 196M 0s 2019-12-09T11:30:25.509 INFO:teuthology.orchestra.run.smithi146.stderr: 31800K .......... .......... .......... .......... .......... 43% 229M 0s 2019-12-09T11:30:25.509 INFO:teuthology.orchestra.run.smithi146.stderr: 31850K .......... .......... .......... .......... .......... 43% 230M 0s 2019-12-09T11:30:25.509 INFO:teuthology.orchestra.run.smithi146.stderr: 31900K .......... .......... .......... .......... .......... 43% 223M 0s 2019-12-09T11:30:25.509 INFO:teuthology.orchestra.run.smithi146.stderr: 31950K .......... .......... .......... .......... .......... 43% 211M 0s 2019-12-09T11:30:25.509 INFO:teuthology.orchestra.run.smithi146.stderr: 32000K .......... .......... .......... .......... .......... 43% 224M 0s 2019-12-09T11:30:25.509 INFO:teuthology.orchestra.run.smithi146.stderr: 32050K .......... .......... .......... .......... .......... 43% 231M 0s 2019-12-09T11:30:25.509 INFO:teuthology.orchestra.run.smithi146.stderr: 32100K .......... .......... .......... .......... .......... 43% 218M 0s 2019-12-09T11:30:25.510 INFO:teuthology.orchestra.run.smithi146.stderr: 32150K .......... .......... .......... .......... .......... 43% 178M 0s 2019-12-09T11:30:25.510 INFO:teuthology.orchestra.run.smithi146.stderr: 32200K .......... .......... .......... .......... .......... 43% 224M 0s 2019-12-09T11:30:25.510 INFO:teuthology.orchestra.run.smithi146.stderr: 32250K .......... .......... .......... .......... .......... 43% 219M 0s 2019-12-09T11:30:25.510 INFO:teuthology.orchestra.run.smithi146.stderr: 32300K .......... .......... .......... .......... .......... 43% 212M 0s 2019-12-09T11:30:25.510 INFO:teuthology.orchestra.run.smithi146.stderr: 32350K .......... .......... .......... .......... .......... 44% 200M 0s 2019-12-09T11:30:25.510 INFO:teuthology.orchestra.run.smithi146.stderr: 32400K .......... .......... .......... .......... .......... 44% 228M 0s 2019-12-09T11:30:25.510 INFO:teuthology.orchestra.run.smithi146.stderr: 32450K .......... .......... .......... .......... .......... 44% 214M 0s 2019-12-09T11:30:25.511 INFO:teuthology.orchestra.run.smithi146.stderr: 32500K .......... .......... .......... .......... .......... 44% 242M 0s 2019-12-09T11:30:25.511 INFO:teuthology.orchestra.run.smithi146.stderr: 32550K .......... .......... .......... .......... .......... 44% 201M 0s 2019-12-09T11:30:25.511 INFO:teuthology.orchestra.run.smithi146.stderr: 32600K .......... .......... .......... .......... .......... 44% 234M 0s 2019-12-09T11:30:25.511 INFO:teuthology.orchestra.run.smithi146.stderr: 32650K .......... .......... .......... .......... .......... 44% 238M 0s 2019-12-09T11:30:25.511 INFO:teuthology.orchestra.run.smithi146.stderr: 32700K .......... .......... .......... .......... .......... 44% 236M 0s 2019-12-09T11:30:25.511 INFO:teuthology.orchestra.run.smithi146.stderr: 32750K .......... .......... .......... .......... .......... 44% 216M 0s 2019-12-09T11:30:25.512 INFO:teuthology.orchestra.run.smithi146.stderr: 32800K .......... .......... .......... .......... .......... 44% 243M 0s 2019-12-09T11:30:25.512 INFO:teuthology.orchestra.run.smithi146.stderr: 32850K .......... .......... .......... .......... .......... 44% 247M 0s 2019-12-09T11:30:25.512 INFO:teuthology.orchestra.run.smithi146.stderr: 32900K .......... .......... .......... .......... .......... 44% 244M 0s 2019-12-09T11:30:25.513 INFO:teuthology.orchestra.run.smithi146.stderr: 32950K .......... .......... .......... .......... .......... 44% 199M 0s 2019-12-09T11:30:25.513 INFO:teuthology.orchestra.run.smithi146.stderr: 33000K .......... .......... .......... .......... .......... 44% 237M 0s 2019-12-09T11:30:25.513 INFO:teuthology.orchestra.run.smithi146.stderr: 33050K .......... .......... .......... .......... .......... 44% 242M 0s 2019-12-09T11:30:25.513 INFO:teuthology.orchestra.run.smithi146.stderr: 33100K .......... .......... .......... .......... .......... 45% 248M 0s 2019-12-09T11:30:25.513 INFO:teuthology.orchestra.run.smithi146.stderr: 33150K .......... .......... .......... .......... .......... 45% 217M 0s 2019-12-09T11:30:25.514 INFO:teuthology.orchestra.run.smithi146.stderr: 33200K .......... .......... .......... .......... .......... 45% 242M 0s 2019-12-09T11:30:25.514 INFO:teuthology.orchestra.run.smithi146.stderr: 33250K .......... .......... .......... .......... .......... 45% 239M 0s 2019-12-09T11:30:25.514 INFO:teuthology.orchestra.run.smithi146.stderr: 33300K .......... .......... .......... .......... .......... 45% 252M 0s 2019-12-09T11:30:25.514 INFO:teuthology.orchestra.run.smithi146.stderr: 33350K .......... .......... .......... .......... .......... 45% 204M 0s 2019-12-09T11:30:25.514 INFO:teuthology.orchestra.run.smithi146.stderr: 33400K .......... .......... .......... .......... .......... 45% 252M 0s 2019-12-09T11:30:25.515 INFO:teuthology.orchestra.run.smithi146.stderr: 33450K .......... .......... .......... .......... .......... 45% 230M 0s 2019-12-09T11:30:25.515 INFO:teuthology.orchestra.run.smithi146.stderr: 33500K .......... .......... .......... .......... .......... 45% 219M 0s 2019-12-09T11:30:25.515 INFO:teuthology.orchestra.run.smithi146.stderr: 33550K .......... .......... .......... .......... .......... 45% 206M 0s 2019-12-09T11:30:25.515 INFO:teuthology.orchestra.run.smithi146.stderr: 33600K .......... .......... .......... .......... .......... 45% 233M 0s 2019-12-09T11:30:25.515 INFO:teuthology.orchestra.run.smithi146.stderr: 33650K .......... .......... .......... .......... .......... 45% 231M 0s 2019-12-09T11:30:25.515 INFO:teuthology.orchestra.run.smithi146.stderr: 33700K .......... .......... .......... .......... .......... 45% 225M 0s 2019-12-09T11:30:25.515 INFO:teuthology.orchestra.run.smithi146.stderr: 33750K .......... .......... .......... .......... .......... 45% 182M 0s 2019-12-09T11:30:25.516 INFO:teuthology.orchestra.run.smithi146.stderr: 33800K .......... .......... .......... .......... .......... 46% 215M 0s 2019-12-09T11:30:25.516 INFO:teuthology.orchestra.run.smithi146.stderr: 33850K .......... .......... .......... .......... .......... 46% 240M 0s 2019-12-09T11:30:25.516 INFO:teuthology.orchestra.run.smithi146.stderr: 33900K .......... .......... .......... .......... .......... 46% 228M 0s 2019-12-09T11:30:25.516 INFO:teuthology.orchestra.run.smithi146.stderr: 33950K .......... .......... .......... .......... .......... 46% 214M 0s 2019-12-09T11:30:25.516 INFO:teuthology.orchestra.run.smithi146.stderr: 34000K .......... .......... .......... .......... .......... 46% 249M 0s 2019-12-09T11:30:25.516 INFO:teuthology.orchestra.run.smithi146.stderr: 34050K .......... .......... .......... .......... .......... 46% 241M 0s 2019-12-09T11:30:25.516 INFO:teuthology.orchestra.run.smithi146.stderr: 34100K .......... .......... .......... .......... .......... 46% 234M 0s 2019-12-09T11:30:25.517 INFO:teuthology.orchestra.run.smithi146.stderr: 34150K .......... .......... .......... .......... .......... 46% 193M 0s 2019-12-09T11:30:25.517 INFO:teuthology.orchestra.run.smithi146.stderr: 34200K .......... .......... .......... .......... .......... 46% 236M 0s 2019-12-09T11:30:25.517 INFO:teuthology.orchestra.run.smithi146.stderr: 34250K .......... .......... .......... .......... .......... 46% 232M 0s 2019-12-09T11:30:25.517 INFO:teuthology.orchestra.run.smithi146.stderr: 34300K .......... .......... .......... .......... .......... 46% 245M 0s 2019-12-09T11:30:25.517 INFO:teuthology.orchestra.run.smithi146.stderr: 34350K .......... .......... .......... .......... .......... 46% 197M 0s 2019-12-09T11:30:25.517 INFO:teuthology.orchestra.run.smithi146.stderr: 34400K .......... .......... .......... .......... .......... 46% 228M 0s 2019-12-09T11:30:25.517 INFO:teuthology.orchestra.run.smithi146.stderr: 34450K .......... .......... .......... .......... .......... 46% 243M 0s 2019-12-09T11:30:25.518 INFO:teuthology.orchestra.run.smithi146.stderr: 34500K .......... .......... .......... .......... .......... 46% 236M 0s 2019-12-09T11:30:25.518 INFO:teuthology.orchestra.run.smithi146.stderr: 34550K .......... .......... .......... .......... .......... 47% 203M 0s 2019-12-09T11:30:25.518 INFO:teuthology.orchestra.run.smithi146.stderr: 34600K .......... .......... .......... .......... .......... 47% 249M 0s 2019-12-09T11:30:25.518 INFO:teuthology.orchestra.run.smithi146.stderr: 34650K .......... .......... .......... .......... .......... 47% 233M 0s 2019-12-09T11:30:25.518 INFO:teuthology.orchestra.run.smithi146.stderr: 34700K .......... .......... .......... .......... .......... 47% 248M 0s 2019-12-09T11:30:25.518 INFO:teuthology.orchestra.run.smithi146.stderr: 34750K .......... .......... .......... .......... .......... 47% 224M 0s 2019-12-09T11:30:25.518 INFO:teuthology.orchestra.run.smithi146.stderr: 34800K .......... .......... .......... .......... .......... 47% 237M 0s 2019-12-09T11:30:25.519 INFO:teuthology.orchestra.run.smithi146.stderr: 34850K .......... .......... .......... .......... .......... 47% 257M 0s 2019-12-09T11:30:25.519 INFO:teuthology.orchestra.run.smithi146.stderr: 34900K .......... .......... .......... .......... .......... 47% 243M 0s 2019-12-09T11:30:25.519 INFO:teuthology.orchestra.run.smithi146.stderr: 34950K .......... .......... .......... .......... .......... 47% 206M 0s 2019-12-09T11:30:25.520 INFO:teuthology.orchestra.run.smithi146.stderr: 35000K .......... .......... .......... .......... .......... 47% 257M 0s 2019-12-09T11:30:25.520 INFO:teuthology.orchestra.run.smithi146.stderr: 35050K .......... .......... .......... .......... .......... 47% 259M 0s 2019-12-09T11:30:25.520 INFO:teuthology.orchestra.run.smithi146.stderr: 35100K .......... .......... .......... .......... .......... 47% 254M 0s 2019-12-09T11:30:25.520 INFO:teuthology.orchestra.run.smithi146.stderr: 35150K .......... .......... .......... .......... .......... 47% 228M 0s 2019-12-09T11:30:25.520 INFO:teuthology.orchestra.run.smithi146.stderr: 35200K .......... .......... .......... .......... .......... 47% 261M 0s 2019-12-09T11:30:25.520 INFO:teuthology.orchestra.run.smithi146.stderr: 35250K .......... .......... .......... .......... .......... 47% 253M 0s 2019-12-09T11:30:25.520 INFO:teuthology.orchestra.run.smithi146.stderr: 35300K .......... .......... .......... .......... .......... 48% 221M 0s 2019-12-09T11:30:25.521 INFO:teuthology.orchestra.run.smithi146.stderr: 35350K .......... .......... .......... .......... .......... 48% 191M 0s 2019-12-09T11:30:25.521 INFO:teuthology.orchestra.run.smithi146.stderr: 35400K .......... .......... .......... .......... .......... 48% 247M 0s 2019-12-09T11:30:25.521 INFO:teuthology.orchestra.run.smithi146.stderr: 35450K .......... .......... .......... .......... .......... 48% 232M 0s 2019-12-09T11:30:25.521 INFO:teuthology.orchestra.run.smithi146.stderr: 35500K .......... .......... .......... .......... .......... 48% 233M 0s 2019-12-09T11:30:25.521 INFO:teuthology.orchestra.run.smithi146.stderr: 35550K .......... .......... .......... .......... .......... 48% 230M 0s 2019-12-09T11:30:25.521 INFO:teuthology.orchestra.run.smithi146.stderr: 35600K .......... .......... .......... .......... .......... 48% 245M 0s 2019-12-09T11:30:25.521 INFO:teuthology.orchestra.run.smithi146.stderr: 35650K .......... .......... .......... .......... .......... 48% 254M 0s 2019-12-09T11:30:25.521 INFO:teuthology.orchestra.run.smithi146.stderr: 35700K .......... .......... .......... .......... .......... 48% 259M 0s 2019-12-09T11:30:25.522 INFO:teuthology.orchestra.run.smithi146.stderr: 35750K .......... .......... .......... .......... .......... 48% 204M 0s 2019-12-09T11:30:25.522 INFO:teuthology.orchestra.run.smithi146.stderr: 35800K .......... .......... .......... .......... .......... 48% 260M 0s 2019-12-09T11:30:25.522 INFO:teuthology.orchestra.run.smithi146.stderr: 35850K .......... .......... .......... .......... .......... 48% 238M 0s 2019-12-09T11:30:25.522 INFO:teuthology.orchestra.run.smithi146.stderr: 35900K .......... .......... .......... .......... .......... 48% 253M 0s 2019-12-09T11:30:25.523 INFO:teuthology.orchestra.run.smithi146.stderr: 35950K .......... .......... .......... .......... .......... 48% 222M 0s 2019-12-09T11:30:25.523 INFO:teuthology.orchestra.run.smithi146.stderr: 36000K .......... .......... .......... .......... .......... 49% 247M 0s 2019-12-09T11:30:25.523 INFO:teuthology.orchestra.run.smithi146.stderr: 36050K .......... .......... .......... .......... .......... 49% 234M 0s 2019-12-09T11:30:25.523 INFO:teuthology.orchestra.run.smithi146.stderr: 36100K .......... .......... .......... .......... .......... 49% 246M 0s 2019-12-09T11:30:25.524 INFO:teuthology.orchestra.run.smithi146.stderr: 36150K .......... .......... .......... .......... .......... 49% 204M 0s 2019-12-09T11:30:25.524 INFO:teuthology.orchestra.run.smithi146.stderr: 36200K .......... .......... .......... .......... .......... 49% 251M 0s 2019-12-09T11:30:25.524 INFO:teuthology.orchestra.run.smithi146.stderr: 36250K .......... .......... .......... .......... .......... 49% 241M 0s 2019-12-09T11:30:25.524 INFO:teuthology.orchestra.run.smithi146.stderr: 36300K .......... .......... .......... .......... .......... 49% 241M 0s 2019-12-09T11:30:25.524 INFO:teuthology.orchestra.run.smithi146.stderr: 36350K .......... .......... .......... .......... .......... 49% 210M 0s 2019-12-09T11:30:25.524 INFO:teuthology.orchestra.run.smithi146.stderr: 36400K .......... .......... .......... .......... .......... 49% 244M 0s 2019-12-09T11:30:25.524 INFO:teuthology.orchestra.run.smithi146.stderr: 36450K .......... .......... .......... .......... .......... 49% 244M 0s 2019-12-09T11:30:25.524 INFO:teuthology.orchestra.run.smithi146.stderr: 36500K .......... .......... .......... .......... .......... 49% 245M 0s 2019-12-09T11:30:25.525 INFO:teuthology.orchestra.run.smithi146.stderr: 36550K .......... .......... .......... .......... .......... 49% 200M 0s 2019-12-09T11:30:25.525 INFO:teuthology.orchestra.run.smithi146.stderr: 36600K .......... .......... .......... .......... .......... 49% 243M 0s 2019-12-09T11:30:25.525 INFO:teuthology.orchestra.run.smithi146.stderr: 36650K .......... .......... .......... .......... .......... 49% 254M 0s 2019-12-09T11:30:25.525 INFO:teuthology.orchestra.run.smithi146.stderr: 36700K .......... .......... .......... .......... .......... 49% 254M 0s 2019-12-09T11:30:25.525 INFO:teuthology.orchestra.run.smithi146.stderr: 36750K .......... .......... .......... .......... .......... 50% 226M 0s 2019-12-09T11:30:25.525 INFO:teuthology.orchestra.run.smithi146.stderr: 36800K .......... .......... .......... .......... .......... 50% 250M 0s 2019-12-09T11:30:25.525 INFO:teuthology.orchestra.run.smithi146.stderr: 36850K .......... .......... .......... .......... .......... 50% 251M 0s 2019-12-09T11:30:25.526 INFO:teuthology.orchestra.run.smithi146.stderr: 36900K .......... .......... .......... .......... .......... 50% 260M 0s 2019-12-09T11:30:25.526 INFO:teuthology.orchestra.run.smithi146.stderr: 36950K .......... .......... .......... .......... .......... 50% 213M 0s 2019-12-09T11:30:25.526 INFO:teuthology.orchestra.run.smithi146.stderr: 37000K .......... .......... .......... .......... .......... 50% 248M 0s 2019-12-09T11:30:25.526 INFO:teuthology.orchestra.run.smithi146.stderr: 37050K .......... .......... .......... .......... .......... 50% 250M 0s 2019-12-09T11:30:25.526 INFO:teuthology.orchestra.run.smithi146.stderr: 37100K .......... .......... .......... .......... .......... 50% 252M 0s 2019-12-09T11:30:25.526 INFO:teuthology.orchestra.run.smithi146.stderr: 37150K .......... .......... .......... .......... .......... 50% 220M 0s 2019-12-09T11:30:25.527 INFO:teuthology.orchestra.run.smithi146.stderr: 37200K .......... .......... .......... .......... .......... 50% 270M 0s 2019-12-09T11:30:25.527 INFO:teuthology.orchestra.run.smithi146.stderr: 37250K .......... .......... .......... .......... .......... 50% 260M 0s 2019-12-09T11:30:25.527 INFO:teuthology.orchestra.run.smithi146.stderr: 37300K .......... .......... .......... .......... .......... 50% 255M 0s 2019-12-09T11:30:25.527 INFO:teuthology.orchestra.run.smithi146.stderr: 37350K .......... .......... .......... .......... .......... 50% 211M 0s 2019-12-09T11:30:25.527 INFO:teuthology.orchestra.run.smithi146.stderr: 37400K .......... .......... .......... .......... .......... 50% 243M 0s 2019-12-09T11:30:25.527 INFO:teuthology.orchestra.run.smithi146.stderr: 37450K .......... .......... .......... .......... .......... 50% 243M 0s 2019-12-09T11:30:25.527 INFO:teuthology.orchestra.run.smithi146.stderr: 37500K .......... .......... .......... .......... .......... 51% 249M 0s 2019-12-09T11:30:25.528 INFO:teuthology.orchestra.run.smithi146.stderr: 37550K .......... .......... .......... .......... .......... 51% 217M 0s 2019-12-09T11:30:25.528 INFO:teuthology.orchestra.run.smithi146.stderr: 37600K .......... .......... .......... .......... .......... 51% 263M 0s 2019-12-09T11:30:25.528 INFO:teuthology.orchestra.run.smithi146.stderr: 37650K .......... .......... .......... .......... .......... 51% 253M 0s 2019-12-09T11:30:25.528 INFO:teuthology.orchestra.run.smithi146.stderr: 37700K .......... .......... .......... .......... .......... 51% 254M 0s 2019-12-09T11:30:25.528 INFO:teuthology.orchestra.run.smithi146.stderr: 37750K .......... .......... .......... .......... .......... 51% 215M 0s 2019-12-09T11:30:25.528 INFO:teuthology.orchestra.run.smithi146.stderr: 37800K .......... .......... .......... .......... .......... 51% 255M 0s 2019-12-09T11:30:25.528 INFO:teuthology.orchestra.run.smithi146.stderr: 37850K .......... .......... .......... .......... .......... 51% 255M 0s 2019-12-09T11:30:25.529 INFO:teuthology.orchestra.run.smithi146.stderr: 37900K .......... .......... .......... .......... .......... 51% 250M 0s 2019-12-09T11:30:25.529 INFO:teuthology.orchestra.run.smithi146.stderr: 37950K .......... .......... .......... .......... .......... 51% 237M 0s 2019-12-09T11:30:25.529 INFO:teuthology.orchestra.run.smithi146.stderr: 38000K .......... .......... .......... .......... .......... 51% 263M 0s 2019-12-09T11:30:25.529 INFO:teuthology.orchestra.run.smithi146.stderr: 38050K .......... .......... .......... .......... .......... 51% 250M 0s 2019-12-09T11:30:25.529 INFO:teuthology.orchestra.run.smithi146.stderr: 38100K .......... .......... .......... .......... .......... 51% 250M 0s 2019-12-09T11:30:25.530 INFO:teuthology.orchestra.run.smithi146.stderr: 38150K .......... .......... .......... .......... .......... 51% 213M 0s 2019-12-09T11:30:25.530 INFO:teuthology.orchestra.run.smithi146.stderr: 38200K .......... .......... .......... .......... .......... 51% 260M 0s 2019-12-09T11:30:25.530 INFO:teuthology.orchestra.run.smithi146.stderr: 38250K .......... .......... .......... .......... .......... 52% 262M 0s 2019-12-09T11:30:25.530 INFO:teuthology.orchestra.run.smithi146.stderr: 38300K .......... .......... .......... .......... .......... 52% 255M 0s 2019-12-09T11:30:25.530 INFO:teuthology.orchestra.run.smithi146.stderr: 38350K .......... .......... .......... .......... .......... 52% 234M 0s 2019-12-09T11:30:25.530 INFO:teuthology.orchestra.run.smithi146.stderr: 38400K .......... .......... .......... .......... .......... 52% 266M 0s 2019-12-09T11:30:25.530 INFO:teuthology.orchestra.run.smithi146.stderr: 38450K .......... .......... .......... .......... .......... 52% 264M 0s 2019-12-09T11:30:25.531 INFO:teuthology.orchestra.run.smithi146.stderr: 38500K .......... .......... .......... .......... .......... 52% 270M 0s 2019-12-09T11:30:25.531 INFO:teuthology.orchestra.run.smithi146.stderr: 38550K .......... .......... .......... .......... .......... 52% 216M 0s 2019-12-09T11:30:25.531 INFO:teuthology.orchestra.run.smithi146.stderr: 38600K .......... .......... .......... .......... .......... 52% 262M 0s 2019-12-09T11:30:25.531 INFO:teuthology.orchestra.run.smithi146.stderr: 38650K .......... .......... .......... .......... .......... 52% 260M 0s 2019-12-09T11:30:25.531 INFO:teuthology.orchestra.run.smithi146.stderr: 38700K .......... .......... .......... .......... .......... 52% 260M 0s 2019-12-09T11:30:25.531 INFO:teuthology.orchestra.run.smithi146.stderr: 38750K .......... .......... .......... .......... .......... 52% 232M 0s 2019-12-09T11:30:25.531 INFO:teuthology.orchestra.run.smithi146.stderr: 38800K .......... .......... .......... .......... .......... 52% 262M 0s 2019-12-09T11:30:25.532 INFO:teuthology.orchestra.run.smithi146.stderr: 38850K .......... .......... .......... .......... .......... 52% 244M 0s 2019-12-09T11:30:25.532 INFO:teuthology.orchestra.run.smithi146.stderr: 38900K .......... .......... .......... .......... .......... 52% 255M 0s 2019-12-09T11:30:25.532 INFO:teuthology.orchestra.run.smithi146.stderr: 38950K .......... .......... .......... .......... .......... 53% 210M 0s 2019-12-09T11:30:25.532 INFO:teuthology.orchestra.run.smithi146.stderr: 39000K .......... .......... .......... .......... .......... 53% 240M 0s 2019-12-09T11:30:25.532 INFO:teuthology.orchestra.run.smithi146.stderr: 39050K .......... .......... .......... .......... .......... 53% 250M 0s 2019-12-09T11:30:25.532 INFO:teuthology.orchestra.run.smithi146.stderr: 39100K .......... .......... .......... .......... .......... 53% 260M 0s 2019-12-09T11:30:25.532 INFO:teuthology.orchestra.run.smithi146.stderr: 39150K .......... .......... .......... .......... .......... 53% 221M 0s 2019-12-09T11:30:25.533 INFO:teuthology.orchestra.run.smithi146.stderr: 39200K .......... .......... .......... .......... .......... 53% 240M 0s 2019-12-09T11:30:25.533 INFO:teuthology.orchestra.run.smithi146.stderr: 39250K .......... .......... .......... .......... .......... 53% 262M 0s 2019-12-09T11:30:25.533 INFO:teuthology.orchestra.run.smithi146.stderr: 39300K .......... .......... .......... .......... .......... 53% 254M 0s 2019-12-09T11:30:25.534 INFO:teuthology.orchestra.run.smithi146.stderr: 39350K .......... .......... .......... .......... .......... 53% 209M 0s 2019-12-09T11:30:25.534 INFO:teuthology.orchestra.run.smithi146.stderr: 39400K .......... .......... .......... .......... .......... 53% 262M 0s 2019-12-09T11:30:25.534 INFO:teuthology.orchestra.run.smithi146.stderr: 39450K .......... .......... .......... .......... .......... 53% 249M 0s 2019-12-09T11:30:25.534 INFO:teuthology.orchestra.run.smithi146.stderr: 39500K .......... .......... .......... .......... .......... 53% 264M 0s 2019-12-09T11:30:25.535 INFO:teuthology.orchestra.run.smithi146.stderr: 39550K .......... .......... .......... .......... .......... 53% 230M 0s 2019-12-09T11:30:25.535 INFO:teuthology.orchestra.run.smithi146.stderr: 39600K .......... .......... .......... .......... .......... 53% 248M 0s 2019-12-09T11:30:25.535 INFO:teuthology.orchestra.run.smithi146.stderr: 39650K .......... .......... .......... .......... .......... 53% 253M 0s 2019-12-09T11:30:25.535 INFO:teuthology.orchestra.run.smithi146.stderr: 39700K .......... .......... .......... .......... .......... 54% 242M 0s 2019-12-09T11:30:25.535 INFO:teuthology.orchestra.run.smithi146.stderr: 39750K .......... .......... .......... .......... .......... 54% 213M 0s 2019-12-09T11:30:25.535 INFO:teuthology.orchestra.run.smithi146.stderr: 39800K .......... .......... .......... .......... .......... 54% 249M 0s 2019-12-09T11:30:25.536 INFO:teuthology.orchestra.run.smithi146.stderr: 39850K .......... .......... .......... .......... .......... 54% 260M 0s 2019-12-09T11:30:25.536 INFO:teuthology.orchestra.run.smithi146.stderr: 39900K .......... .......... .......... .......... .......... 54% 263M 0s 2019-12-09T11:30:25.536 INFO:teuthology.orchestra.run.smithi146.stderr: 39950K .......... .......... .......... .......... .......... 54% 239M 0s 2019-12-09T11:30:25.536 INFO:teuthology.orchestra.run.smithi146.stderr: 40000K .......... .......... .......... .......... .......... 54% 272M 0s 2019-12-09T11:30:25.536 INFO:teuthology.orchestra.run.smithi146.stderr: 40050K .......... .......... .......... .......... .......... 54% 260M 0s 2019-12-09T11:30:25.536 INFO:teuthology.orchestra.run.smithi146.stderr: 40100K .......... .......... .......... .......... .......... 54% 259M 0s 2019-12-09T11:30:25.537 INFO:teuthology.orchestra.run.smithi146.stderr: 40150K .......... .......... .......... .......... .......... 54% 227M 0s 2019-12-09T11:30:25.537 INFO:teuthology.orchestra.run.smithi146.stderr: 40200K .......... .......... .......... .......... .......... 54% 275M 0s 2019-12-09T11:30:25.537 INFO:teuthology.orchestra.run.smithi146.stderr: 40250K .......... .......... .......... .......... .......... 54% 261M 0s 2019-12-09T11:30:25.537 INFO:teuthology.orchestra.run.smithi146.stderr: 40300K .......... .......... .......... .......... .......... 54% 269M 0s 2019-12-09T11:30:25.537 INFO:teuthology.orchestra.run.smithi146.stderr: 40350K .......... .......... .......... .......... .......... 54% 241M 0s 2019-12-09T11:30:25.537 INFO:teuthology.orchestra.run.smithi146.stderr: 40400K .......... .......... .......... .......... .......... 54% 268M 0s 2019-12-09T11:30:25.537 INFO:teuthology.orchestra.run.smithi146.stderr: 40450K .......... .......... .......... .......... .......... 55% 266M 0s 2019-12-09T11:30:25.538 INFO:teuthology.orchestra.run.smithi146.stderr: 40500K .......... .......... .......... .......... .......... 55% 266M 0s 2019-12-09T11:30:25.538 INFO:teuthology.orchestra.run.smithi146.stderr: 40550K .......... .......... .......... .......... .......... 55% 228M 0s 2019-12-09T11:30:25.538 INFO:teuthology.orchestra.run.smithi146.stderr: 40600K .......... .......... .......... .......... .......... 55% 266M 0s 2019-12-09T11:30:25.538 INFO:teuthology.orchestra.run.smithi146.stderr: 40650K .......... .......... .......... .......... .......... 55% 260M 0s 2019-12-09T11:30:25.538 INFO:teuthology.orchestra.run.smithi146.stderr: 40700K .......... .......... .......... .......... .......... 55% 258M 0s 2019-12-09T11:30:25.538 INFO:teuthology.orchestra.run.smithi146.stderr: 40750K .......... .......... .......... .......... .......... 55% 245M 0s 2019-12-09T11:30:25.538 INFO:teuthology.orchestra.run.smithi146.stderr: 40800K .......... .......... .......... .......... .......... 55% 249M 0s 2019-12-09T11:30:25.538 INFO:teuthology.orchestra.run.smithi146.stderr: 40850K .......... .......... .......... .......... .......... 55% 253M 0s 2019-12-09T11:30:25.539 INFO:teuthology.orchestra.run.smithi146.stderr: 40900K .......... .......... .......... .......... .......... 55% 244M 0s 2019-12-09T11:30:25.539 INFO:teuthology.orchestra.run.smithi146.stderr: 40950K .......... .......... .......... .......... .......... 55% 222M 0s 2019-12-09T11:30:25.539 INFO:teuthology.orchestra.run.smithi146.stderr: 41000K .......... .......... .......... .......... .......... 55% 269M 0s 2019-12-09T11:30:25.539 INFO:teuthology.orchestra.run.smithi146.stderr: 41050K .......... .......... .......... .......... .......... 55% 237M 0s 2019-12-09T11:30:25.539 INFO:teuthology.orchestra.run.smithi146.stderr: 41100K .......... .......... .......... .......... .......... 55% 255M 0s 2019-12-09T11:30:25.539 INFO:teuthology.orchestra.run.smithi146.stderr: 41150K .......... .......... .......... .......... .......... 56% 236M 0s 2019-12-09T11:30:25.539 INFO:teuthology.orchestra.run.smithi146.stderr: 41200K .......... .......... .......... .......... .......... 56% 259M 0s 2019-12-09T11:30:25.540 INFO:teuthology.orchestra.run.smithi146.stderr: 41250K .......... .......... .......... .......... .......... 56% 262M 0s 2019-12-09T11:30:25.540 INFO:teuthology.orchestra.run.smithi146.stderr: 41300K .......... .......... .......... .......... .......... 56% 263M 0s 2019-12-09T11:30:25.540 INFO:teuthology.orchestra.run.smithi146.stderr: 41350K .......... .......... .......... .......... .......... 56% 210M 0s 2019-12-09T11:30:25.540 INFO:teuthology.orchestra.run.smithi146.stderr: 41400K .......... .......... .......... .......... .......... 56% 257M 0s 2019-12-09T11:30:25.540 INFO:teuthology.orchestra.run.smithi146.stderr: 41450K .......... .......... .......... .......... .......... 56% 274M 0s 2019-12-09T11:30:25.540 INFO:teuthology.orchestra.run.smithi146.stderr: 41500K .......... .......... .......... .......... .......... 56% 267M 0s 2019-12-09T11:30:25.540 INFO:teuthology.orchestra.run.smithi146.stderr: 41550K .......... .......... .......... .......... .......... 56% 237M 0s 2019-12-09T11:30:25.541 INFO:teuthology.orchestra.run.smithi146.stderr: 41600K .......... .......... .......... .......... .......... 56% 272M 0s 2019-12-09T11:30:25.541 INFO:teuthology.orchestra.run.smithi146.stderr: 41650K .......... .......... .......... .......... .......... 56% 263M 0s 2019-12-09T11:30:25.541 INFO:teuthology.orchestra.run.smithi146.stderr: 41700K .......... .......... .......... .......... .......... 56% 270M 0s 2019-12-09T11:30:25.541 INFO:teuthology.orchestra.run.smithi146.stderr: 41750K .......... .......... .......... .......... .......... 56% 228M 0s 2019-12-09T11:30:25.541 INFO:teuthology.orchestra.run.smithi146.stderr: 41800K .......... .......... .......... .......... .......... 56% 267M 0s 2019-12-09T11:30:25.541 INFO:teuthology.orchestra.run.smithi146.stderr: 41850K .......... .......... .......... .......... .......... 56% 275M 0s 2019-12-09T11:30:25.541 INFO:teuthology.orchestra.run.smithi146.stderr: 41900K .......... .......... .......... .......... .......... 57% 262M 0s 2019-12-09T11:30:25.542 INFO:teuthology.orchestra.run.smithi146.stderr: 41950K .......... .......... .......... .......... .......... 57% 249M 0s 2019-12-09T11:30:25.542 INFO:teuthology.orchestra.run.smithi146.stderr: 42000K .......... .......... .......... .......... .......... 57% 268M 0s 2019-12-09T11:30:25.542 INFO:teuthology.orchestra.run.smithi146.stderr: 42050K .......... .......... .......... .......... .......... 57% 274M 0s 2019-12-09T11:30:25.542 INFO:teuthology.orchestra.run.smithi146.stderr: 42100K .......... .......... .......... .......... .......... 57% 277M 0s 2019-12-09T11:30:25.542 INFO:teuthology.orchestra.run.smithi146.stderr: 42150K .......... .......... .......... .......... .......... 57% 209M 0s 2019-12-09T11:30:25.542 INFO:teuthology.orchestra.run.smithi146.stderr: 42200K .......... .......... .......... .......... .......... 57% 263M 0s 2019-12-09T11:30:25.542 INFO:teuthology.orchestra.run.smithi146.stderr: 42250K .......... .......... .......... .......... .......... 57% 266M 0s 2019-12-09T11:30:25.543 INFO:teuthology.orchestra.run.smithi146.stderr: 42300K .......... .......... .......... .......... .......... 57% 236M 0s 2019-12-09T11:30:25.543 INFO:teuthology.orchestra.run.smithi146.stderr: 42350K .......... .......... .......... .......... .......... 57% 238M 0s 2019-12-09T11:30:25.543 INFO:teuthology.orchestra.run.smithi146.stderr: 42400K .......... .......... .......... .......... .......... 57% 250M 0s 2019-12-09T11:30:25.543 INFO:teuthology.orchestra.run.smithi146.stderr: 42450K .......... .......... .......... .......... .......... 57% 257M 0s 2019-12-09T11:30:25.543 INFO:teuthology.orchestra.run.smithi146.stderr: 42500K .......... .......... .......... .......... .......... 57% 280M 0s 2019-12-09T11:30:25.543 INFO:teuthology.orchestra.run.smithi146.stderr: 42550K .......... .......... .......... .......... .......... 57% 227M 0s 2019-12-09T11:30:25.543 INFO:teuthology.orchestra.run.smithi146.stderr: 42600K .......... .......... .......... .......... .......... 57% 252M 0s 2019-12-09T11:30:25.544 INFO:teuthology.orchestra.run.smithi146.stderr: 42650K .......... .......... .......... .......... .......... 58% 255M 0s 2019-12-09T11:30:25.544 INFO:teuthology.orchestra.run.smithi146.stderr: 42700K .......... .......... .......... .......... .......... 58% 270M 0s 2019-12-09T11:30:25.544 INFO:teuthology.orchestra.run.smithi146.stderr: 42750K .......... .......... .......... .......... .......... 58% 239M 0s 2019-12-09T11:30:25.544 INFO:teuthology.orchestra.run.smithi146.stderr: 42800K .......... .......... .......... .......... .......... 58% 263M 0s 2019-12-09T11:30:25.544 INFO:teuthology.orchestra.run.smithi146.stderr: 42850K .......... .......... .......... .......... .......... 58% 268M 0s 2019-12-09T11:30:25.544 INFO:teuthology.orchestra.run.smithi146.stderr: 42900K .......... .......... .......... .......... .......... 58% 270M 0s 2019-12-09T11:30:25.544 INFO:teuthology.orchestra.run.smithi146.stderr: 42950K .......... .......... .......... .......... .......... 58% 226M 0s 2019-12-09T11:30:25.545 INFO:teuthology.orchestra.run.smithi146.stderr: 43000K .......... .......... .......... .......... .......... 58% 270M 0s 2019-12-09T11:30:25.545 INFO:teuthology.orchestra.run.smithi146.stderr: 43050K .......... .......... .......... .......... .......... 58% 282M 0s 2019-12-09T11:30:25.545 INFO:teuthology.orchestra.run.smithi146.stderr: 43100K .......... .......... .......... .......... .......... 58% 275M 0s 2019-12-09T11:30:25.545 INFO:teuthology.orchestra.run.smithi146.stderr: 43150K .......... .......... .......... .......... .......... 58% 250M 0s 2019-12-09T11:30:25.545 INFO:teuthology.orchestra.run.smithi146.stderr: 43200K .......... .......... .......... .......... .......... 58% 272M 0s 2019-12-09T11:30:25.545 INFO:teuthology.orchestra.run.smithi146.stderr: 43250K .......... .......... .......... .......... .......... 58% 274M 0s 2019-12-09T11:30:25.545 INFO:teuthology.orchestra.run.smithi146.stderr: 43300K .......... .......... .......... .......... .......... 58% 280M 0s 2019-12-09T11:30:25.545 INFO:teuthology.orchestra.run.smithi146.stderr: 43350K .......... .......... .......... .......... .......... 59% 236M 0s 2019-12-09T11:30:25.546 INFO:teuthology.orchestra.run.smithi146.stderr: 43400K .......... .......... .......... .......... .......... 59% 272M 0s 2019-12-09T11:30:25.546 INFO:teuthology.orchestra.run.smithi146.stderr: 43450K .......... .......... .......... .......... .......... 59% 278M 0s 2019-12-09T11:30:25.546 INFO:teuthology.orchestra.run.smithi146.stderr: 43500K .......... .......... .......... .......... .......... 59% 265M 0s 2019-12-09T11:30:25.546 INFO:teuthology.orchestra.run.smithi146.stderr: 43550K .......... .......... .......... .......... .......... 59% 254M 0s 2019-12-09T11:30:25.546 INFO:teuthology.orchestra.run.smithi146.stderr: 43600K .......... .......... .......... .......... .......... 59% 269M 0s 2019-12-09T11:30:25.546 INFO:teuthology.orchestra.run.smithi146.stderr: 43650K .......... .......... .......... .......... .......... 59% 267M 0s 2019-12-09T11:30:25.546 INFO:teuthology.orchestra.run.smithi146.stderr: 43700K .......... .......... .......... .......... .......... 59% 279M 0s 2019-12-09T11:30:25.547 INFO:teuthology.orchestra.run.smithi146.stderr: 43750K .......... .......... .......... .......... .......... 59% 219M 0s 2019-12-09T11:30:25.547 INFO:teuthology.orchestra.run.smithi146.stderr: 43800K .......... .......... .......... .......... .......... 59% 273M 0s 2019-12-09T11:30:25.547 INFO:teuthology.orchestra.run.smithi146.stderr: 43850K .......... .......... .......... .......... .......... 59% 257M 0s 2019-12-09T11:30:25.547 INFO:teuthology.orchestra.run.smithi146.stderr: 43900K .......... .......... .......... .......... .......... 59% 261M 0s 2019-12-09T11:30:25.547 INFO:teuthology.orchestra.run.smithi146.stderr: 43950K .......... .......... .......... .......... .......... 59% 252M 0s 2019-12-09T11:30:25.547 INFO:teuthology.orchestra.run.smithi146.stderr: 44000K .......... .......... .......... .......... .......... 59% 238M 0s 2019-12-09T11:30:25.547 INFO:teuthology.orchestra.run.smithi146.stderr: 44050K .......... .......... .......... .......... .......... 59% 264M 0s 2019-12-09T11:30:25.548 INFO:teuthology.orchestra.run.smithi146.stderr: 44100K .......... .......... .......... .......... .......... 60% 279M 0s 2019-12-09T11:30:25.548 INFO:teuthology.orchestra.run.smithi146.stderr: 44150K .......... .......... .......... .......... .......... 60% 223M 0s 2019-12-09T11:30:25.548 INFO:teuthology.orchestra.run.smithi146.stderr: 44200K .......... .......... .......... .......... .......... 60% 257M 0s 2019-12-09T11:30:25.548 INFO:teuthology.orchestra.run.smithi146.stderr: 44250K .......... .......... .......... .......... .......... 60% 262M 0s 2019-12-09T11:30:25.548 INFO:teuthology.orchestra.run.smithi146.stderr: 44300K .......... .......... .......... .......... .......... 60% 258M 0s 2019-12-09T11:30:25.548 INFO:teuthology.orchestra.run.smithi146.stderr: 44350K .......... .......... .......... .......... .......... 60% 233M 0s 2019-12-09T11:30:25.548 INFO:teuthology.orchestra.run.smithi146.stderr: 44400K .......... .......... .......... .......... .......... 60% 272M 0s 2019-12-09T11:30:25.549 INFO:teuthology.orchestra.run.smithi146.stderr: 44450K .......... .......... .......... .......... .......... 60% 263M 0s 2019-12-09T11:30:25.549 INFO:teuthology.orchestra.run.smithi146.stderr: 44500K .......... .......... .......... .......... .......... 60% 274M 0s 2019-12-09T11:30:25.549 INFO:teuthology.orchestra.run.smithi146.stderr: 44550K .......... .......... .......... .......... .......... 60% 215M 0s 2019-12-09T11:30:25.549 INFO:teuthology.orchestra.run.smithi146.stderr: 44600K .......... .......... .......... .......... .......... 60% 283M 0s 2019-12-09T11:30:25.549 INFO:teuthology.orchestra.run.smithi146.stderr: 44650K .......... .......... .......... .......... .......... 60% 274M 0s 2019-12-09T11:30:25.549 INFO:teuthology.orchestra.run.smithi146.stderr: 44700K .......... .......... .......... .......... .......... 60% 269M 0s 2019-12-09T11:30:25.549 INFO:teuthology.orchestra.run.smithi146.stderr: 44750K .......... .......... .......... .......... .......... 60% 253M 0s 2019-12-09T11:30:25.550 INFO:teuthology.orchestra.run.smithi146.stderr: 44800K .......... .......... .......... .......... .......... 60% 250M 0s 2019-12-09T11:30:25.551 INFO:teuthology.orchestra.run.smithi146.stderr: 44850K .......... .......... .......... .......... .......... 61% 273M 0s 2019-12-09T11:30:25.551 INFO:teuthology.orchestra.run.smithi146.stderr: 44900K .......... .......... .......... .......... .......... 61% 282M 0s 2019-12-09T11:30:25.551 INFO:teuthology.orchestra.run.smithi146.stderr: 44950K .......... .......... .......... .......... .......... 61% 217M 0s 2019-12-09T11:30:25.552 INFO:teuthology.orchestra.run.smithi146.stderr: 45000K .......... .......... .......... .......... .......... 61% 275M 0s 2019-12-09T11:30:25.552 INFO:teuthology.orchestra.run.smithi146.stderr: 45050K .......... .......... .......... .......... .......... 61% 264M 0s 2019-12-09T11:30:25.552 INFO:teuthology.orchestra.run.smithi146.stderr: 45100K .......... .......... .......... .......... .......... 61% 264M 0s 2019-12-09T11:30:25.552 INFO:teuthology.orchestra.run.smithi146.stderr: 45150K .......... .......... .......... .......... .......... 61% 249M 0s 2019-12-09T11:30:25.552 INFO:teuthology.orchestra.run.smithi146.stderr: 45200K .......... .......... .......... .......... .......... 61% 274M 0s 2019-12-09T11:30:25.552 INFO:teuthology.orchestra.run.smithi146.stderr: 45250K .......... .......... .......... .......... .......... 61% 270M 0s 2019-12-09T11:30:25.552 INFO:teuthology.orchestra.run.smithi146.stderr: 45300K .......... .......... .......... .......... .......... 61% 279M 0s 2019-12-09T11:30:25.553 INFO:teuthology.orchestra.run.smithi146.stderr: 45350K .......... .......... .......... .......... .......... 61% 222M 0s 2019-12-09T11:30:25.553 INFO:teuthology.orchestra.run.smithi146.stderr: 45400K .......... .......... .......... .......... .......... 61% 275M 0s 2019-12-09T11:30:25.553 INFO:teuthology.orchestra.run.smithi146.stderr: 45450K .......... .......... .......... .......... .......... 61% 273M 0s 2019-12-09T11:30:25.553 INFO:teuthology.orchestra.run.smithi146.stderr: 45500K .......... .......... .......... .......... .......... 61% 274M 0s 2019-12-09T11:30:25.553 INFO:teuthology.orchestra.run.smithi146.stderr: 45550K .......... .......... .......... .......... .......... 61% 245M 0s 2019-12-09T11:30:25.553 INFO:teuthology.orchestra.run.smithi146.stderr: 45600K .......... .......... .......... .......... .......... 62% 239M 0s 2019-12-09T11:30:25.553 INFO:teuthology.orchestra.run.smithi146.stderr: 45650K .......... .......... .......... .......... .......... 62% 278M 0s 2019-12-09T11:30:25.554 INFO:teuthology.orchestra.run.smithi146.stderr: 45700K .......... .......... .......... .......... .......... 62% 267M 0s 2019-12-09T11:30:25.554 INFO:teuthology.orchestra.run.smithi146.stderr: 45750K .......... .......... .......... .......... .......... 62% 229M 0s 2019-12-09T11:30:25.554 INFO:teuthology.orchestra.run.smithi146.stderr: 45800K .......... .......... .......... .......... .......... 62% 274M 0s 2019-12-09T11:30:25.554 INFO:teuthology.orchestra.run.smithi146.stderr: 45850K .......... .......... .......... .......... .......... 62% 259M 0s 2019-12-09T11:30:25.554 INFO:teuthology.orchestra.run.smithi146.stderr: 45900K .......... .......... .......... .......... .......... 62% 235M 0s 2019-12-09T11:30:25.554 INFO:teuthology.orchestra.run.smithi146.stderr: 45950K .......... .......... .......... .......... .......... 62% 220M 0s 2019-12-09T11:30:25.554 INFO:teuthology.orchestra.run.smithi146.stderr: 46000K .......... .......... .......... .......... .......... 62% 246M 0s 2019-12-09T11:30:25.554 INFO:teuthology.orchestra.run.smithi146.stderr: 46050K .......... .......... .......... .......... .......... 62% 247M 0s 2019-12-09T11:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr: 46100K .......... .......... .......... .......... .......... 62% 240M 0s 2019-12-09T11:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr: 46150K .......... .......... .......... .......... .......... 62% 213M 0s 2019-12-09T11:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr: 46200K .......... .......... .......... .......... .......... 62% 243M 0s 2019-12-09T11:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr: 46250K .......... .......... .......... .......... .......... 62% 270M 0s 2019-12-09T11:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr: 46300K .......... .......... .......... .......... .......... 63% 268M 0s 2019-12-09T11:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr: 46350K .......... .......... .......... .......... .......... 63% 224M 0s 2019-12-09T11:30:25.555 INFO:teuthology.orchestra.run.smithi146.stderr: 46400K .......... .......... .......... .......... .......... 63% 271M 0s 2019-12-09T11:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr: 46450K .......... .......... .......... .......... .......... 63% 251M 0s 2019-12-09T11:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr: 46500K .......... .......... .......... .......... .......... 63% 257M 0s 2019-12-09T11:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr: 46550K .......... .......... .......... .......... .......... 63% 227M 0s 2019-12-09T11:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr: 46600K .......... .......... .......... .......... .......... 63% 267M 0s 2019-12-09T11:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr: 46650K .......... .......... .......... .......... .......... 63% 277M 0s 2019-12-09T11:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr: 46700K .......... .......... .......... .......... .......... 63% 264M 0s 2019-12-09T11:30:25.556 INFO:teuthology.orchestra.run.smithi146.stderr: 46750K .......... .......... .......... .......... .......... 63% 251M 0s 2019-12-09T11:30:25.557 INFO:teuthology.orchestra.run.smithi146.stderr: 46800K .......... .......... .......... .......... .......... 63% 272M 0s 2019-12-09T11:30:25.557 INFO:teuthology.orchestra.run.smithi146.stderr: 46850K .......... .......... .......... .......... .......... 63% 275M 0s 2019-12-09T11:30:25.557 INFO:teuthology.orchestra.run.smithi146.stderr: 46900K .......... .......... .......... .......... .......... 63% 264M 0s 2019-12-09T11:30:25.557 INFO:teuthology.orchestra.run.smithi146.stderr: 46950K .......... .......... .......... .......... .......... 63% 226M 0s 2019-12-09T11:30:25.557 INFO:teuthology.orchestra.run.smithi146.stderr: 47000K .......... .......... .......... .......... .......... 63% 258M 0s 2019-12-09T11:30:25.557 INFO:teuthology.orchestra.run.smithi146.stderr: 47050K .......... .......... .......... .......... .......... 64% 274M 0s 2019-12-09T11:30:25.557 INFO:teuthology.orchestra.run.smithi146.stderr: 47100K .......... .......... .......... .......... .......... 64% 274M 0s 2019-12-09T11:30:25.558 INFO:teuthology.orchestra.run.smithi146.stderr: 47150K .......... .......... .......... .......... .......... 64% 230M 0s 2019-12-09T11:30:25.558 INFO:teuthology.orchestra.run.smithi146.stderr: 47200K .......... .......... .......... .......... .......... 64% 285M 0s 2019-12-09T11:30:25.558 INFO:teuthology.orchestra.run.smithi146.stderr: 47250K .......... .......... .......... .......... .......... 64% 256M 0s 2019-12-09T11:30:25.558 INFO:teuthology.orchestra.run.smithi146.stderr: 47300K .......... .......... .......... .......... .......... 64% 275M 0s 2019-12-09T11:30:25.558 INFO:teuthology.orchestra.run.smithi146.stderr: 47350K .......... .......... .......... .......... .......... 64% 235M 0s 2019-12-09T11:30:25.558 INFO:teuthology.orchestra.run.smithi146.stderr: 47400K .......... .......... .......... .......... .......... 64% 264M 0s 2019-12-09T11:30:25.558 INFO:teuthology.orchestra.run.smithi146.stderr: 47450K .......... .......... .......... .......... .......... 64% 271M 0s 2019-12-09T11:30:25.558 INFO:teuthology.orchestra.run.smithi146.stderr: 47500K .......... .......... .......... .......... .......... 64% 267M 0s 2019-12-09T11:30:25.559 INFO:teuthology.orchestra.run.smithi146.stderr: 47550K .......... .......... .......... .......... .......... 64% 246M 0s 2019-12-09T11:30:25.559 INFO:teuthology.orchestra.run.smithi146.stderr: 47600K .......... .......... .......... .......... .......... 64% 274M 0s 2019-12-09T11:30:25.559 INFO:teuthology.orchestra.run.smithi146.stderr: 47650K .......... .......... .......... .......... .......... 64% 277M 0s 2019-12-09T11:30:25.559 INFO:teuthology.orchestra.run.smithi146.stderr: 47700K .......... .......... .......... .......... .......... 64% 266M 0s 2019-12-09T11:30:25.559 INFO:teuthology.orchestra.run.smithi146.stderr: 47750K .......... .......... .......... .......... .......... 64% 231M 0s 2019-12-09T11:30:25.559 INFO:teuthology.orchestra.run.smithi146.stderr: 47800K .......... .......... .......... .......... .......... 65% 277M 0s 2019-12-09T11:30:25.559 INFO:teuthology.orchestra.run.smithi146.stderr: 47850K .......... .......... .......... .......... .......... 65% 273M 0s 2019-12-09T11:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr: 47900K .......... .......... .......... .......... .......... 65% 245M 0s 2019-12-09T11:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr: 47950K .......... .......... .......... .......... .......... 65% 228M 0s 2019-12-09T11:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr: 48000K .......... .......... .......... .......... .......... 65% 266M 0s 2019-12-09T11:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr: 48050K .......... .......... .......... .......... .......... 65% 264M 0s 2019-12-09T11:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr: 48100K .......... .......... .......... .......... .......... 65% 266M 0s 2019-12-09T11:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr: 48150K .......... .......... .......... .......... .......... 65% 211M 0s 2019-12-09T11:30:25.560 INFO:teuthology.orchestra.run.smithi146.stderr: 48200K .......... .......... .......... .......... .......... 65% 253M 0s 2019-12-09T11:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr: 48250K .......... .......... .......... .......... .......... 65% 217M 0s 2019-12-09T11:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr: 48300K .......... .......... .......... .......... .......... 65% 239M 0s 2019-12-09T11:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr: 48350K .......... .......... .......... .......... .......... 65% 251M 0s 2019-12-09T11:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr: 48400K .......... .......... .......... .......... .......... 65% 268M 0s 2019-12-09T11:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr: 48450K .......... .......... .......... .......... .......... 65% 269M 0s 2019-12-09T11:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr: 48500K .......... .......... .......... .......... .......... 66% 275M 0s 2019-12-09T11:30:25.561 INFO:teuthology.orchestra.run.smithi146.stderr: 48550K .......... .......... .......... .......... .......... 66% 223M 0s 2019-12-09T11:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr: 48600K .......... .......... .......... .......... .......... 66% 279M 0s 2019-12-09T11:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr: 48650K .......... .......... .......... .......... .......... 66% 276M 0s 2019-12-09T11:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr: 48700K .......... .......... .......... .......... .......... 66% 268M 0s 2019-12-09T11:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr: 48750K .......... .......... .......... .......... .......... 66% 242M 0s 2019-12-09T11:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr: 48800K .......... .......... .......... .......... .......... 66% 279M 0s 2019-12-09T11:30:25.562 INFO:teuthology.orchestra.run.smithi146.stderr: 48850K .......... .......... .......... .......... .......... 66% 269M 0s 2019-12-09T11:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr: 48900K .......... .......... .......... .......... .......... 66% 271M 0s 2019-12-09T11:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr: 48950K .......... .......... .......... .......... .......... 66% 230M 0s 2019-12-09T11:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr: 49000K .......... .......... .......... .......... .......... 66% 272M 0s 2019-12-09T11:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr: 49050K .......... .......... .......... .......... .......... 66% 284M 0s 2019-12-09T11:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr: 49100K .......... .......... .......... .......... .......... 66% 284M 0s 2019-12-09T11:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr: 49150K .......... .......... .......... .......... .......... 66% 248M 0s 2019-12-09T11:30:25.563 INFO:teuthology.orchestra.run.smithi146.stderr: 49200K .......... .......... .......... .......... .......... 66% 270M 0s 2019-12-09T11:30:25.564 INFO:teuthology.orchestra.run.smithi146.stderr: 49250K .......... .......... .......... .......... .......... 67% 251M 0s 2019-12-09T11:30:25.564 INFO:teuthology.orchestra.run.smithi146.stderr: 49300K .......... .......... .......... .......... .......... 67% 272M 0s 2019-12-09T11:30:25.564 INFO:teuthology.orchestra.run.smithi146.stderr: 49350K .......... .......... .......... .......... .......... 67% 227M 0s 2019-12-09T11:30:25.564 INFO:teuthology.orchestra.run.smithi146.stderr: 49400K .......... .......... .......... .......... .......... 67% 267M 0s 2019-12-09T11:30:25.564 INFO:teuthology.orchestra.run.smithi146.stderr: 49450K .......... .......... .......... .......... .......... 67% 277M 0s 2019-12-09T11:30:25.564 INFO:teuthology.orchestra.run.smithi146.stderr: 49500K .......... .......... .......... .......... .......... 67% 266M 0s 2019-12-09T11:30:25.565 INFO:teuthology.orchestra.run.smithi146.stderr: 49550K .......... .......... .......... .......... .......... 67% 249M 0s 2019-12-09T11:30:25.565 INFO:teuthology.orchestra.run.smithi146.stderr: 49600K .......... .......... .......... .......... .......... 67% 276M 0s 2019-12-09T11:30:25.565 INFO:teuthology.orchestra.run.smithi146.stderr: 49650K .......... .......... .......... .......... .......... 67% 276M 0s 2019-12-09T11:30:25.565 INFO:teuthology.orchestra.run.smithi146.stderr: 49700K .......... .......... .......... .......... .......... 67% 270M 0s 2019-12-09T11:30:25.566 INFO:teuthology.orchestra.run.smithi146.stderr: 49750K .......... .......... .......... .......... .......... 67% 220M 0s 2019-12-09T11:30:25.566 INFO:teuthology.orchestra.run.smithi146.stderr: 49800K .......... .......... .......... .......... .......... 67% 267M 0s 2019-12-09T11:30:25.566 INFO:teuthology.orchestra.run.smithi146.stderr: 49850K .......... .......... .......... .......... .......... 67% 275M 0s 2019-12-09T11:30:25.566 INFO:teuthology.orchestra.run.smithi146.stderr: 49900K .......... .......... .......... .......... .......... 67% 278M 0s 2019-12-09T11:30:25.566 INFO:teuthology.orchestra.run.smithi146.stderr: 49950K .......... .......... .......... .......... .......... 67% 241M 0s 2019-12-09T11:30:25.566 INFO:teuthology.orchestra.run.smithi146.stderr: 50000K .......... .......... .......... .......... .......... 68% 273M 0s 2019-12-09T11:30:25.567 INFO:teuthology.orchestra.run.smithi146.stderr: 50050K .......... .......... .......... .......... .......... 68% 270M 0s 2019-12-09T11:30:25.567 INFO:teuthology.orchestra.run.smithi146.stderr: 50100K .......... .......... .......... .......... .......... 68% 280M 0s 2019-12-09T11:30:25.567 INFO:teuthology.orchestra.run.smithi146.stderr: 50150K .......... .......... .......... .......... .......... 68% 230M 0s 2019-12-09T11:30:25.567 INFO:teuthology.orchestra.run.smithi146.stderr: 50200K .......... .......... .......... .......... .......... 68% 283M 0s 2019-12-09T11:30:25.567 INFO:teuthology.orchestra.run.smithi146.stderr: 50250K .......... .......... .......... .......... .......... 68% 284M 0s 2019-12-09T11:30:25.567 INFO:teuthology.orchestra.run.smithi146.stderr: 50300K .......... .......... .......... .......... .......... 68% 269M 0s 2019-12-09T11:30:25.567 INFO:teuthology.orchestra.run.smithi146.stderr: 50350K .......... .......... .......... .......... .......... 68% 247M 0s 2019-12-09T11:30:25.567 INFO:teuthology.orchestra.run.smithi146.stderr: 50400K .......... .......... .......... .......... .......... 68% 282M 0s 2019-12-09T11:30:25.568 INFO:teuthology.orchestra.run.smithi146.stderr: 50450K .......... .......... .......... .......... .......... 68% 272M 0s 2019-12-09T11:30:25.568 INFO:teuthology.orchestra.run.smithi146.stderr: 50500K .......... .......... .......... .......... .......... 68% 245M 0s 2019-12-09T11:30:25.568 INFO:teuthology.orchestra.run.smithi146.stderr: 50550K .......... .......... .......... .......... .......... 68% 217M 0s 2019-12-09T11:30:25.568 INFO:teuthology.orchestra.run.smithi146.stderr: 50600K .......... .......... .......... .......... .......... 68% 263M 0s 2019-12-09T11:30:25.568 INFO:teuthology.orchestra.run.smithi146.stderr: 50650K .......... .......... .......... .......... .......... 68% 278M 0s 2019-12-09T11:30:25.568 INFO:teuthology.orchestra.run.smithi146.stderr: 50700K .......... .......... .......... .......... .......... 68% 269M 0s 2019-12-09T11:30:25.568 INFO:teuthology.orchestra.run.smithi146.stderr: 50750K .......... .......... .......... .......... .......... 69% 236M 0s 2019-12-09T11:30:25.569 INFO:teuthology.orchestra.run.smithi146.stderr: 50800K .......... .......... .......... .......... .......... 69% 275M 0s 2019-12-09T11:30:25.569 INFO:teuthology.orchestra.run.smithi146.stderr: 50850K .......... .......... .......... .......... .......... 69% 250M 0s 2019-12-09T11:30:25.569 INFO:teuthology.orchestra.run.smithi146.stderr: 50900K .......... .......... .......... .......... .......... 69% 260M 0s 2019-12-09T11:30:25.569 INFO:teuthology.orchestra.run.smithi146.stderr: 50950K .......... .......... .......... .......... .......... 69% 209M 0s 2019-12-09T11:30:25.569 INFO:teuthology.orchestra.run.smithi146.stderr: 51000K .......... .......... .......... .......... .......... 69% 272M 0s 2019-12-09T11:30:25.569 INFO:teuthology.orchestra.run.smithi146.stderr: 51050K .......... .......... .......... .......... .......... 69% 264M 0s 2019-12-09T11:30:25.569 INFO:teuthology.orchestra.run.smithi146.stderr: 51100K .......... .......... .......... .......... .......... 69% 257M 0s 2019-12-09T11:30:25.570 INFO:teuthology.orchestra.run.smithi146.stderr: 51150K .......... .......... .......... .......... .......... 69% 246M 0s 2019-12-09T11:30:25.570 INFO:teuthology.orchestra.run.smithi146.stderr: 51200K .......... .......... .......... .......... .......... 69% 265M 0s 2019-12-09T11:30:25.570 INFO:teuthology.orchestra.run.smithi146.stderr: 51250K .......... .......... .......... .......... .......... 69% 278M 0s 2019-12-09T11:30:25.570 INFO:teuthology.orchestra.run.smithi146.stderr: 51300K .......... .......... .......... .......... .......... 69% 280M 0s 2019-12-09T11:30:25.570 INFO:teuthology.orchestra.run.smithi146.stderr: 51350K .......... .......... .......... .......... .......... 69% 220M 0s 2019-12-09T11:30:25.570 INFO:teuthology.orchestra.run.smithi146.stderr: 51400K .......... .......... .......... .......... .......... 69% 273M 0s 2019-12-09T11:30:25.571 INFO:teuthology.orchestra.run.smithi146.stderr: 51450K .......... .......... .......... .......... .......... 70% 278M 0s 2019-12-09T11:30:25.571 INFO:teuthology.orchestra.run.smithi146.stderr: 51500K .......... .......... .......... .......... .......... 70% 261M 0s 2019-12-09T11:30:25.571 INFO:teuthology.orchestra.run.smithi146.stderr: 51550K .......... .......... .......... .......... .......... 70% 241M 0s 2019-12-09T11:30:25.572 INFO:teuthology.orchestra.run.smithi146.stderr: 51600K .......... .......... .......... .......... .......... 70% 263M 0s 2019-12-09T11:30:25.572 INFO:teuthology.orchestra.run.smithi146.stderr: 51650K .......... .......... .......... .......... .......... 70% 266M 0s 2019-12-09T11:30:25.572 INFO:teuthology.orchestra.run.smithi146.stderr: 51700K .......... .......... .......... .......... .......... 70% 265M 0s 2019-12-09T11:30:25.572 INFO:teuthology.orchestra.run.smithi146.stderr: 51750K .......... .......... .......... .......... .......... 70% 221M 0s 2019-12-09T11:30:25.572 INFO:teuthology.orchestra.run.smithi146.stderr: 51800K .......... .......... .......... .......... .......... 70% 270M 0s 2019-12-09T11:30:25.572 INFO:teuthology.orchestra.run.smithi146.stderr: 51850K .......... .......... .......... .......... .......... 70% 247M 0s 2019-12-09T11:30:25.572 INFO:teuthology.orchestra.run.smithi146.stderr: 51900K .......... .......... .......... .......... .......... 70% 260M 0s 2019-12-09T11:30:25.573 INFO:teuthology.orchestra.run.smithi146.stderr: 51950K .......... .......... .......... .......... .......... 70% 232M 0s 2019-12-09T11:30:25.573 INFO:teuthology.orchestra.run.smithi146.stderr: 52000K .......... .......... .......... .......... .......... 70% 246M 0s 2019-12-09T11:30:25.573 INFO:teuthology.orchestra.run.smithi146.stderr: 52050K .......... .......... .......... .......... .......... 70% 274M 0s 2019-12-09T11:30:25.573 INFO:teuthology.orchestra.run.smithi146.stderr: 52100K .......... .......... .......... .......... .......... 70% 247M 0s 2019-12-09T11:30:25.573 INFO:teuthology.orchestra.run.smithi146.stderr: 52150K .......... .......... .......... .......... .......... 70% 203M 0s 2019-12-09T11:30:25.573 INFO:teuthology.orchestra.run.smithi146.stderr: 52200K .......... .......... .......... .......... .......... 71% 257M 0s 2019-12-09T11:30:25.573 INFO:teuthology.orchestra.run.smithi146.stderr: 52250K .......... .......... .......... .......... .......... 71% 260M 0s 2019-12-09T11:30:25.573 INFO:teuthology.orchestra.run.smithi146.stderr: 52300K .......... .......... .......... .......... .......... 71% 261M 0s 2019-12-09T11:30:25.574 INFO:teuthology.orchestra.run.smithi146.stderr: 52350K .......... .......... .......... .......... .......... 71% 243M 0s 2019-12-09T11:30:25.574 INFO:teuthology.orchestra.run.smithi146.stderr: 52400K .......... .......... .......... .......... .......... 71% 260M 0s 2019-12-09T11:30:25.574 INFO:teuthology.orchestra.run.smithi146.stderr: 52450K .......... .......... .......... .......... .......... 71% 269M 0s 2019-12-09T11:30:25.574 INFO:teuthology.orchestra.run.smithi146.stderr: 52500K .......... .......... .......... .......... .......... 71% 274M 0s 2019-12-09T11:30:25.574 INFO:teuthology.orchestra.run.smithi146.stderr: 52550K .......... .......... .......... .......... .......... 71% 207M 0s 2019-12-09T11:30:25.574 INFO:teuthology.orchestra.run.smithi146.stderr: 52600K .......... .......... .......... .......... .......... 71% 248M 0s 2019-12-09T11:30:25.574 INFO:teuthology.orchestra.run.smithi146.stderr: 52650K .......... .......... .......... .......... .......... 71% 251M 0s 2019-12-09T11:30:25.575 INFO:teuthology.orchestra.run.smithi146.stderr: 52700K .......... .......... .......... .......... .......... 71% 273M 0s 2019-12-09T11:30:25.575 INFO:teuthology.orchestra.run.smithi146.stderr: 52750K .......... .......... .......... .......... .......... 71% 246M 0s 2019-12-09T11:30:25.575 INFO:teuthology.orchestra.run.smithi146.stderr: 52800K .......... .......... .......... .......... .......... 71% 263M 0s 2019-12-09T11:30:25.575 INFO:teuthology.orchestra.run.smithi146.stderr: 52850K .......... .......... .......... .......... .......... 71% 271M 0s 2019-12-09T11:30:25.575 INFO:teuthology.orchestra.run.smithi146.stderr: 52900K .......... .......... .......... .......... .......... 71% 268M 0s 2019-12-09T11:30:25.575 INFO:teuthology.orchestra.run.smithi146.stderr: 52950K .......... .......... .......... .......... .......... 72% 223M 0s 2019-12-09T11:30:25.575 INFO:teuthology.orchestra.run.smithi146.stderr: 53000K .......... .......... .......... .......... .......... 72% 270M 0s 2019-12-09T11:30:25.576 INFO:teuthology.orchestra.run.smithi146.stderr: 53050K .......... .......... .......... .......... .......... 72% 273M 0s 2019-12-09T11:30:25.576 INFO:teuthology.orchestra.run.smithi146.stderr: 53100K .......... .......... .......... .......... .......... 72% 269M 0s 2019-12-09T11:30:25.576 INFO:teuthology.orchestra.run.smithi146.stderr: 53150K .......... .......... .......... .......... .......... 72% 247M 0s 2019-12-09T11:30:25.576 INFO:teuthology.orchestra.run.smithi146.stderr: 53200K .......... .......... .......... .......... .......... 72% 261M 0s 2019-12-09T11:30:25.576 INFO:teuthology.orchestra.run.smithi146.stderr: 53250K .......... .......... .......... .......... .......... 72% 259M 0s 2019-12-09T11:30:25.576 INFO:teuthology.orchestra.run.smithi146.stderr: 53300K .......... .......... .......... .......... .......... 72% 280M 0s 2019-12-09T11:30:25.576 INFO:teuthology.orchestra.run.smithi146.stderr: 53350K .......... .......... .......... .......... .......... 72% 229M 0s 2019-12-09T11:30:25.577 INFO:teuthology.orchestra.run.smithi146.stderr: 53400K .......... .......... .......... .......... .......... 72% 273M 0s 2019-12-09T11:30:25.577 INFO:teuthology.orchestra.run.smithi146.stderr: 53450K .......... .......... .......... .......... .......... 72% 259M 0s 2019-12-09T11:30:25.577 INFO:teuthology.orchestra.run.smithi146.stderr: 53500K .......... .......... .......... .......... .......... 72% 255M 0s 2019-12-09T11:30:25.577 INFO:teuthology.orchestra.run.smithi146.stderr: 53550K .......... .......... .......... .......... .......... 72% 238M 0s 2019-12-09T11:30:25.577 INFO:teuthology.orchestra.run.smithi146.stderr: 53600K .......... .......... .......... .......... .......... 72% 280M 0s 2019-12-09T11:30:25.577 INFO:teuthology.orchestra.run.smithi146.stderr: 53650K .......... .......... .......... .......... .......... 73% 279M 0s 2019-12-09T11:30:25.577 INFO:teuthology.orchestra.run.smithi146.stderr: 53700K .......... .......... .......... .......... .......... 73% 278M 0s 2019-12-09T11:30:25.577 INFO:teuthology.orchestra.run.smithi146.stderr: 53750K .......... .......... .......... .......... .......... 73% 228M 0s 2019-12-09T11:30:25.578 INFO:teuthology.orchestra.run.smithi146.stderr: 53800K .......... .......... .......... .......... .......... 73% 273M 0s 2019-12-09T11:30:25.578 INFO:teuthology.orchestra.run.smithi146.stderr: 53850K .......... .......... .......... .......... .......... 73% 271M 0s 2019-12-09T11:30:25.578 INFO:teuthology.orchestra.run.smithi146.stderr: 53900K .......... .......... .......... .......... .......... 73% 280M 0s 2019-12-09T11:30:25.578 INFO:teuthology.orchestra.run.smithi146.stderr: 53950K .......... .......... .......... .......... .......... 73% 243M 0s 2019-12-09T11:30:25.578 INFO:teuthology.orchestra.run.smithi146.stderr: 54000K .......... .......... .......... .......... .......... 73% 263M 0s 2019-12-09T11:30:25.578 INFO:teuthology.orchestra.run.smithi146.stderr: 54050K .......... .......... .......... .......... .......... 73% 261M 0s 2019-12-09T11:30:25.578 INFO:teuthology.orchestra.run.smithi146.stderr: 54100K .......... .......... .......... .......... .......... 73% 256M 0s 2019-12-09T11:30:25.579 INFO:teuthology.orchestra.run.smithi146.stderr: 54150K .......... .......... .......... .......... .......... 73% 218M 0s 2019-12-09T11:30:25.579 INFO:teuthology.orchestra.run.smithi146.stderr: 54200K .......... .......... .......... .......... .......... 73% 255M 0s 2019-12-09T11:30:25.579 INFO:teuthology.orchestra.run.smithi146.stderr: 54250K .......... .......... .......... .......... .......... 73% 258M 0s 2019-12-09T11:30:25.579 INFO:teuthology.orchestra.run.smithi146.stderr: 54300K .......... .......... .......... .......... .......... 73% 256M 0s 2019-12-09T11:30:25.579 INFO:teuthology.orchestra.run.smithi146.stderr: 54350K .......... .......... .......... .......... .......... 73% 236M 0s 2019-12-09T11:30:25.579 INFO:teuthology.orchestra.run.smithi146.stderr: 54400K .......... .......... .......... .......... .......... 74% 265M 0s 2019-12-09T11:30:25.579 INFO:teuthology.orchestra.run.smithi146.stderr: 54450K .......... .......... .......... .......... .......... 74% 272M 0s 2019-12-09T11:30:25.580 INFO:teuthology.orchestra.run.smithi146.stderr: 54500K .......... .......... .......... .......... .......... 74% 270M 0s 2019-12-09T11:30:25.580 INFO:teuthology.orchestra.run.smithi146.stderr: 54550K .......... .......... .......... .......... .......... 74% 230M 0s 2019-12-09T11:30:25.580 INFO:teuthology.orchestra.run.smithi146.stderr: 54600K .......... .......... .......... .......... .......... 74% 268M 0s 2019-12-09T11:30:25.580 INFO:teuthology.orchestra.run.smithi146.stderr: 54650K .......... .......... .......... .......... .......... 74% 262M 0s 2019-12-09T11:30:25.580 INFO:teuthology.orchestra.run.smithi146.stderr: 54700K .......... .......... .......... .......... .......... 74% 252M 0s 2019-12-09T11:30:25.580 INFO:teuthology.orchestra.run.smithi146.stderr: 54750K .......... .......... .......... .......... .......... 74% 219M 0s 2019-12-09T11:30:25.580 INFO:teuthology.orchestra.run.smithi146.stderr: 54800K .......... .......... .......... .......... .......... 74% 274M 0s 2019-12-09T11:30:25.580 INFO:teuthology.orchestra.run.smithi146.stderr: 54850K .......... .......... .......... .......... .......... 74% 264M 0s 2019-12-09T11:30:25.581 INFO:teuthology.orchestra.run.smithi146.stderr: 54900K .......... .......... .......... .......... .......... 74% 254M 0s 2019-12-09T11:30:25.581 INFO:teuthology.orchestra.run.smithi146.stderr: 54950K .......... .......... .......... .......... .......... 74% 221M 0s 2019-12-09T11:30:25.581 INFO:teuthology.orchestra.run.smithi146.stderr: 55000K .......... .......... .......... .......... .......... 74% 261M 0s 2019-12-09T11:30:25.581 INFO:teuthology.orchestra.run.smithi146.stderr: 55050K .......... .......... .......... .......... .......... 74% 265M 0s 2019-12-09T11:30:25.581 INFO:teuthology.orchestra.run.smithi146.stderr: 55100K .......... .......... .......... .......... .......... 74% 264M 0s 2019-12-09T11:30:25.581 INFO:teuthology.orchestra.run.smithi146.stderr: 55150K .......... .......... .......... .......... .......... 75% 235M 0s 2019-12-09T11:30:25.581 INFO:teuthology.orchestra.run.smithi146.stderr: 55200K .......... .......... .......... .......... .......... 75% 270M 0s 2019-12-09T11:30:25.582 INFO:teuthology.orchestra.run.smithi146.stderr: 55250K .......... .......... .......... .......... .......... 75% 262M 0s 2019-12-09T11:30:25.582 INFO:teuthology.orchestra.run.smithi146.stderr: 55300K .......... .......... .......... .......... .......... 75% 262M 0s 2019-12-09T11:30:25.582 INFO:teuthology.orchestra.run.smithi146.stderr: 55350K .......... .......... .......... .......... .......... 75% 221M 0s 2019-12-09T11:30:25.582 INFO:teuthology.orchestra.run.smithi146.stderr: 55400K .......... .......... .......... .......... .......... 75% 270M 0s 2019-12-09T11:30:25.582 INFO:teuthology.orchestra.run.smithi146.stderr: 55450K .......... .......... .......... .......... .......... 75% 282M 0s 2019-12-09T11:30:25.582 INFO:teuthology.orchestra.run.smithi146.stderr: 55500K .......... .......... .......... .......... .......... 75% 282M 0s 2019-12-09T11:30:25.582 INFO:teuthology.orchestra.run.smithi146.stderr: 55550K .......... .......... .......... .......... .......... 75% 235M 0s 2019-12-09T11:30:25.583 INFO:teuthology.orchestra.run.smithi146.stderr: 55600K .......... .......... .......... .......... .......... 75% 277M 0s 2019-12-09T11:30:25.583 INFO:teuthology.orchestra.run.smithi146.stderr: 55650K .......... .......... .......... .......... .......... 75% 273M 0s 2019-12-09T11:30:25.583 INFO:teuthology.orchestra.run.smithi146.stderr: 55700K .......... .......... .......... .......... .......... 75% 279M 0s 2019-12-09T11:30:25.583 INFO:teuthology.orchestra.run.smithi146.stderr: 55750K .......... .......... .......... .......... .......... 75% 225M 0s 2019-12-09T11:30:25.583 INFO:teuthology.orchestra.run.smithi146.stderr: 55800K .......... .......... .......... .......... .......... 75% 271M 0s 2019-12-09T11:30:25.583 INFO:teuthology.orchestra.run.smithi146.stderr: 55850K .......... .......... .......... .......... .......... 75% 278M 0s 2019-12-09T11:30:25.583 INFO:teuthology.orchestra.run.smithi146.stderr: 55900K .......... .......... .......... .......... .......... 76% 263M 0s 2019-12-09T11:30:25.584 INFO:teuthology.orchestra.run.smithi146.stderr: 55950K .......... .......... .......... .......... .......... 76% 245M 0s 2019-12-09T11:30:25.584 INFO:teuthology.orchestra.run.smithi146.stderr: 56000K .......... .......... .......... .......... .......... 76% 275M 0s 2019-12-09T11:30:25.584 INFO:teuthology.orchestra.run.smithi146.stderr: 56050K .......... .......... .......... .......... .......... 76% 271M 0s 2019-12-09T11:30:25.584 INFO:teuthology.orchestra.run.smithi146.stderr: 56100K .......... .......... .......... .......... .......... 76% 268M 0s 2019-12-09T11:30:25.584 INFO:teuthology.orchestra.run.smithi146.stderr: 56150K .......... .......... .......... .......... .......... 76% 229M 0s 2019-12-09T11:30:25.584 INFO:teuthology.orchestra.run.smithi146.stderr: 56200K .......... .......... .......... .......... .......... 76% 269M 0s 2019-12-09T11:30:25.584 INFO:teuthology.orchestra.run.smithi146.stderr: 56250K .......... .......... .......... .......... .......... 76% 278M 0s 2019-12-09T11:30:25.585 INFO:teuthology.orchestra.run.smithi146.stderr: 56300K .......... .......... .......... .......... .......... 76% 283M 0s 2019-12-09T11:30:25.585 INFO:teuthology.orchestra.run.smithi146.stderr: 56350K .......... .......... .......... .......... .......... 76% 238M 0s 2019-12-09T11:30:25.585 INFO:teuthology.orchestra.run.smithi146.stderr: 56400K .......... .......... .......... .......... .......... 76% 277M 0s 2019-12-09T11:30:25.585 INFO:teuthology.orchestra.run.smithi146.stderr: 56450K .......... .......... .......... .......... .......... 76% 271M 0s 2019-12-09T11:30:25.585 INFO:teuthology.orchestra.run.smithi146.stderr: 56500K .......... .......... .......... .......... .......... 76% 259M 0s 2019-12-09T11:30:25.585 INFO:teuthology.orchestra.run.smithi146.stderr: 56550K .......... .......... .......... .......... .......... 76% 217M 0s 2019-12-09T11:30:25.585 INFO:teuthology.orchestra.run.smithi146.stderr: 56600K .......... .......... .......... .......... .......... 77% 252M 0s 2019-12-09T11:30:25.586 INFO:teuthology.orchestra.run.smithi146.stderr: 56650K .......... .......... .......... .......... .......... 77% 259M 0s 2019-12-09T11:30:25.586 INFO:teuthology.orchestra.run.smithi146.stderr: 56700K .......... .......... .......... .......... .......... 77% 277M 0s 2019-12-09T11:30:25.586 INFO:teuthology.orchestra.run.smithi146.stderr: 56750K .......... .......... .......... .......... .......... 77% 247M 0s 2019-12-09T11:30:25.586 INFO:teuthology.orchestra.run.smithi146.stderr: 56800K .......... .......... .......... .......... .......... 77% 269M 0s 2019-12-09T11:30:25.586 INFO:teuthology.orchestra.run.smithi146.stderr: 56850K .......... .......... .......... .......... .......... 77% 265M 0s 2019-12-09T11:30:25.586 INFO:teuthology.orchestra.run.smithi146.stderr: 56900K .......... .......... .......... .......... .......... 77% 262M 0s 2019-12-09T11:30:25.586 INFO:teuthology.orchestra.run.smithi146.stderr: 56950K .......... .......... .......... .......... .......... 77% 228M 0s 2019-12-09T11:30:25.586 INFO:teuthology.orchestra.run.smithi146.stderr: 57000K .......... .......... .......... .......... .......... 77% 258M 0s 2019-12-09T11:30:25.587 INFO:teuthology.orchestra.run.smithi146.stderr: 57050K .......... .......... .......... .......... .......... 77% 250M 0s 2019-12-09T11:30:25.587 INFO:teuthology.orchestra.run.smithi146.stderr: 57100K .......... .......... .......... .......... .......... 77% 268M 0s 2019-12-09T11:30:25.587 INFO:teuthology.orchestra.run.smithi146.stderr: 57150K .......... .......... .......... .......... .......... 77% 236M 0s 2019-12-09T11:30:25.587 INFO:teuthology.orchestra.run.smithi146.stderr: 57200K .......... .......... .......... .......... .......... 77% 267M 0s 2019-12-09T11:30:25.587 INFO:teuthology.orchestra.run.smithi146.stderr: 57250K .......... .......... .......... .......... .......... 77% 279M 0s 2019-12-09T11:30:25.587 INFO:teuthology.orchestra.run.smithi146.stderr: 57300K .......... .......... .......... .......... .......... 77% 275M 0s 2019-12-09T11:30:25.587 INFO:teuthology.orchestra.run.smithi146.stderr: 57350K .......... .......... .......... .......... .......... 78% 230M 0s 2019-12-09T11:30:25.588 INFO:teuthology.orchestra.run.smithi146.stderr: 57400K .......... .......... .......... .......... .......... 78% 267M 0s 2019-12-09T11:30:25.588 INFO:teuthology.orchestra.run.smithi146.stderr: 57450K .......... .......... .......... .......... .......... 78% 270M 0s 2019-12-09T11:30:25.588 INFO:teuthology.orchestra.run.smithi146.stderr: 57500K .......... .......... .......... .......... .......... 78% 263M 0s 2019-12-09T11:30:25.588 INFO:teuthology.orchestra.run.smithi146.stderr: 57550K .......... .......... .......... .......... .......... 78% 252M 0s 2019-12-09T11:30:25.588 INFO:teuthology.orchestra.run.smithi146.stderr: 57600K .......... .......... .......... .......... .......... 78% 269M 0s 2019-12-09T11:30:25.588 INFO:teuthology.orchestra.run.smithi146.stderr: 57650K .......... .......... .......... .......... .......... 78% 277M 0s 2019-12-09T11:30:25.588 INFO:teuthology.orchestra.run.smithi146.stderr: 57700K .......... .......... .......... .......... .......... 78% 267M 0s 2019-12-09T11:30:25.589 INFO:teuthology.orchestra.run.smithi146.stderr: 57750K .......... .......... .......... .......... .......... 78% 229M 0s 2019-12-09T11:30:25.589 INFO:teuthology.orchestra.run.smithi146.stderr: 57800K .......... .......... .......... .......... .......... 78% 276M 0s 2019-12-09T11:30:25.589 INFO:teuthology.orchestra.run.smithi146.stderr: 57850K .......... .......... .......... .......... .......... 78% 278M 0s 2019-12-09T11:30:25.589 INFO:teuthology.orchestra.run.smithi146.stderr: 57900K .......... .......... .......... .......... .......... 78% 275M 0s 2019-12-09T11:30:25.589 INFO:teuthology.orchestra.run.smithi146.stderr: 57950K .......... .......... .......... .......... .......... 78% 238M 0s 2019-12-09T11:30:25.589 INFO:teuthology.orchestra.run.smithi146.stderr: 58000K .......... .......... .......... .......... .......... 78% 279M 0s 2019-12-09T11:30:25.590 INFO:teuthology.orchestra.run.smithi146.stderr: 58050K .......... .......... .......... .......... .......... 78% 273M 0s 2019-12-09T11:30:25.590 INFO:teuthology.orchestra.run.smithi146.stderr: 58100K .......... .......... .......... .......... .......... 79% 265M 0s 2019-12-09T11:30:25.590 INFO:teuthology.orchestra.run.smithi146.stderr: 58150K .......... .......... .......... .......... .......... 79% 222M 0s 2019-12-09T11:30:25.590 INFO:teuthology.orchestra.run.smithi146.stderr: 58200K .......... .......... .......... .......... .......... 79% 250M 0s 2019-12-09T11:30:25.590 INFO:teuthology.orchestra.run.smithi146.stderr: 58250K .......... .......... .......... .......... .......... 79% 259M 0s 2019-12-09T11:30:25.590 INFO:teuthology.orchestra.run.smithi146.stderr: 58300K .......... .......... .......... .......... .......... 79% 269M 0s 2019-12-09T11:30:25.591 INFO:teuthology.orchestra.run.smithi146.stderr: 58350K .......... .......... .......... .......... .......... 79% 229M 0s 2019-12-09T11:30:25.591 INFO:teuthology.orchestra.run.smithi146.stderr: 58400K .......... .......... .......... .......... .......... 79% 254M 0s 2019-12-09T11:30:25.591 INFO:teuthology.orchestra.run.smithi146.stderr: 58450K .......... .......... .......... .......... .......... 79% 257M 0s 2019-12-09T11:30:25.591 INFO:teuthology.orchestra.run.smithi146.stderr: 58500K .......... .......... .......... .......... .......... 79% 279M 0s 2019-12-09T11:30:25.591 INFO:teuthology.orchestra.run.smithi146.stderr: 58550K .......... .......... .......... .......... .......... 79% 212M 0s 2019-12-09T11:30:25.591 INFO:teuthology.orchestra.run.smithi146.stderr: 58600K .......... .......... .......... .......... .......... 79% 267M 0s 2019-12-09T11:30:25.592 INFO:teuthology.orchestra.run.smithi146.stderr: 58650K .......... .......... .......... .......... .......... 79% 274M 0s 2019-12-09T11:30:25.592 INFO:teuthology.orchestra.run.smithi146.stderr: 58700K .......... .......... .......... .......... .......... 79% 272M 0s 2019-12-09T11:30:25.592 INFO:teuthology.orchestra.run.smithi146.stderr: 58750K .......... .......... .......... .......... .......... 79% 230M 0s 2019-12-09T11:30:25.592 INFO:teuthology.orchestra.run.smithi146.stderr: 58800K .......... .......... .......... .......... .......... 80% 270M 0s 2019-12-09T11:30:25.592 INFO:teuthology.orchestra.run.smithi146.stderr: 58850K .......... .......... .......... .......... .......... 80% 276M 0s 2019-12-09T11:30:25.592 INFO:teuthology.orchestra.run.smithi146.stderr: 58900K .......... .......... .......... .......... .......... 80% 282M 0s 2019-12-09T11:30:25.592 INFO:teuthology.orchestra.run.smithi146.stderr: 58950K .......... .......... .......... .......... .......... 80% 230M 0s 2019-12-09T11:30:25.593 INFO:teuthology.orchestra.run.smithi146.stderr: 59000K .......... .......... .......... .......... .......... 80% 269M 0s 2019-12-09T11:30:25.593 INFO:teuthology.orchestra.run.smithi146.stderr: 59050K .......... .......... .......... .......... .......... 80% 276M 0s 2019-12-09T11:30:25.593 INFO:teuthology.orchestra.run.smithi146.stderr: 59100K .......... .......... .......... .......... .......... 80% 274M 0s 2019-12-09T11:30:25.593 INFO:teuthology.orchestra.run.smithi146.stderr: 59150K .......... .......... .......... .......... .......... 80% 245M 0s 2019-12-09T11:30:25.593 INFO:teuthology.orchestra.run.smithi146.stderr: 59200K .......... .......... .......... .......... .......... 80% 262M 0s 2019-12-09T11:30:25.593 INFO:teuthology.orchestra.run.smithi146.stderr: 59250K .......... .......... .......... .......... .......... 80% 266M 0s 2019-12-09T11:30:25.593 INFO:teuthology.orchestra.run.smithi146.stderr: 59300K .......... .......... .......... .......... .......... 80% 270M 0s 2019-12-09T11:30:25.594 INFO:teuthology.orchestra.run.smithi146.stderr: 59350K .......... .......... .......... .......... .......... 80% 256M 0s 2019-12-09T11:30:25.594 INFO:teuthology.orchestra.run.smithi146.stderr: 59400K .......... .......... .......... .......... .......... 80% 356M 0s 2019-12-09T11:30:25.594 INFO:teuthology.orchestra.run.smithi146.stderr: 59450K .......... .......... .......... .......... .......... 80% 366M 0s 2019-12-09T11:30:25.594 INFO:teuthology.orchestra.run.smithi146.stderr: 59500K .......... .......... .......... .......... .......... 80% 413M 0s 2019-12-09T11:30:25.594 INFO:teuthology.orchestra.run.smithi146.stderr: 59550K .......... .......... .......... .......... .......... 81% 341M 0s 2019-12-09T11:30:25.594 INFO:teuthology.orchestra.run.smithi146.stderr: 59600K .......... .......... .......... .......... .......... 81% 267M 0s 2019-12-09T11:30:25.594 INFO:teuthology.orchestra.run.smithi146.stderr: 59650K .......... .......... .......... .......... .......... 81% 334M 0s 2019-12-09T11:30:25.595 INFO:teuthology.orchestra.run.smithi146.stderr: 59700K .......... .......... .......... .......... .......... 81% 352M 0s 2019-12-09T11:30:25.595 INFO:teuthology.orchestra.run.smithi146.stderr: 59750K .......... .......... .......... .......... .......... 81% 322M 0s 2019-12-09T11:30:25.595 INFO:teuthology.orchestra.run.smithi146.stderr: 59800K .......... .......... .......... .......... .......... 81% 374M 0s 2019-12-09T11:30:25.595 INFO:teuthology.orchestra.run.smithi146.stderr: 59850K .......... .......... .......... .......... .......... 81% 376M 0s 2019-12-09T11:30:25.595 INFO:teuthology.orchestra.run.smithi146.stderr: 59900K .......... .......... .......... .......... .......... 81% 387M 0s 2019-12-09T11:30:25.595 INFO:teuthology.orchestra.run.smithi146.stderr: 59950K .......... .......... .......... .......... .......... 81% 332M 0s 2019-12-09T11:30:25.595 INFO:teuthology.orchestra.run.smithi146.stderr: 60000K .......... .......... .......... .......... .......... 81% 371M 0s 2019-12-09T11:30:25.596 INFO:teuthology.orchestra.run.smithi146.stderr: 60050K .......... .......... .......... .......... .......... 81% 378M 0s 2019-12-09T11:30:25.596 INFO:teuthology.orchestra.run.smithi146.stderr: 60100K .......... .......... .......... .......... .......... 81% 375M 0s 2019-12-09T11:30:25.596 INFO:teuthology.orchestra.run.smithi146.stderr: 60150K .......... .......... .......... .......... .......... 81% 316M 0s 2019-12-09T11:30:25.596 INFO:teuthology.orchestra.run.smithi146.stderr: 60200K .......... .......... .......... .......... .......... 81% 389M 0s 2019-12-09T11:30:25.596 INFO:teuthology.orchestra.run.smithi146.stderr: 60250K .......... .......... .......... .......... .......... 81% 366M 0s 2019-12-09T11:30:25.596 INFO:teuthology.orchestra.run.smithi146.stderr: 60300K .......... .......... .......... .......... .......... 82% 362M 0s 2019-12-09T11:30:25.596 INFO:teuthology.orchestra.run.smithi146.stderr: 60350K .......... .......... .......... .......... .......... 82% 355M 0s 2019-12-09T11:30:25.597 INFO:teuthology.orchestra.run.smithi146.stderr: 60400K .......... .......... .......... .......... .......... 82% 390M 0s 2019-12-09T11:30:25.597 INFO:teuthology.orchestra.run.smithi146.stderr: 60450K .......... .......... .......... .......... .......... 82% 385M 0s 2019-12-09T11:30:25.597 INFO:teuthology.orchestra.run.smithi146.stderr: 60500K .......... .......... .......... .......... .......... 82% 377M 0s 2019-12-09T11:30:25.597 INFO:teuthology.orchestra.run.smithi146.stderr: 60550K .......... .......... .......... .......... .......... 82% 305M 0s 2019-12-09T11:30:25.597 INFO:teuthology.orchestra.run.smithi146.stderr: 60600K .......... .......... .......... .......... .......... 82% 378M 0s 2019-12-09T11:30:25.597 INFO:teuthology.orchestra.run.smithi146.stderr: 60650K .......... .......... .......... .......... .......... 82% 365M 0s 2019-12-09T11:30:25.597 INFO:teuthology.orchestra.run.smithi146.stderr: 60700K .......... .......... .......... .......... .......... 82% 374M 0s 2019-12-09T11:30:25.598 INFO:teuthology.orchestra.run.smithi146.stderr: 60750K .......... .......... .......... .......... .......... 82% 335M 0s 2019-12-09T11:30:25.598 INFO:teuthology.orchestra.run.smithi146.stderr: 60800K .......... .......... .......... .......... .......... 82% 374M 0s 2019-12-09T11:30:25.598 INFO:teuthology.orchestra.run.smithi146.stderr: 60850K .......... .......... .......... .......... .......... 82% 369M 0s 2019-12-09T11:30:25.598 INFO:teuthology.orchestra.run.smithi146.stderr: 60900K .......... .......... .......... .......... .......... 82% 406M 0s 2019-12-09T11:30:25.598 INFO:teuthology.orchestra.run.smithi146.stderr: 60950K .......... .......... .......... .......... .......... 82% 325M 0s 2019-12-09T11:30:25.598 INFO:teuthology.orchestra.run.smithi146.stderr: 61000K .......... .......... .......... .......... .......... 82% 360M 0s 2019-12-09T11:30:25.598 INFO:teuthology.orchestra.run.smithi146.stderr: 61050K .......... .......... .......... .......... .......... 83% 362M 0s 2019-12-09T11:30:25.599 INFO:teuthology.orchestra.run.smithi146.stderr: 61100K .......... .......... .......... .......... .......... 83% 382M 0s 2019-12-09T11:30:25.599 INFO:teuthology.orchestra.run.smithi146.stderr: 61150K .......... .......... .......... .......... .......... 83% 350M 0s 2019-12-09T11:30:25.599 INFO:teuthology.orchestra.run.smithi146.stderr: 61200K .......... .......... .......... .......... .......... 83% 380M 0s 2019-12-09T11:30:25.599 INFO:teuthology.orchestra.run.smithi146.stderr: 61250K .......... .......... .......... .......... .......... 83% 381M 0s 2019-12-09T11:30:25.599 INFO:teuthology.orchestra.run.smithi146.stderr: 61300K .......... .......... .......... .......... .......... 83% 390M 0s 2019-12-09T11:30:25.599 INFO:teuthology.orchestra.run.smithi146.stderr: 61350K .......... .......... .......... .......... .......... 83% 335M 0s 2019-12-09T11:30:25.599 INFO:teuthology.orchestra.run.smithi146.stderr: 61400K .......... .......... .......... .......... .......... 83% 411M 0s 2019-12-09T11:30:25.599 INFO:teuthology.orchestra.run.smithi146.stderr: 61450K .......... .......... .......... .......... .......... 83% 400M 0s 2019-12-09T11:30:25.600 INFO:teuthology.orchestra.run.smithi146.stderr: 61500K .......... .......... .......... .......... .......... 83% 396M 0s 2019-12-09T11:30:25.600 INFO:teuthology.orchestra.run.smithi146.stderr: 61550K .......... .......... .......... .......... .......... 83% 344M 0s 2019-12-09T11:30:25.600 INFO:teuthology.orchestra.run.smithi146.stderr: 61600K .......... .......... .......... .......... .......... 83% 381M 0s 2019-12-09T11:30:25.600 INFO:teuthology.orchestra.run.smithi146.stderr: 61650K .......... .......... .......... .......... .......... 83% 392M 0s 2019-12-09T11:30:25.600 INFO:teuthology.orchestra.run.smithi146.stderr: 61700K .......... .......... .......... .......... .......... 83% 399M 0s 2019-12-09T11:30:25.600 INFO:teuthology.orchestra.run.smithi146.stderr: 61750K .......... .......... .......... .......... .......... 84% 319M 0s 2019-12-09T11:30:25.601 INFO:teuthology.orchestra.run.smithi146.stderr: 61800K .......... .......... .......... .......... .......... 84% 366M 0s 2019-12-09T11:30:25.601 INFO:teuthology.orchestra.run.smithi146.stderr: 61850K .......... .......... .......... .......... .......... 84% 384M 0s 2019-12-09T11:30:25.601 INFO:teuthology.orchestra.run.smithi146.stderr: 61900K .......... .......... .......... .......... .......... 84% 386M 0s 2019-12-09T11:30:25.601 INFO:teuthology.orchestra.run.smithi146.stderr: 61950K .......... .......... .......... .......... .......... 84% 350M 0s 2019-12-09T11:30:25.601 INFO:teuthology.orchestra.run.smithi146.stderr: 62000K .......... .......... .......... .......... .......... 84% 390M 0s 2019-12-09T11:30:25.601 INFO:teuthology.orchestra.run.smithi146.stderr: 62050K .......... .......... .......... .......... .......... 84% 369M 0s 2019-12-09T11:30:25.601 INFO:teuthology.orchestra.run.smithi146.stderr: 62100K .......... .......... .......... .......... .......... 84% 389M 0s 2019-12-09T11:30:25.601 INFO:teuthology.orchestra.run.smithi146.stderr: 62150K .......... .......... .......... .......... .......... 84% 321M 0s 2019-12-09T11:30:25.602 INFO:teuthology.orchestra.run.smithi146.stderr: 62200K .......... .......... .......... .......... .......... 84% 382M 0s 2019-12-09T11:30:25.602 INFO:teuthology.orchestra.run.smithi146.stderr: 62250K .......... .......... .......... .......... .......... 84% 399M 0s 2019-12-09T11:30:25.602 INFO:teuthology.orchestra.run.smithi146.stderr: 62300K .......... .......... .......... .......... .......... 84% 399M 0s 2019-12-09T11:30:25.602 INFO:teuthology.orchestra.run.smithi146.stderr: 62350K .......... .......... .......... .......... .......... 84% 351M 0s 2019-12-09T11:30:25.602 INFO:teuthology.orchestra.run.smithi146.stderr: 62400K .......... .......... .......... .......... .......... 84% 393M 0s 2019-12-09T11:30:25.602 INFO:teuthology.orchestra.run.smithi146.stderr: 62450K .......... .......... .......... .......... .......... 84% 399M 0s 2019-12-09T11:30:25.602 INFO:teuthology.orchestra.run.smithi146.stderr: 62500K .......... .......... .......... .......... .......... 85% 397M 0s 2019-12-09T11:30:25.603 INFO:teuthology.orchestra.run.smithi146.stderr: 62550K .......... .......... .......... .......... .......... 85% 335M 0s 2019-12-09T11:30:25.603 INFO:teuthology.orchestra.run.smithi146.stderr: 62600K .......... .......... .......... .......... .......... 85% 389M 0s 2019-12-09T11:30:25.603 INFO:teuthology.orchestra.run.smithi146.stderr: 62650K .......... .......... .......... .......... .......... 85% 399M 0s 2019-12-09T11:30:25.603 INFO:teuthology.orchestra.run.smithi146.stderr: 62700K .......... .......... .......... .......... .......... 85% 389M 0s 2019-12-09T11:30:25.603 INFO:teuthology.orchestra.run.smithi146.stderr: 62750K .......... .......... .......... .......... .......... 85% 353M 0s 2019-12-09T11:30:25.603 INFO:teuthology.orchestra.run.smithi146.stderr: 62800K .......... .......... .......... .......... .......... 85% 339M 0s 2019-12-09T11:30:25.603 INFO:teuthology.orchestra.run.smithi146.stderr: 62850K .......... .......... .......... .......... .......... 85% 354M 0s 2019-12-09T11:30:25.604 INFO:teuthology.orchestra.run.smithi146.stderr: 62900K .......... .......... .......... .......... .......... 85% 348M 0s 2019-12-09T11:30:25.604 INFO:teuthology.orchestra.run.smithi146.stderr: 62950K .......... .......... .......... .......... .......... 85% 305M 0s 2019-12-09T11:30:25.604 INFO:teuthology.orchestra.run.smithi146.stderr: 63000K .......... .......... .......... .......... .......... 85% 411M 0s 2019-12-09T11:30:25.604 INFO:teuthology.orchestra.run.smithi146.stderr: 63050K .......... .......... .......... .......... .......... 85% 390M 0s 2019-12-09T11:30:25.604 INFO:teuthology.orchestra.run.smithi146.stderr: 63100K .......... .......... .......... .......... .......... 85% 390M 0s 2019-12-09T11:30:25.604 INFO:teuthology.orchestra.run.smithi146.stderr: 63150K .......... .......... .......... .......... .......... 85% 357M 0s 2019-12-09T11:30:25.604 INFO:teuthology.orchestra.run.smithi146.stderr: 63200K .......... .......... .......... .......... .......... 85% 398M 0s 2019-12-09T11:30:25.605 INFO:teuthology.orchestra.run.smithi146.stderr: 63250K .......... .......... .......... .......... .......... 86% 402M 0s 2019-12-09T11:30:25.605 INFO:teuthology.orchestra.run.smithi146.stderr: 63300K .......... .......... .......... .......... .......... 86% 406M 0s 2019-12-09T11:30:25.605 INFO:teuthology.orchestra.run.smithi146.stderr: 63350K .......... .......... .......... .......... .......... 86% 332M 0s 2019-12-09T11:30:25.605 INFO:teuthology.orchestra.run.smithi146.stderr: 63400K .......... .......... .......... .......... .......... 86% 406M 0s 2019-12-09T11:30:25.605 INFO:teuthology.orchestra.run.smithi146.stderr: 63450K .......... .......... .......... .......... .......... 86% 383M 0s 2019-12-09T11:30:25.605 INFO:teuthology.orchestra.run.smithi146.stderr: 63500K .......... .......... .......... .......... .......... 86% 410M 0s 2019-12-09T11:30:25.605 INFO:teuthology.orchestra.run.smithi146.stderr: 63550K .......... .......... .......... .......... .......... 86% 356M 0s 2019-12-09T11:30:25.606 INFO:teuthology.orchestra.run.smithi146.stderr: 63600K .......... .......... .......... .......... .......... 86% 386M 0s 2019-12-09T11:30:25.606 INFO:teuthology.orchestra.run.smithi146.stderr: 63650K .......... .......... .......... .......... .......... 86% 378M 0s 2019-12-09T11:30:25.606 INFO:teuthology.orchestra.run.smithi146.stderr: 63700K .......... .......... .......... .......... .......... 86% 393M 0s 2019-12-09T11:30:25.606 INFO:teuthology.orchestra.run.smithi146.stderr: 63750K .......... .......... .......... .......... .......... 86% 307M 0s 2019-12-09T11:30:25.606 INFO:teuthology.orchestra.run.smithi146.stderr: 63800K .......... .......... .......... .......... .......... 86% 387M 0s 2019-12-09T11:30:25.606 INFO:teuthology.orchestra.run.smithi146.stderr: 63850K .......... .......... .......... .......... .......... 86% 376M 0s 2019-12-09T11:30:25.606 INFO:teuthology.orchestra.run.smithi146.stderr: 63900K .......... .......... .......... .......... .......... 86% 383M 0s 2019-12-09T11:30:25.607 INFO:teuthology.orchestra.run.smithi146.stderr: 63950K .......... .......... .......... .......... .......... 87% 336M 0s 2019-12-09T11:30:25.607 INFO:teuthology.orchestra.run.smithi146.stderr: 64000K .......... .......... .......... .......... .......... 87% 375M 0s 2019-12-09T11:30:25.607 INFO:teuthology.orchestra.run.smithi146.stderr: 64050K .......... .......... .......... .......... .......... 87% 383M 0s 2019-12-09T11:30:25.607 INFO:teuthology.orchestra.run.smithi146.stderr: 64100K .......... .......... .......... .......... .......... 87% 359M 0s 2019-12-09T11:30:25.607 INFO:teuthology.orchestra.run.smithi146.stderr: 64150K .......... .......... .......... .......... .......... 87% 307M 0s 2019-12-09T11:30:25.607 INFO:teuthology.orchestra.run.smithi146.stderr: 64200K .......... .......... .......... .......... .......... 87% 371M 0s 2019-12-09T11:30:25.607 INFO:teuthology.orchestra.run.smithi146.stderr: 64250K .......... .......... .......... .......... .......... 87% 403M 0s 2019-12-09T11:30:25.608 INFO:teuthology.orchestra.run.smithi146.stderr: 64300K .......... .......... .......... .......... .......... 87% 417M 0s 2019-12-09T11:30:25.608 INFO:teuthology.orchestra.run.smithi146.stderr: 64350K .......... .......... .......... .......... .......... 87% 359M 0s 2019-12-09T11:30:25.608 INFO:teuthology.orchestra.run.smithi146.stderr: 64400K .......... .......... .......... .......... .......... 87% 367M 0s 2019-12-09T11:30:25.608 INFO:teuthology.orchestra.run.smithi146.stderr: 64450K .......... .......... .......... .......... .......... 87% 360M 0s 2019-12-09T11:30:25.608 INFO:teuthology.orchestra.run.smithi146.stderr: 64500K .......... .......... .......... .......... .......... 87% 361M 0s 2019-12-09T11:30:25.609 INFO:teuthology.orchestra.run.smithi146.stderr: 64550K .......... .......... .......... .......... .......... 87% 310M 0s 2019-12-09T11:30:25.609 INFO:teuthology.orchestra.run.smithi146.stderr: 64600K .......... .......... .......... .......... .......... 87% 360M 0s 2019-12-09T11:30:25.609 INFO:teuthology.orchestra.run.smithi146.stderr: 64650K .......... .......... .......... .......... .......... 87% 384M 0s 2019-12-09T11:30:25.609 INFO:teuthology.orchestra.run.smithi146.stderr: 64700K .......... .......... .......... .......... .......... 88% 392M 0s 2019-12-09T11:30:25.609 INFO:teuthology.orchestra.run.smithi146.stderr: 64750K .......... .......... .......... .......... .......... 88% 351M 0s 2019-12-09T11:30:25.609 INFO:teuthology.orchestra.run.smithi146.stderr: 64800K .......... .......... .......... .......... .......... 88% 401M 0s 2019-12-09T11:30:25.609 INFO:teuthology.orchestra.run.smithi146.stderr: 64850K .......... .......... .......... .......... .......... 88% 384M 0s 2019-12-09T11:30:25.610 INFO:teuthology.orchestra.run.smithi146.stderr: 64900K .......... .......... .......... .......... .......... 88% 401M 0s 2019-12-09T11:30:25.610 INFO:teuthology.orchestra.run.smithi146.stderr: 64950K .......... .......... .......... .......... .......... 88% 331M 0s 2019-12-09T11:30:25.610 INFO:teuthology.orchestra.run.smithi146.stderr: 65000K .......... .......... .......... .......... .......... 88% 394M 0s 2019-12-09T11:30:25.610 INFO:teuthology.orchestra.run.smithi146.stderr: 65050K .......... .......... .......... .......... .......... 88% 399M 0s 2019-12-09T11:30:25.610 INFO:teuthology.orchestra.run.smithi146.stderr: 65100K .......... .......... .......... .......... .......... 88% 408M 0s 2019-12-09T11:30:25.610 INFO:teuthology.orchestra.run.smithi146.stderr: 65150K .......... .......... .......... .......... .......... 88% 364M 0s 2019-12-09T11:30:25.610 INFO:teuthology.orchestra.run.smithi146.stderr: 65200K .......... .......... .......... .......... .......... 88% 394M 0s 2019-12-09T11:30:25.611 INFO:teuthology.orchestra.run.smithi146.stderr: 65250K .......... .......... .......... .......... .......... 88% 371M 0s 2019-12-09T11:30:25.611 INFO:teuthology.orchestra.run.smithi146.stderr: 65300K .......... .......... .......... .......... .......... 88% 397M 0s 2019-12-09T11:30:25.611 INFO:teuthology.orchestra.run.smithi146.stderr: 65350K .......... .......... .......... .......... .......... 88% 342M 0s 2019-12-09T11:30:25.611 INFO:teuthology.orchestra.run.smithi146.stderr: 65400K .......... .......... .......... .......... .......... 88% 384M 0s 2019-12-09T11:30:25.611 INFO:teuthology.orchestra.run.smithi146.stderr: 65450K .......... .......... .......... .......... .......... 89% 386M 0s 2019-12-09T11:30:25.611 INFO:teuthology.orchestra.run.smithi146.stderr: 65500K .......... .......... .......... .......... .......... 89% 400M 0s 2019-12-09T11:30:25.611 INFO:teuthology.orchestra.run.smithi146.stderr: 65550K .......... .......... .......... .......... .......... 89% 326M 0s 2019-12-09T11:30:25.611 INFO:teuthology.orchestra.run.smithi146.stderr: 65600K .......... .......... .......... .......... .......... 89% 379M 0s 2019-12-09T11:30:25.612 INFO:teuthology.orchestra.run.smithi146.stderr: 65650K .......... .......... .......... .......... .......... 89% 391M 0s 2019-12-09T11:30:25.612 INFO:teuthology.orchestra.run.smithi146.stderr: 65700K .......... .......... .......... .......... .......... 89% 379M 0s 2019-12-09T11:30:25.612 INFO:teuthology.orchestra.run.smithi146.stderr: 65750K .......... .......... .......... .......... .......... 89% 333M 0s 2019-12-09T11:30:25.612 INFO:teuthology.orchestra.run.smithi146.stderr: 65800K .......... .......... .......... .......... .......... 89% 375M 0s 2019-12-09T11:30:25.612 INFO:teuthology.orchestra.run.smithi146.stderr: 65850K .......... .......... .......... .......... .......... 89% 400M 0s 2019-12-09T11:30:25.612 INFO:teuthology.orchestra.run.smithi146.stderr: 65900K .......... .......... .......... .......... .......... 89% 282M 0s 2019-12-09T11:30:25.612 INFO:teuthology.orchestra.run.smithi146.stderr: 65950K .......... .......... .......... .......... .......... 89% 259M 0s 2019-12-09T11:30:25.613 INFO:teuthology.orchestra.run.smithi146.stderr: 66000K .......... .......... .......... .......... .......... 89% 330M 0s 2019-12-09T11:30:25.613 INFO:teuthology.orchestra.run.smithi146.stderr: 66050K .......... .......... .......... .......... .......... 89% 348M 0s 2019-12-09T11:30:25.613 INFO:teuthology.orchestra.run.smithi146.stderr: 66100K .......... .......... .......... .......... .......... 89% 357M 0s 2019-12-09T11:30:25.613 INFO:teuthology.orchestra.run.smithi146.stderr: 66150K .......... .......... .......... .......... .......... 89% 273M 0s 2019-12-09T11:30:25.613 INFO:teuthology.orchestra.run.smithi146.stderr: 66200K .......... .......... .......... .......... .......... 90% 379M 0s 2019-12-09T11:30:25.613 INFO:teuthology.orchestra.run.smithi146.stderr: 66250K .......... .......... .......... .......... .......... 90% 395M 0s 2019-12-09T11:30:25.613 INFO:teuthology.orchestra.run.smithi146.stderr: 66300K .......... .......... .......... .......... .......... 90% 382M 0s 2019-12-09T11:30:25.614 INFO:teuthology.orchestra.run.smithi146.stderr: 66350K .......... .......... .......... .......... .......... 90% 328M 0s 2019-12-09T11:30:25.614 INFO:teuthology.orchestra.run.smithi146.stderr: 66400K .......... .......... .......... .......... .......... 90% 374M 0s 2019-12-09T11:30:25.614 INFO:teuthology.orchestra.run.smithi146.stderr: 66450K .......... .......... .......... .......... .......... 90% 404M 0s 2019-12-09T11:30:25.614 INFO:teuthology.orchestra.run.smithi146.stderr: 66500K .......... .......... .......... .......... .......... 90% 392M 0s 2019-12-09T11:30:25.614 INFO:teuthology.orchestra.run.smithi146.stderr: 66550K .......... .......... .......... .......... .......... 90% 334M 0s 2019-12-09T11:30:25.614 INFO:teuthology.orchestra.run.smithi146.stderr: 66600K .......... .......... .......... .......... .......... 90% 391M 0s 2019-12-09T11:30:25.614 INFO:teuthology.orchestra.run.smithi146.stderr: 66650K .......... .......... .......... .......... .......... 90% 399M 0s 2019-12-09T11:30:25.615 INFO:teuthology.orchestra.run.smithi146.stderr: 66700K .......... .......... .......... .......... .......... 90% 384M 0s 2019-12-09T11:30:25.615 INFO:teuthology.orchestra.run.smithi146.stderr: 66750K .......... .......... .......... .......... .......... 90% 345M 0s 2019-12-09T11:30:25.615 INFO:teuthology.orchestra.run.smithi146.stderr: 66800K .......... .......... .......... .......... .......... 90% 355M 0s 2019-12-09T11:30:25.615 INFO:teuthology.orchestra.run.smithi146.stderr: 66850K .......... .......... .......... .......... .......... 90% 400M 0s 2019-12-09T11:30:25.615 INFO:teuthology.orchestra.run.smithi146.stderr: 66900K .......... .......... .......... .......... .......... 91% 400M 0s 2019-12-09T11:30:25.615 INFO:teuthology.orchestra.run.smithi146.stderr: 66950K .......... .......... .......... .......... .......... 91% 314M 0s 2019-12-09T11:30:25.615 INFO:teuthology.orchestra.run.smithi146.stderr: 67000K .......... .......... .......... .......... .......... 91% 393M 0s 2019-12-09T11:30:25.616 INFO:teuthology.orchestra.run.smithi146.stderr: 67050K .......... .......... .......... .......... .......... 91% 378M 0s 2019-12-09T11:30:25.616 INFO:teuthology.orchestra.run.smithi146.stderr: 67100K .......... .......... .......... .......... .......... 91% 375M 0s 2019-12-09T11:30:25.616 INFO:teuthology.orchestra.run.smithi146.stderr: 67150K .......... .......... .......... .......... .......... 91% 308M 0s 2019-12-09T11:30:25.616 INFO:teuthology.orchestra.run.smithi146.stderr: 67200K .......... .......... .......... .......... .......... 91% 393M 0s 2019-12-09T11:30:25.616 INFO:teuthology.orchestra.run.smithi146.stderr: 67250K .......... .......... .......... .......... .......... 91% 389M 0s 2019-12-09T11:30:25.616 INFO:teuthology.orchestra.run.smithi146.stderr: 67300K .......... .......... .......... .......... .......... 91% 403M 0s 2019-12-09T11:30:25.616 INFO:teuthology.orchestra.run.smithi146.stderr: 67350K .......... .......... .......... .......... .......... 91% 337M 0s 2019-12-09T11:30:25.616 INFO:teuthology.orchestra.run.smithi146.stderr: 67400K .......... .......... .......... .......... .......... 91% 413M 0s 2019-12-09T11:30:25.617 INFO:teuthology.orchestra.run.smithi146.stderr: 67450K .......... .......... .......... .......... .......... 91% 379M 0s 2019-12-09T11:30:25.617 INFO:teuthology.orchestra.run.smithi146.stderr: 67500K .......... .......... .......... .......... .......... 91% 407M 0s 2019-12-09T11:30:25.617 INFO:teuthology.orchestra.run.smithi146.stderr: 67550K .......... .......... .......... .......... .......... 91% 359M 0s 2019-12-09T11:30:25.617 INFO:teuthology.orchestra.run.smithi146.stderr: 67600K .......... .......... .......... .......... .......... 91% 396M 0s 2019-12-09T11:30:25.617 INFO:teuthology.orchestra.run.smithi146.stderr: 67650K .......... .......... .......... .......... .......... 92% 399M 0s 2019-12-09T11:30:25.617 INFO:teuthology.orchestra.run.smithi146.stderr: 67700K .......... .......... .......... .......... .......... 92% 375M 0s 2019-12-09T11:30:25.618 INFO:teuthology.orchestra.run.smithi146.stderr: 67750K .......... .......... .......... .......... .......... 92% 328M 0s 2019-12-09T11:30:25.618 INFO:teuthology.orchestra.run.smithi146.stderr: 67800K .......... .......... .......... .......... .......... 92% 366M 0s 2019-12-09T11:30:25.618 INFO:teuthology.orchestra.run.smithi146.stderr: 67850K .......... .......... .......... .......... .......... 92% 355M 0s 2019-12-09T11:30:25.618 INFO:teuthology.orchestra.run.smithi146.stderr: 67900K .......... .......... .......... .......... .......... 92% 391M 0s 2019-12-09T11:30:25.618 INFO:teuthology.orchestra.run.smithi146.stderr: 67950K .......... .......... .......... .......... .......... 92% 365M 0s 2019-12-09T11:30:25.618 INFO:teuthology.orchestra.run.smithi146.stderr: 68000K .......... .......... .......... .......... .......... 92% 402M 0s 2019-12-09T11:30:25.618 INFO:teuthology.orchestra.run.smithi146.stderr: 68050K .......... .......... .......... .......... .......... 92% 358M 0s 2019-12-09T11:30:25.619 INFO:teuthology.orchestra.run.smithi146.stderr: 68100K .......... .......... .......... .......... .......... 92% 387M 0s 2019-12-09T11:30:25.619 INFO:teuthology.orchestra.run.smithi146.stderr: 68150K .......... .......... .......... .......... .......... 92% 326M 0s 2019-12-09T11:30:25.619 INFO:teuthology.orchestra.run.smithi146.stderr: 68200K .......... .......... .......... .......... .......... 92% 386M 0s 2019-12-09T11:30:25.619 INFO:teuthology.orchestra.run.smithi146.stderr: 68250K .......... .......... .......... .......... .......... 92% 372M 0s 2019-12-09T11:30:25.619 INFO:teuthology.orchestra.run.smithi146.stderr: 68300K .......... .......... .......... .......... .......... 92% 377M 0s 2019-12-09T11:30:25.620 INFO:teuthology.orchestra.run.smithi146.stderr: 68350K .......... .......... .......... .......... .......... 92% 328M 0s 2019-12-09T11:30:25.620 INFO:teuthology.orchestra.run.smithi146.stderr: 68400K .......... .......... .......... .......... .......... 93% 386M 0s 2019-12-09T11:30:25.620 INFO:teuthology.orchestra.run.smithi146.stderr: 68450K .......... .......... .......... .......... .......... 93% 387M 0s 2019-12-09T11:30:25.620 INFO:teuthology.orchestra.run.smithi146.stderr: 68500K .......... .......... .......... .......... .......... 93% 370M 0s 2019-12-09T11:30:25.620 INFO:teuthology.orchestra.run.smithi146.stderr: 68550K .......... .......... .......... .......... .......... 93% 300M 0s 2019-12-09T11:30:25.620 INFO:teuthology.orchestra.run.smithi146.stderr: 68600K .......... .......... .......... .......... .......... 93% 278M 0s 2019-12-09T11:30:25.620 INFO:teuthology.orchestra.run.smithi146.stderr: 68650K .......... .......... .......... .......... .......... 93% 271M 0s 2019-12-09T11:30:25.621 INFO:teuthology.orchestra.run.smithi146.stderr: 68700K .......... .......... .......... .......... .......... 93% 279M 0s 2019-12-09T11:30:25.621 INFO:teuthology.orchestra.run.smithi146.stderr: 68750K .......... .......... .......... .......... .......... 93% 239M 0s 2019-12-09T11:30:25.621 INFO:teuthology.orchestra.run.smithi146.stderr: 68800K .......... .......... .......... .......... .......... 93% 282M 0s 2019-12-09T11:30:25.621 INFO:teuthology.orchestra.run.smithi146.stderr: 68850K .......... .......... .......... .......... .......... 93% 271M 0s 2019-12-09T11:30:25.621 INFO:teuthology.orchestra.run.smithi146.stderr: 68900K .......... .......... .......... .......... .......... 93% 281M 0s 2019-12-09T11:30:25.621 INFO:teuthology.orchestra.run.smithi146.stderr: 68950K .......... .......... .......... .......... .......... 93% 233M 0s 2019-12-09T11:30:25.621 INFO:teuthology.orchestra.run.smithi146.stderr: 69000K .......... .......... .......... .......... .......... 93% 274M 0s 2019-12-09T11:30:25.622 INFO:teuthology.orchestra.run.smithi146.stderr: 69050K .......... .......... .......... .......... .......... 93% 270M 0s 2019-12-09T11:30:25.622 INFO:teuthology.orchestra.run.smithi146.stderr: 69100K .......... .......... .......... .......... .......... 94% 271M 0s 2019-12-09T11:30:25.622 INFO:teuthology.orchestra.run.smithi146.stderr: 69150K .......... .......... .......... .......... .......... 94% 247M 0s 2019-12-09T11:30:25.622 INFO:teuthology.orchestra.run.smithi146.stderr: 69200K .......... .......... .......... .......... .......... 94% 276M 0s 2019-12-09T11:30:25.622 INFO:teuthology.orchestra.run.smithi146.stderr: 69250K .......... .......... .......... .......... .......... 94% 277M 0s 2019-12-09T11:30:25.622 INFO:teuthology.orchestra.run.smithi146.stderr: 69300K .......... .......... .......... .......... .......... 94% 275M 0s 2019-12-09T11:30:25.622 INFO:teuthology.orchestra.run.smithi146.stderr: 69350K .......... .......... .......... .......... .......... 94% 220M 0s 2019-12-09T11:30:25.623 INFO:teuthology.orchestra.run.smithi146.stderr: 69400K .......... .......... .......... .......... .......... 94% 269M 0s 2019-12-09T11:30:25.623 INFO:teuthology.orchestra.run.smithi146.stderr: 69450K .......... .......... .......... .......... .......... 94% 275M 0s 2019-12-09T11:30:25.623 INFO:teuthology.orchestra.run.smithi146.stderr: 69500K .......... .......... .......... .......... .......... 94% 266M 0s 2019-12-09T11:30:25.623 INFO:teuthology.orchestra.run.smithi146.stderr: 69550K .......... .......... .......... .......... .......... 94% 254M 0s 2019-12-09T11:30:25.623 INFO:teuthology.orchestra.run.smithi146.stderr: 69600K .......... .......... .......... .......... .......... 94% 277M 0s 2019-12-09T11:30:25.623 INFO:teuthology.orchestra.run.smithi146.stderr: 69650K .......... .......... .......... .......... .......... 94% 275M 0s 2019-12-09T11:30:25.623 INFO:teuthology.orchestra.run.smithi146.stderr: 69700K .......... .......... .......... .......... .......... 94% 274M 0s 2019-12-09T11:30:25.624 INFO:teuthology.orchestra.run.smithi146.stderr: 69750K .......... .......... .......... .......... .......... 94% 230M 0s 2019-12-09T11:30:25.624 INFO:teuthology.orchestra.run.smithi146.stderr: 69800K .......... .......... .......... .......... .......... 94% 283M 0s 2019-12-09T11:30:25.624 INFO:teuthology.orchestra.run.smithi146.stderr: 69850K .......... .......... .......... .......... .......... 95% 273M 0s 2019-12-09T11:30:25.624 INFO:teuthology.orchestra.run.smithi146.stderr: 69900K .......... .......... .......... .......... .......... 95% 275M 0s 2019-12-09T11:30:25.624 INFO:teuthology.orchestra.run.smithi146.stderr: 69950K .......... .......... .......... .......... .......... 95% 240M 0s 2019-12-09T11:30:25.624 INFO:teuthology.orchestra.run.smithi146.stderr: 70000K .......... .......... .......... .......... .......... 95% 256M 0s 2019-12-09T11:30:25.624 INFO:teuthology.orchestra.run.smithi146.stderr: 70050K .......... .......... .......... .......... .......... 95% 271M 0s 2019-12-09T11:30:25.624 INFO:teuthology.orchestra.run.smithi146.stderr: 70100K .......... .......... .......... .......... .......... 95% 276M 0s 2019-12-09T11:30:25.625 INFO:teuthology.orchestra.run.smithi146.stderr: 70150K .......... .......... .......... .......... .......... 95% 236M 0s 2019-12-09T11:30:25.625 INFO:teuthology.orchestra.run.smithi146.stderr: 70200K .......... .......... .......... .......... .......... 95% 277M 0s 2019-12-09T11:30:25.625 INFO:teuthology.orchestra.run.smithi146.stderr: 70250K .......... .......... .......... .......... .......... 95% 272M 0s 2019-12-09T11:30:25.625 INFO:teuthology.orchestra.run.smithi146.stderr: 70300K .......... .......... .......... .......... .......... 95% 284M 0s 2019-12-09T11:30:25.625 INFO:teuthology.orchestra.run.smithi146.stderr: 70350K .......... .......... .......... .......... .......... 95% 248M 0s 2019-12-09T11:30:25.625 INFO:teuthology.orchestra.run.smithi146.stderr: 70400K .......... .......... .......... .......... .......... 95% 277M 0s 2019-12-09T11:30:25.625 INFO:teuthology.orchestra.run.smithi146.stderr: 70450K .......... .......... .......... .......... .......... 95% 247M 0s 2019-12-09T11:30:25.626 INFO:teuthology.orchestra.run.smithi146.stderr: 70500K .......... .......... .......... .......... .......... 95% 269M 0s 2019-12-09T11:30:25.626 INFO:teuthology.orchestra.run.smithi146.stderr: 70550K .......... .......... .......... .......... .......... 95% 221M 0s 2019-12-09T11:30:25.626 INFO:teuthology.orchestra.run.smithi146.stderr: 70600K .......... .......... .......... .......... .......... 96% 280M 0s 2019-12-09T11:30:25.626 INFO:teuthology.orchestra.run.smithi146.stderr: 70650K .......... .......... .......... .......... .......... 96% 274M 0s 2019-12-09T11:30:25.626 INFO:teuthology.orchestra.run.smithi146.stderr: 70700K .......... .......... .......... .......... .......... 96% 272M 0s 2019-12-09T11:30:25.626 INFO:teuthology.orchestra.run.smithi146.stderr: 70750K .......... .......... .......... .......... .......... 96% 245M 0s 2019-12-09T11:30:25.626 INFO:teuthology.orchestra.run.smithi146.stderr: 70800K .......... .......... .......... .......... .......... 96% 273M 0s 2019-12-09T11:30:25.627 INFO:teuthology.orchestra.run.smithi146.stderr: 70850K .......... .......... .......... .......... .......... 96% 270M 0s 2019-12-09T11:30:25.627 INFO:teuthology.orchestra.run.smithi146.stderr: 70900K .......... .......... .......... .......... .......... 96% 274M 0s 2019-12-09T11:30:25.627 INFO:teuthology.orchestra.run.smithi146.stderr: 70950K .......... .......... .......... .......... .......... 96% 227M 0s 2019-12-09T11:30:25.627 INFO:teuthology.orchestra.run.smithi146.stderr: 71000K .......... .......... .......... .......... .......... 96% 261M 0s 2019-12-09T11:30:25.627 INFO:teuthology.orchestra.run.smithi146.stderr: 71050K .......... .......... .......... .......... .......... 96% 268M 0s 2019-12-09T11:30:25.627 INFO:teuthology.orchestra.run.smithi146.stderr: 71100K .......... .......... .......... .......... .......... 96% 266M 0s 2019-12-09T11:30:25.627 INFO:teuthology.orchestra.run.smithi146.stderr: 71150K .......... .......... .......... .......... .......... 96% 232M 0s 2019-12-09T11:30:25.628 INFO:teuthology.orchestra.run.smithi146.stderr: 71200K .......... .......... .......... .......... .......... 96% 276M 0s 2019-12-09T11:30:25.628 INFO:teuthology.orchestra.run.smithi146.stderr: 71250K .......... .......... .......... .......... .......... 96% 276M 0s 2019-12-09T11:30:25.628 INFO:teuthology.orchestra.run.smithi146.stderr: 71300K .......... .......... .......... .......... .......... 96% 270M 0s 2019-12-09T11:30:25.628 INFO:teuthology.orchestra.run.smithi146.stderr: 71350K .......... .......... .......... .......... .......... 97% 227M 0s 2019-12-09T11:30:25.628 INFO:teuthology.orchestra.run.smithi146.stderr: 71400K .......... .......... .......... .......... .......... 97% 271M 0s 2019-12-09T11:30:25.628 INFO:teuthology.orchestra.run.smithi146.stderr: 71450K .......... .......... .......... .......... .......... 97% 267M 0s 2019-12-09T11:30:25.628 INFO:teuthology.orchestra.run.smithi146.stderr: 71500K .......... .......... .......... .......... .......... 97% 280M 0s 2019-12-09T11:30:25.629 INFO:teuthology.orchestra.run.smithi146.stderr: 71550K .......... .......... .......... .......... .......... 97% 225M 0s 2019-12-09T11:30:25.629 INFO:teuthology.orchestra.run.smithi146.stderr: 71600K .......... .......... .......... .......... .......... 97% 265M 0s 2019-12-09T11:30:25.629 INFO:teuthology.orchestra.run.smithi146.stderr: 71650K .......... .......... .......... .......... .......... 97% 275M 0s 2019-12-09T11:30:25.629 INFO:teuthology.orchestra.run.smithi146.stderr: 71700K .......... .......... .......... .......... .......... 97% 275M 0s 2019-12-09T11:30:25.629 INFO:teuthology.orchestra.run.smithi146.stderr: 71750K .......... .......... .......... .......... .......... 97% 233M 0s 2019-12-09T11:30:25.629 INFO:teuthology.orchestra.run.smithi146.stderr: 71800K .......... .......... .......... .......... .......... 97% 255M 0s 2019-12-09T11:30:25.629 INFO:teuthology.orchestra.run.smithi146.stderr: 71850K .......... .......... .......... .......... .......... 97% 264M 0s 2019-12-09T11:30:25.629 INFO:teuthology.orchestra.run.smithi146.stderr: 71900K .......... .......... .......... .......... .......... 97% 263M 0s 2019-12-09T11:30:25.630 INFO:teuthology.orchestra.run.smithi146.stderr: 71950K .......... .......... .......... .......... .......... 97% 230M 0s 2019-12-09T11:30:25.630 INFO:teuthology.orchestra.run.smithi146.stderr: 72000K .......... .......... .......... .......... .......... 97% 268M 0s 2019-12-09T11:30:25.630 INFO:teuthology.orchestra.run.smithi146.stderr: 72050K .......... .......... .......... .......... .......... 98% 234M 0s 2019-12-09T11:30:25.630 INFO:teuthology.orchestra.run.smithi146.stderr: 72100K .......... .......... .......... .......... .......... 98% 245M 0s 2019-12-09T11:30:25.630 INFO:teuthology.orchestra.run.smithi146.stderr: 72150K .......... .......... .......... .......... .......... 98% 209M 0s 2019-12-09T11:30:25.630 INFO:teuthology.orchestra.run.smithi146.stderr: 72200K .......... .......... .......... .......... .......... 98% 259M 0s 2019-12-09T11:30:25.630 INFO:teuthology.orchestra.run.smithi146.stderr: 72250K .......... .......... .......... .......... .......... 98% 262M 0s 2019-12-09T11:30:25.631 INFO:teuthology.orchestra.run.smithi146.stderr: 72300K .......... .......... .......... .......... .......... 98% 264M 0s 2019-12-09T11:30:25.631 INFO:teuthology.orchestra.run.smithi146.stderr: 72350K .......... .......... .......... .......... .......... 98% 243M 0s 2019-12-09T11:30:25.631 INFO:teuthology.orchestra.run.smithi146.stderr: 72400K .......... .......... .......... .......... .......... 98% 280M 0s 2019-12-09T11:30:25.631 INFO:teuthology.orchestra.run.smithi146.stderr: 72450K .......... .......... .......... .......... .......... 98% 274M 0s 2019-12-09T11:30:25.631 INFO:teuthology.orchestra.run.smithi146.stderr: 72500K .......... .......... .......... .......... .......... 98% 283M 0s 2019-12-09T11:30:25.631 INFO:teuthology.orchestra.run.smithi146.stderr: 72550K .......... .......... .......... .......... .......... 98% 232M 0s 2019-12-09T11:30:25.631 INFO:teuthology.orchestra.run.smithi146.stderr: 72600K .......... .......... .......... .......... .......... 98% 271M 0s 2019-12-09T11:30:25.632 INFO:teuthology.orchestra.run.smithi146.stderr: 72650K .......... .......... .......... .......... .......... 98% 272M 0s 2019-12-09T11:30:25.632 INFO:teuthology.orchestra.run.smithi146.stderr: 72700K .......... .......... .......... .......... .......... 98% 281M 0s 2019-12-09T11:30:25.632 INFO:teuthology.orchestra.run.smithi146.stderr: 72750K .......... .......... .......... .......... .......... 98% 250M 0s 2019-12-09T11:30:25.632 INFO:teuthology.orchestra.run.smithi146.stderr: 72800K .......... .......... .......... .......... .......... 99% 273M 0s 2019-12-09T11:30:25.632 INFO:teuthology.orchestra.run.smithi146.stderr: 72850K .......... .......... .......... .......... .......... 99% 275M 0s 2019-12-09T11:30:25.632 INFO:teuthology.orchestra.run.smithi146.stderr: 72900K .......... .......... .......... .......... .......... 99% 278M 0s 2019-12-09T11:30:25.632 INFO:teuthology.orchestra.run.smithi146.stderr: 72950K .......... .......... .......... .......... .......... 99% 219M 0s 2019-12-09T11:30:25.632 INFO:teuthology.orchestra.run.smithi146.stderr: 73000K .......... .......... .......... .......... .......... 99% 278M 0s 2019-12-09T11:30:25.633 INFO:teuthology.orchestra.run.smithi146.stderr: 73050K .......... .......... .......... .......... .......... 99% 271M 0s 2019-12-09T11:30:25.633 INFO:teuthology.orchestra.run.smithi146.stderr: 73100K .......... .......... .......... .......... .......... 99% 272M 0s 2019-12-09T11:30:25.633 INFO:teuthology.orchestra.run.smithi146.stderr: 73150K .......... .......... .......... .......... .......... 99% 246M 0s 2019-12-09T11:30:25.633 INFO:teuthology.orchestra.run.smithi146.stderr: 73200K .......... .......... .......... .......... .......... 99% 262M 0s 2019-12-09T11:30:25.633 INFO:teuthology.orchestra.run.smithi146.stderr: 73250K .......... .......... .......... .......... .......... 99% 278M 0s 2019-12-09T11:30:25.633 INFO:teuthology.orchestra.run.smithi146.stderr: 73300K .......... .......... .......... .......... .......... 99% 283M 0s 2019-12-09T11:30:25.633 INFO:teuthology.orchestra.run.smithi146.stderr: 73350K .......... .......... .......... .......... .......... 99% 231M 0s 2019-12-09T11:30:25.634 INFO:teuthology.orchestra.run.smithi146.stderr: 73400K .......... .......... .......... .......... .......... 99% 270M 0s 2019-12-09T11:30:25.634 INFO:teuthology.orchestra.run.smithi146.stderr: 73450K .......... .......... .......... .......... .......... 99% 283M 0s 2019-12-09T11:30:25.634 INFO:teuthology.orchestra.run.smithi146.stderr: 73500K .......... .......... .......... .......... .......... 99% 266M 0s 2019-12-09T11:30:25.634 INFO:teuthology.orchestra.run.smithi146.stderr: 73550K ........ 100% 154M=0.3s 2019-12-09T11:30:25.634 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T11:30:25.634 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09 11:30:24 (223 MB/s) - ‘gradle-4.7-bin.zip’ saved [75323957/75323957] 2019-12-09T11:30:25.634 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T11:30:25.635 INFO:teuthology.orchestra.run.smithi146.stdout:Archive: gradle-4.7-bin.zip 2019-12-09T11:30:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: creating: /opt/gradle/gradle-4.7/ 2019-12-09T11:30:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/getting-started.html 2019-12-09T11:30:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/LICENSE 2019-12-09T11:30:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: creating: /opt/gradle/gradle-4.7/media/ 2019-12-09T11:30:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-64x64.png 2019-12-09T11:30:25.636 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-48x48.png 2019-12-09T11:30:25.636 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle.icns 2019-12-09T11:30:25.636 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-24x24.png 2019-12-09T11:30:25.636 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-256x256.png 2019-12-09T11:30:25.636 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-512x512.png 2019-12-09T11:30:25.636 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-16x16.png 2019-12-09T11:30:25.637 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-32x32.png 2019-12-09T11:30:25.637 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-128x128.png 2019-12-09T11:30:25.637 INFO:teuthology.orchestra.run.smithi146.stdout: creating: /opt/gradle/gradle-4.7/init.d/ 2019-12-09T11:30:25.637 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/init.d/readme.txt 2019-12-09T11:30:25.637 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/NOTICE 2019-12-09T11:30:25.637 INFO:teuthology.orchestra.run.smithi146.stdout: creating: /opt/gradle/gradle-4.7/bin/ 2019-12-09T11:30:25.637 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle.bat 2019-12-09T11:30:25.638 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle 2019-12-09T11:30:25.638 INFO:teuthology.orchestra.run.smithi146.stdout: creating: /opt/gradle/gradle-4.7/lib/ 2019-12-09T11:30:25.638 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/annotations-13.0.jar 2019-12-09T11:30:25.638 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-0.16.3.jar 2019-12-09T11:30:25.638 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-builders-0.16.3.jar 2019-12-09T11:30:25.638 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-models-0.16.3.jar 2019-12-09T11:30:25.638 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-compiler-embeddable-1.2.31.jar 2019-12-09T11:30:25.639 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-reflect-1.2.31.jar 2019-12-09T11:30:25.639 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-sam-with-receiver-compiler-plugin-1.2.31.jar 2019-12-09T11:30:25.639 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-script-runtime-1.2.31.jar 2019-12-09T11:30:25.639 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-1.2.31.jar 2019-12-09T11:30:25.639 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk7-1.2.31.jar 2019-12-09T11:30:25.639 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk8-1.2.31.jar 2019-12-09T11:30:25.639 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-launcher-4.7.jar 2019-12-09T11:30:25.640 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-runtime-api-info-4.7.jar 2019-12-09T11:30:25.640 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-tooling-api-4.7.jar 2019-12-09T11:30:25.640 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-wrapper-4.7.jar 2019-12-09T11:30:25.640 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-installation-beacon-4.7.jar 2019-12-09T11:30:25.640 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-4.7.jar 2019-12-09T11:30:25.640 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-jvm-services-4.7.jar 2019-12-09T11:30:25.640 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-api-4.7.jar 2019-12-09T11:30:25.641 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-cache-4.7.jar 2019-12-09T11:30:25.641 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-logging-4.7.jar 2019-12-09T11:30:25.641 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-process-services-4.7.jar 2019-12-09T11:30:25.641 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-resources-4.7.jar 2019-12-09T11:30:25.641 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-persistent-cache-4.7.jar 2019-12-09T11:30:25.641 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-native-4.7.jar 2019-12-09T11:30:25.641 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-groovy-4.7.jar 2019-12-09T11:30:25.642 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-core-4.7.jar 2019-12-09T11:30:25.642 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-groovy-4.7.jar 2019-12-09T11:30:25.642 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-messaging-4.7.jar 2019-12-09T11:30:25.642 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-4.7.jar 2019-12-09T11:30:25.642 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-option-4.7.jar 2019-12-09T11:30:25.642 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-cli-4.7.jar 2019-12-09T11:30:25.642 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-docs-4.7.jar 2019-12-09T11:30:25.642 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-commons-6.1.1.jar 2019-12-09T11:30:25.643 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-analysis-6.1.1.jar 2019-12-09T11:30:25.643 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-tree-6.1.1.jar 2019-12-09T11:30:25.643 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/kryo-2.20.jar 2019-12-09T11:30:25.643 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/reflectasm-1.07-shaded.jar 2019-12-09T11:30:25.643 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-6.1.1.jar 2019-12-09T11:30:25.643 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-io-2.4.jar 2019-12-09T11:30:25.643 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcl-over-slf4j-1.7.16.jar 2019-12-09T11:30:25.644 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/jul-to-slf4j-1.7.16.jar 2019-12-09T11:30:25.644 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/log4j-over-slf4j-1.7.16.jar 2019-12-09T11:30:25.644 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/slf4j-api-1.7.16.jar 2019-12-09T11:30:25.644 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/guava-jdk5-17.0.jar 2019-12-09T11:30:25.644 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/jsr305-2.0.1.jar 2019-12-09T11:30:25.644 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/fastutil-7.2.1-min.jar 2019-12-09T11:30:25.644 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-lang-2.6.jar 2019-12-09T11:30:25.645 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcip-annotations-1.0.jar 2019-12-09T11:30:25.645 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/groovy-all-2.4.12.jar 2019-12-09T11:30:25.645 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-1.9.9.jar 2019-12-09T11:30:25.645 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/javax.inject-1.jar 2019-12-09T11:30:25.645 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-collections-3.2.2.jar 2019-12-09T11:30:25.645 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-0.14.jar 2019-12-09T11:30:25.645 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-compress-1.14.jar 2019-12-09T11:30:25.646 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/xml-apis-1.4.01.jar 2019-12-09T11:30:25.646 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/jansi-1.14.jar 2019-12-09T11:30:25.646 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-launcher-1.9.9.jar 2019-12-09T11:30:25.646 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libcpp-0.14.jar 2019-12-09T11:30:25.646 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libstdcpp-0.14.jar 2019-12-09T11:30:25.646 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libcpp-0.14.jar 2019-12-09T11:30:25.646 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libstdcpp-0.14.jar 2019-12-09T11:30:25.647 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-0.14.jar 2019-12-09T11:30:25.647 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-0.14.jar 2019-12-09T11:30:25.647 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-amd64-0.14.jar 2019-12-09T11:30:25.647 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-i386-0.14.jar 2019-12-09T11:30:25.647 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-amd64-0.14.jar 2019-12-09T11:30:25.647 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-i386-0.14.jar 2019-12-09T11:30:25.647 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses5-0.14.jar 2019-12-09T11:30:25.648 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses6-0.14.jar 2019-12-09T11:30:25.648 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses5-0.14.jar 2019-12-09T11:30:25.648 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses6-0.14.jar 2019-12-09T11:30:25.648 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/minlog-1.2.jar 2019-12-09T11:30:25.648 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/objenesis-1.2.jar 2019-12-09T11:30:25.648 INFO:teuthology.orchestra.run.smithi146.stdout: creating: /opt/gradle/gradle-4.7/lib/plugins/ 2019-12-09T11:30:25.648 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-announce-4.7.jar 2019-12-09T11:30:25.648 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-antlr-4.7.jar 2019-12-09T11:30:25.649 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-code-quality-4.7.jar 2019-12-09T11:30:25.649 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-osgi-4.7.jar 2019-12-09T11:30:25.649 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-signing-4.7.jar 2019-12-09T11:30:25.649 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-native-4.7.jar 2019-12-09T11:30:25.649 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-native-4.7.jar 2019-12-09T11:30:25.649 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-native-4.7.jar 2019-12-09T11:30:25.649 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-development-4.7.jar 2019-12-09T11:30:25.650 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-maven-4.7.jar 2019-12-09T11:30:25.650 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-play-4.7.jar 2019-12-09T11:30:25.650 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-4.7.jar 2019-12-09T11:30:25.650 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-scala-4.7.jar 2019-12-09T11:30:25.650 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-comparison-4.7.jar 2019-12-09T11:30:25.650 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ear-4.7.jar 2019-12-09T11:30:25.650 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-play-4.7.jar 2019-12-09T11:30:25.651 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-javascript-4.7.jar 2019-12-09T11:30:25.651 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ivy-4.7.jar 2019-12-09T11:30:25.651 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-jacoco-4.7.jar 2019-12-09T11:30:25.651 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-init-4.7.jar 2019-12-09T11:30:25.651 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugins-4.7.jar 2019-12-09T11:30:25.651 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-tooling-api-builders-4.7.jar 2019-12-09T11:30:25.651 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-test-kit-4.7.jar 2019-12-09T11:30:25.652 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-composite-builds-4.7.jar 2019-12-09T11:30:25.652 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-groovy-4.7.jar 2019-12-09T11:30:25.652 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-scala-4.7.jar 2019-12-09T11:30:25.652 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-junit-platform-4.7.jar 2019-12-09T11:30:25.652 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-jvm-4.7.jar 2019-12-09T11:30:25.652 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-java-4.7.jar 2019-12-09T11:30:25.652 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-jvm-4.7.jar 2019-12-09T11:30:25.653 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-jvm-4.7.jar 2019-12-09T11:30:25.653 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-native-4.7.jar 2019-12-09T11:30:25.653 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-diagnostics-4.7.jar 2019-12-09T11:30:25.653 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-base-4.7.jar 2019-12-09T11:30:25.653 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-reporting-4.7.jar 2019-12-09T11:30:25.653 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-publish-4.7.jar 2019-12-09T11:30:25.653 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-base-4.7.jar 2019-12-09T11:30:25.654 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-use-4.7.jar 2019-12-09T11:30:25.654 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-s3-4.7.jar 2019-12-09T11:30:25.654 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-gcs-4.7.jar 2019-12-09T11:30:25.654 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-cache-http-4.7.jar 2019-12-09T11:30:25.654 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-dependency-management-4.7.jar 2019-12-09T11:30:25.654 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-http-4.7.jar 2019-12-09T11:30:25.654 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-sftp-4.7.jar 2019-12-09T11:30:25.655 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-workers-4.7.jar 2019-12-09T11:30:25.655 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-version-control-4.7.jar 2019-12-09T11:30:25.655 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-s3-1.11.267.jar 2019-12-09T11:30:25.655 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-kms-1.11.267.jar 2019-12-09T11:30:25.655 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-core-1.11.267.jar 2019-12-09T11:30:25.655 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/org.eclipse.jgit-4.5.3.201708160445-r.jar 2019-12-09T11:30:25.655 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-2.4.jar 2019-12-09T11:30:25.656 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-shared4-2.4.jar 2019-12-09T11:30:25.656 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-services-storage-v1-rev116-1.23.0.jar 2019-12-09T11:30:25.656 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-client-1.23.0.jar 2019-12-09T11:30:25.656 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-oauth-client-1.23.0.jar 2019-12-09T11:30:25.656 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-jackson2-1.23.0.jar 2019-12-09T11:30:25.656 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-1.23.0.jar 2019-12-09T11:30:25.656 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpclient-4.5.5.jar 2019-12-09T11:30:25.657 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-codec-1.10.jar 2019-12-09T11:30:25.657 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-container-default-1.5.5.jar 2019-12-09T11:30:25.657 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xbean-reflect-3.4.jar 2019-12-09T11:30:25.657 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/asm-util-6.1.1.jar 2019-12-09T11:30:25.657 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jatl-0.2.2.jar 2019-12-09T11:30:25.657 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-cli-1.2.jar 2019-12-09T11:30:25.657 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/biz.aQute.bndlib-3.4.0.jar 2019-12-09T11:30:25.658 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ivy-2.2.0.jar 2019-12-09T11:30:25.658 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-compat-3.0.4.jar 2019-12-09T11:30:25.658 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-core-3.0.4.jar 2019-12-09T11:30:25.658 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-common-0.8-20100325.jar 2019-12-09T11:30:25.658 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-groovy-0.8-20100325.jar 2019-12-09T11:30:25.658 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-file-2.4.jar 2019-12-09T11:30:25.658 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-connector-wagon-1.13.1.jar 2019-12-09T11:30:25.659 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcpg-jdk15on-1.58.jar 2019-12-09T11:30:25.659 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/rhino-1.7R3.jar 2019-12-09T11:30:25.659 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gson-2.7.jar 2019-12-09T11:30:25.659 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/simple-4.1.21.jar 2019-12-09T11:30:25.659 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-plugin-api-3.0.4.jar 2019-12-09T11:30:25.659 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/testng-6.3.1.jar 2019-12-09T11:30:25.659 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/snakeyaml-1.6.jar 2019-12-09T11:30:25.659 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/dd-plist-1.20.jar 2019-12-09T11:30:25.660 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-4.12.jar 2019-12-09T11:30:25.660 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bsh-2.0b6.jar 2019-12-09T11:30:25.660 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-launcher-1.0.3.jar 2019-12-09T11:30:25.660 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcifs-1.3.17.jar 2019-12-09T11:30:25.660 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/nekohtml-1.9.20.jar 2019-12-09T11:30:25.660 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xercesImpl-2.11.0.jar 2019-12-09T11:30:25.661 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jsch-0.1.54.jar 2019-12-09T11:30:25.661 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jmespath-java-1.11.267.jar 2019-12-09T11:30:25.661 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-databind-2.8.11.jar 2019-12-09T11:30:25.661 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-core-2.8.11.jar 2019-12-09T11:30:25.661 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-annotations-2.8.11.jar 2019-12-09T11:30:25.661 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/joda-time-2.8.2.jar 2019-12-09T11:30:25.661 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcprov-jdk15on-1.58.jar 2019-12-09T11:30:25.661 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-aether-provider-3.0.4.jar 2019-12-09T11:30:25.662 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-impl-1.13.1.jar 2019-12-09T11:30:25.662 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-spi-1.13.1.jar 2019-12-09T11:30:25.662 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-util-1.13.1.jar 2019-12-09T11:30:25.662 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-api-1.13.1.jar 2019-12-09T11:30:25.662 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-provider-api-2.4.jar 2019-12-09T11:30:25.662 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-classworlds-2.4.jar 2019-12-09T11:30:25.663 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-builder-3.0.4.jar 2019-12-09T11:30:25.663 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-3.0.4.jar 2019-12-09T11:30:25.663 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-builder-3.0.4.jar 2019-12-09T11:30:25.663 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-artifact-3.0.4.jar 2019-12-09T11:30:25.663 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-3.0.4.jar 2019-12-09T11:30:25.663 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-sec-dispatcher-1.3.jar 2019-12-09T11:30:25.664 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-repository-metadata-3.0.4.jar 2019-12-09T11:30:25.664 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-utils-3.0.8.jar 2019-12-09T11:30:25.664 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ion-java-1.0.2.jar 2019-12-09T11:30:25.664 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpcore-4.4.9.jar 2019-12-09T11:30:25.664 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/hamcrest-core-1.3.jar 2019-12-09T11:30:25.664 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-engine-1.0.3.jar 2019-12-09T11:30:25.664 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-commons-1.0.3.jar 2019-12-09T11:30:25.665 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/apiguardian-api-1.0.0.jar 2019-12-09T11:30:25.665 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcommander-1.47.jar 2019-12-09T11:30:25.665 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-interpolation-1.14.jar 2019-12-09T11:30:25.665 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-component-annotations-1.5.5.jar 2019-12-09T11:30:25.665 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/opentest4j-1.0.0.jar 2019-12-09T11:30:25.665 INFO:teuthology.orchestra.run.smithi146.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-cipher-1.7.jar 2019-12-09T11:30:25.666 INFO:teuthology.orchestra.run.smithi146.stdout:export PATH=/opt/gradle/gradle-4.7/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin 2019-12-09T11:30:26.099 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:30:26.099 INFO:teuthology.orchestra.run.smithi146.stdout:Welcome to Gradle 4.7! 2019-12-09T11:30:26.099 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:30:26.100 INFO:teuthology.orchestra.run.smithi146.stdout:Here are the highlights of this release: 2019-12-09T11:30:26.100 INFO:teuthology.orchestra.run.smithi146.stdout: - Incremental annotation processing 2019-12-09T11:30:26.100 INFO:teuthology.orchestra.run.smithi146.stdout: - JDK 10 support 2019-12-09T11:30:26.100 INFO:teuthology.orchestra.run.smithi146.stdout: - Grouped non-interactive console logs 2019-12-09T11:30:26.100 INFO:teuthology.orchestra.run.smithi146.stdout: - Failed tests are re-run first for quicker feedback 2019-12-09T11:30:26.100 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:30:26.101 INFO:teuthology.orchestra.run.smithi146.stdout:For more details see https://docs.gradle.org/4.7/release-notes.html 2019-12-09T11:30:26.101 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:30:26.416 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:30:26.416 INFO:teuthology.orchestra.run.smithi146.stdout:------------------------------------------------------------ 2019-12-09T11:30:26.416 INFO:teuthology.orchestra.run.smithi146.stdout:Gradle 4.7 2019-12-09T11:30:26.416 INFO:teuthology.orchestra.run.smithi146.stdout:------------------------------------------------------------ 2019-12-09T11:30:26.416 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:30:26.417 INFO:teuthology.orchestra.run.smithi146.stdout:Build time: 2018-04-18 09:09:12 UTC 2019-12-09T11:30:26.423 INFO:teuthology.orchestra.run.smithi146.stdout:Revision: b9a962bf70638332300e7f810689cb2febbd4a6c 2019-12-09T11:30:26.423 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:30:26.423 INFO:teuthology.orchestra.run.smithi146.stdout:Groovy: 2.4.12 2019-12-09T11:30:26.424 INFO:teuthology.orchestra.run.smithi146.stdout:Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017 2019-12-09T11:30:26.424 INFO:teuthology.orchestra.run.smithi146.stdout:JVM: 1.8.0_232 (Oracle Corporation 25.232-b09) 2019-12-09T11:30:26.425 INFO:teuthology.orchestra.run.smithi146.stdout:OS: Linux 3.10.0-1062.9.1.el7.x86_64 amd64 2019-12-09T11:30:26.425 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:30:26.426 INFO:teuthology.orchestra.run.smithi146:> sudo keytool -import -alias smithi146.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2019-12-09T11:30:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:Certificate was added to keystore 2019-12-09T11:30:26.933 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2019-12-09T11:30:26.933 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-09T11:30:26.933 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi146.front.sepia.ceph.com 2019-12-09T11:30:26.933 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-12-09T11:30:26.933 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi194.front.sepia.ceph.com 2019-12-09T11:30:26.933 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2019-12-09T11:30:27.375 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2019-12-09T11:30:27.376 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2019-12-09T11:30:27.376 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'NCLVIVUKWGVCAPOCJMVK', 's3dir': 'folder', 'endpoint': 'smithi146.front.sepia.ceph.com:443', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 443, 'access_secret': 'Bwpdk1gYt4lgtvlRsvgwE62/RYDyF9URLvhGKWpeoRFtTyjMisru9g==', 'host': 'smithi146.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': True, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2019-12-09T11:30:27.376 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2019-12-09T11:30:27.376 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'NCLVIVUKWGVCAPOCJMVK', '--secret', 'Bwpdk1gYt4lgtvlRsvgwE62/RYDyF9URLvhGKWpeoRFtTyjMisru9g==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2019-12-09T11:30:27.377 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key NCLVIVUKWGVCAPOCJMVK --secret Bwpdk1gYt4lgtvlRsvgwE62/RYDyF9URLvhGKWpeoRFtTyjMisru9g== --email tester.client.0_test@test.test --cluster ceph 2019-12-09T11:30:27.537 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.547+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.562 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.572+0000 7f97ee998ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:27.562 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.572+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.572 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.583+0000 7f97ee998ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.583+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.578 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.589+0000 7f97ee998ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:27.578 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.589+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.592 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.600+0000 7f97ee998ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:27.783 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.794+0000 7f97ee998ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T11:30:27.784 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.794+0000 7f97ee998ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T11:30:27.784 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.794+0000 7f97ee998ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T11:30:27.784 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.794+0000 7f97ee998ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T11:30:27.784 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.794+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.801+0000 7f97ee998ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.801+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.799 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.809+0000 7f97ee998ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:30:27.799 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.809+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.819+0000 7f97ee998ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.819+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.824 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.834+0000 7f97ee998ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:30:27.824 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.834+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.838+0000 7f97ee998ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.838+0000 7f97ee998ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T11:30:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.838+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.834 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.844+0000 7f97ee998ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:27.834 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.844+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.841 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.852+0000 7f97ee998ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:27.842 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.852+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.868+0000 7f97ee998ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:30:27.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.868+0000 7f97ee998ec0 20 zonegroup default 2019-12-09T11:30:27.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.868+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.873+0000 7f97ee998ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.873+0000 7f97ee998ec0 10 Cannot find current period zone using local zone 2019-12-09T11:30:27.863 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.873+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.867 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.877+0000 7f97ee998ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:27.867 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.877+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.887+0000 7f97ee998ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.887+0000 7f97ee998ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:27.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.904+0000 7f97ee998ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:30:27.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.904+0000 7f97ee998ec0 20 zone default found 2019-12-09T11:30:27.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.904+0000 7f97ee998ec0 20 started sync module instance, tier type = 2019-12-09T11:30:27.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:27.904+0000 7f97ee998ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T11:30:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:28.319+0000 7f97ee998ec0 20 add_watcher() i=0 2019-12-09T11:30:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:28.319+0000 7f97ee998ec0 20 add_watcher() i=1 2019-12-09T11:30:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:28.319+0000 7f97ee998ec0 20 add_watcher() i=2 2019-12-09T11:30:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:28.319+0000 7f97ee998ec0 20 add_watcher() i=3 2019-12-09T11:30:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:28.319+0000 7f97ee998ec0 20 add_watcher() i=4 2019-12-09T11:30:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:28.319+0000 7f97ee998ec0 20 add_watcher() i=5 2019-12-09T11:30:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:28.319+0000 7f97ee998ec0 20 add_watcher() i=6 2019-12-09T11:30:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:28.350+0000 7f97ee998ec0 20 add_watcher() i=7 2019-12-09T11:30:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:28.350+0000 7f97ee998ec0 2 all 8 watchers are set, enabling cache 2019-12-09T11:30:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:28.350+0000 7f972ffff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T11:30:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:28.351+0000 7f97db3c1700 0 -- >> v1:172.21.15.194:6789/0 conn(0x55862ced7090 legacy=0x55862ced95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T11:30:28.421 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:28.431+0000 7f97dbbc2700 0 -- 172.21.15.146:0/1506884713 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x55862cee82b0 msgr2=0x55862ceea6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T11:30:30.315 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.325+0000 7f971a7fc700 20 reqs_thread_entry: start 2019-12-09T11:30:30.315 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.325+0000 7f9713fff700 20 reqs_thread_entry: start 2019-12-09T11:30:30.315 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.325+0000 7f97ee998ec0 20 init_complete bucket index max shards: 0 2019-12-09T11:30:30.316 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.325+0000 7f97127fc700 20 reqs_thread_entry: start 2019-12-09T11:30:30.316 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.325+0000 7f97ee998ec0 20 get_system_obj_state: rctx=0x7fffe99004f8 obj=default.rgw.meta:users.uid:tester.client.0 state=0x55862cf54d60 s->prefetch_data=0 2019-12-09T11:30:30.316 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.325+0000 7f97ee998ec0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2019-12-09T11:30:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.333+0000 7f97ee998ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2019-12-09T11:30:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.333+0000 7f97ee998ec0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-12-09T11:30:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.333+0000 7f97ee998ec0 20 get_system_obj_state: rctx=0x7fffe9900508 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x55862cf56af0 s->prefetch_data=0 2019-12-09T11:30:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.333+0000 7f97ee998ec0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2019-12-09T11:30:30.331 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.341+0000 7f97ee998ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2019-12-09T11:30:30.331 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.341+0000 7f97ee998ec0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-12-09T11:30:30.332 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.342+0000 7f97ee998ec0 20 get_system_obj_state: rctx=0x7fffe9900508 obj=default.rgw.meta:users.keys:NCLVIVUKWGVCAPOCJMVK state=0x55862cf56af0 s->prefetch_data=0 2019-12-09T11:30:30.332 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.342+0000 7f97ee998ec0 10 cache get: name=default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK : miss 2019-12-09T11:30:30.348 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.353+0000 7f97ee998ec0 10 cache put: name=default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK info.flags=0x0 2019-12-09T11:30:30.348 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.354+0000 7f97ee998ec0 10 adding default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK to cache LRU end 2019-12-09T11:30:30.349 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.354+0000 7f97ee998ec0 20 get_system_obj_state: rctx=0x7fffe9900118 obj=default.rgw.meta:users.keys:NCLVIVUKWGVCAPOCJMVK state=0x55862cf56af0 s->prefetch_data=0 2019-12-09T11:30:30.349 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.354+0000 7f97ee998ec0 10 cache get: name=default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK : type miss (requested=0x6, cached=0x0) 2019-12-09T11:30:30.355 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.365+0000 7f97ee998ec0 10 cache put: name=default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK info.flags=0x0 2019-12-09T11:30:30.355 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.365+0000 7f97ee998ec0 10 moving default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK to cache LRU end 2019-12-09T11:30:30.355 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.365+0000 7f97ee998ec0 20 get_system_obj_state: rctx=0x7fffe9900298 obj=default.rgw.meta:users.keys:NCLVIVUKWGVCAPOCJMVK state=0x55862cf56af0 s->prefetch_data=0 2019-12-09T11:30:30.355 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.365+0000 7f97ee998ec0 10 cache get: name=default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK : type miss (requested=0x6, cached=0x0) 2019-12-09T11:30:30.365 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.375+0000 7f97ee998ec0 10 cache put: name=default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK info.flags=0x0 2019-12-09T11:30:30.365 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.375+0000 7f97ee998ec0 10 moving default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK to cache LRU end 2019-12-09T11:30:30.444 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.451+0000 7f97ee998ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-12-09T11:30:30.444 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.451+0000 7f97ee998ec0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-12-09T11:30:30.445 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.452+0000 7f97ee998ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2019-12-09T11:30:30.459 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.469+0000 7f97d17fa700 10 RGWWatcher::handle_notify() notify_id 592705486851 cookie 94034767641296 notifier 4692 bl.length()=632 2019-12-09T11:30:30.459 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.469+0000 7f97d17fa700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-12-09T11:30:30.459 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:30.469+0000 7f97d17fa700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-12-09T11:30:31.049 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.059+0000 7f97ee998ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-12-09T11:30:31.049 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.059+0000 7f97ee998ec0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-12-09T11:30:31.049 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.059+0000 7f97ee998ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2019-12-09T11:30:31.070 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.080+0000 7f97d17fa700 10 RGWWatcher::handle_notify() notify_id 592705486853 cookie 94034767622848 notifier 4692 bl.length()=200 2019-12-09T11:30:31.085 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.080+0000 7f97d17fa700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-12-09T11:30:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.080+0000 7f97d17fa700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-12-09T11:30:31.640 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.651+0000 7f97ee998ec0 10 cache put: name=default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK info.flags=0x7 2019-12-09T11:30:31.641 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.651+0000 7f97ee998ec0 10 moving default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK to cache LRU end 2019-12-09T11:30:31.641 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.651+0000 7f97ee998ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2019-12-09T11:30:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.671+0000 7f97d17fa700 10 RGWWatcher::handle_notify() notify_id 592705486865 cookie 94034767615040 notifier 4692 bl.length()=189 2019-12-09T11:30:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.671+0000 7f97d17fa700 10 cache put: name=default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK info.flags=0x7 2019-12-09T11:30:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.671+0000 7f97d17fa700 10 moving default.rgw.meta+users.keys+NCLVIVUKWGVCAPOCJMVK to cache LRU end 2019-12-09T11:30:31.783 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2019-12-09T11:30:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: "user_id": "tester.client.0", 2019-12-09T11:30:31.783 INFO:teuthology.orchestra.run.smithi146.stdout: "display_name": "Ms. tester.client.0", 2019-12-09T11:30:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "email": "tester.client.0_test@test.test", 2019-12-09T11:30:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "suspended": 0, 2019-12-09T11:30:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "max_buckets": 1000, 2019-12-09T11:30:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "subusers": [], 2019-12-09T11:30:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: "keys": [ 2019-12-09T11:30:31.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2019-12-09T11:30:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: "user": "tester.client.0", 2019-12-09T11:30:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: "access_key": "NCLVIVUKWGVCAPOCJMVK", 2019-12-09T11:30:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: "secret_key": "Bwpdk1gYt4lgtvlRsvgwE62/RYDyF9URLvhGKWpeoRFtTyjMisru9g==" 2019-12-09T11:30:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: } 2019-12-09T11:30:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2019-12-09T11:30:31.785 INFO:teuthology.orchestra.run.smithi146.stdout: "swift_keys": [], 2019-12-09T11:30:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": [], 2019-12-09T11:30:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "op_mask": "read, write, delete", 2019-12-09T11:30:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "default_placement": "", 2019-12-09T11:30:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "default_storage_class": "", 2019-12-09T11:30:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "placement_tags": [], 2019-12-09T11:30:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "bucket_quota": { 2019-12-09T11:30:31.786 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T11:30:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T11:30:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T11:30:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T11:30:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T11:30:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T11:30:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "user_quota": { 2019-12-09T11:30:31.787 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T11:30:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T11:30:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T11:30:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T11:30:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T11:30:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T11:30:31.788 INFO:teuthology.orchestra.run.smithi146.stdout: "temp_url_keys": [], 2019-12-09T11:30:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "rgw", 2019-12-09T11:30:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: "mfa_ids": [] 2019-12-09T11:30:31.789 INFO:teuthology.orchestra.run.smithi146.stdout:} 2019-12-09T11:30:31.789 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:30:31.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.833+0000 7f97ee998ec0 20 remove_watcher() i=0 2019-12-09T11:30:31.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.833+0000 7f97ee998ec0 2 removed watcher, disabling cache 2019-12-09T11:30:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.864+0000 7f97ee998ec0 20 remove_watcher() i=1 2019-12-09T11:30:31.883 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.893+0000 7f97ee998ec0 20 remove_watcher() i=2 2019-12-09T11:30:31.956 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:31.967+0000 7f97ee998ec0 20 remove_watcher() i=3 2019-12-09T11:30:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.043+0000 7f97ee998ec0 20 remove_watcher() i=4 2019-12-09T11:30:32.090 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.101+0000 7f97ee998ec0 20 remove_watcher() i=5 2019-12-09T11:30:32.145 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.156+0000 7f97ee998ec0 20 remove_watcher() i=6 2019-12-09T11:30:32.199 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.210+0000 7f97ee998ec0 20 remove_watcher() i=7 2019-12-09T11:30:32.211 INFO:teuthology.orchestra.run.smithi146:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2019-12-09T11:30:32.276 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2019-12-09T11:30:32.278 INFO:teuthology.orchestra.run.smithi146:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2019-12-09T11:30:32.356 INFO:teuthology.orchestra.run.smithi146:> radosgw-admin gc process --include-all 2019-12-09T11:30:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.477+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.490 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.501+0000 7f8a74da5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:32.490 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.501+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.508+0000 7f8a74da5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:32.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.508+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.501 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.512+0000 7f8a74da5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:32.501 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.512+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.509 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.520+0000 7f8a74da5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:32.703 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.713+0000 7f8a74da5ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T11:30:32.703 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.713+0000 7f8a74da5ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T11:30:32.703 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.713+0000 7f8a74da5ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T11:30:32.703 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.713+0000 7f8a74da5ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T11:30:32.703 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.713+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.714 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.725+0000 7f8a74da5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:32.714 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.725+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.725 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.736+0000 7f8a74da5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:30:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.736+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.736 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.747+0000 7f8a74da5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:32.736 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.747+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.768+0000 7f8a74da5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:30:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.768+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.779+0000 7f8a74da5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.779+0000 7f8a74da5ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T11:30:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.779+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.783 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.789+0000 7f8a74da5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:32.783 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.789+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.792 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.803+0000 7f8a74da5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:32.792 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.803+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.823+0000 7f8a74da5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:30:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.823+0000 7f8a74da5ec0 20 zonegroup default 2019-12-09T11:30:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.823+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.834+0000 7f8a74da5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:32.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.834+0000 7f8a74da5ec0 10 Cannot find current period zone using local zone 2019-12-09T11:30:32.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.834+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.833 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.844+0000 7f8a74da5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:32.833 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.844+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.859+0000 7f8a74da5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.859+0000 7f8a74da5ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:32.886 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.897+0000 7f8a74da5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:30:32.886 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.897+0000 7f8a74da5ec0 20 zone default found 2019-12-09T11:30:32.886 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.897+0000 7f8a74da5ec0 20 started sync module instance, tier type = 2019-12-09T11:30:32.886 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:32.897+0000 7f8a74da5ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T11:30:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:33.411+0000 7f8a74da5ec0 20 add_watcher() i=0 2019-12-09T11:30:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:33.411+0000 7f8a74da5ec0 20 add_watcher() i=1 2019-12-09T11:30:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:33.411+0000 7f8a74da5ec0 20 add_watcher() i=2 2019-12-09T11:30:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:33.411+0000 7f8a74da5ec0 20 add_watcher() i=3 2019-12-09T11:30:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:33.411+0000 7f8a74da5ec0 20 add_watcher() i=4 2019-12-09T11:30:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:33.411+0000 7f8a74da5ec0 20 add_watcher() i=5 2019-12-09T11:30:33.409 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:33.420+0000 7f8a74da5ec0 20 add_watcher() i=6 2019-12-09T11:30:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:33.453+0000 7f8a74da5ec0 20 add_watcher() i=7 2019-12-09T11:30:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:33.453+0000 7f8a74da5ec0 2 all 8 watchers are set, enabling cache 2019-12-09T11:30:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:33.453+0000 7f8a327dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T11:30:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:33.458+0000 7f8a627d0700 0 -- 172.21.15.146:0/508757778 >> v1:172.21.15.146:6789/0 conn(0x564cb62ac580 legacy=0x564cb62bec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T11:30:33.489 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:33.500+0000 7f8a597ce700 0 -- 172.21.15.146:0/2167485026 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x564cb62f71e0 msgr2=0x564cb62f9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T11:30:35.313 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.323+0000 7f89a8ff9700 20 reqs_thread_entry: start 2019-12-09T11:30:35.313 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.324+0000 7f89a27fc700 20 reqs_thread_entry: start 2019-12-09T11:30:35.313 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.324+0000 7f8a74da5ec0 20 init_complete bucket index max shards: 0 2019-12-09T11:30:35.314 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.324+0000 7f89a0ff9700 20 reqs_thread_entry: start 2019-12-09T11:30:35.314 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.324+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T11:30:35.357 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.368+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:35.376 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.387+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.398+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:35.417 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.428+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T11:30:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.479+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:35.494 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.495+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:35.494 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.505+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:35.534 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.545+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T11:30:35.592 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.603+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:35.613 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.624+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.634+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.669+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T11:30:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.711+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:35.727 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.730+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:35.730 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.741+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:35.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.783+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T11:30:35.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.871+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:35.885 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.896+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:35.941 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2019-12-09T11:30:35.941 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='_tok3uqHBa5XGYAcxwDDKenjpHocratA', time=2019-12-09T13:30:01.502765+0000, chain.objs.size()=1 2019-12-09T11:30:35.942 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.VG8eHYI8wKLHAYoRcZhCDyNLa20jvdd_0 2019-12-09T11:30:35.942 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.233', time=2019-12-09T13:30:03.975544+0000, chain.objs.size()=5 2019-12-09T11:30:35.942 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-LUKEWARM.2~aa1S-AFgmlUMvB9F8Z8d6J4dYgf47Lg.1 2019-12-09T11:30:35.942 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_foo-LUKEWARM.2~aa1S-AFgmlUMvB9F8Z8d6J4dYgf47Lg.1_1 2019-12-09T11:30:35.942 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-LUKEWARM.2~aa1S-AFgmlUMvB9F8Z8d6J4dYgf47Lg.2 2019-12-09T11:30:35.942 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_foo-LUKEWARM.2~aa1S-AFgmlUMvB9F8Z8d6J4dYgf47Lg.2_1 2019-12-09T11:30:35.943 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-LUKEWARM.2~aa1S-AFgmlUMvB9F8Z8d6J4dYgf47Lg.3 2019-12-09T11:30:35.943 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.235', time=2019-12-09T13:30:04.346291+0000, chain.objs.size()=5 2019-12-09T11:30:35.943 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-LUKEWARM.2~aa1S-AFgmlUMvB9F8Z8d6J4dYgf47Lg.1 2019-12-09T11:30:35.943 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_foo-LUKEWARM.2~aa1S-AFgmlUMvB9F8Z8d6J4dYgf47Lg.1_1 2019-12-09T11:30:35.944 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-LUKEWARM.2~aa1S-AFgmlUMvB9F8Z8d6J4dYgf47Lg.2 2019-12-09T11:30:35.951 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_foo-LUKEWARM.2~aa1S-AFgmlUMvB9F8Z8d6J4dYgf47Lg.2_1 2019-12-09T11:30:35.951 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-LUKEWARM.2~aa1S-AFgmlUMvB9F8Z8d6J4dYgf47Lg.3 2019-12-09T11:30:35.951 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.85', time=2019-12-09T13:30:07.970820+0000, chain.objs.size()=3 2019-12-09T11:30:35.951 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:35.952+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6__shadow_.FgWSi3kIdsnpadROkDde3PpSUR300Jy_0 2019-12-09T11:30:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.174+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6__shadow_.FgWSi3kIdsnpadROkDde3PpSUR300Jy_1 2019-12-09T11:30:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.174+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6__shadow_.FgWSi3kIdsnpadROkDde3PpSUR300Jy_2 2019-12-09T11:30:36.451 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.462+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:36.634 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.645+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T11:30:36.719 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.730+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:36.754 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.765+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:36.811 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2019-12-09T11:30:36.811 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='_N6VQSnCesR1MVTr1mCe2NwX0vrp5zMD', time=2019-12-09T13:30:00.855956+0000, chain.objs.size()=1 2019-12-09T11:30:36.811 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.SsCQa4lzLGYnTLC2Zi5464vz9E7F3Ue_1 2019-12-09T11:30:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='_XcujJanuzKPs02uhpquVuG-b2CBdrBu', time=2019-12-09T13:30:01.298290+0000, chain.objs.size()=1 2019-12-09T11:30:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.azeWcAJMI23BMpJfsWx7LlSSjIp8UiR_0 2019-12-09T11:30:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.245', time=2019-12-09T13:30:05.330857+0000, chain.objs.size()=3 2019-12-09T11:30:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-STANDARD.2~dPqTZITR8ILCfhZN7l96voHn4XAkSya.1 2019-12-09T11:30:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-STANDARD.2~dPqTZITR8ILCfhZN7l96voHn4XAkSya.2 2019-12-09T11:30:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-STANDARD.2~dPqTZITR8ILCfhZN7l96voHn4XAkSya.3 2019-12-09T11:30:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.196', time=2019-12-09T13:30:06.367026+0000, chain.objs.size()=5 2019-12-09T11:30:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__multipart_foo-FROZEN.2~uG-gN8Q48oaa0d75rjgUHLItztMWf0K.1 2019-12-09T11:30:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__shadow_foo-FROZEN.2~uG-gN8Q48oaa0d75rjgUHLItztMWf0K.1_1 2019-12-09T11:30:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__multipart_foo-FROZEN.2~uG-gN8Q48oaa0d75rjgUHLItztMWf0K.2 2019-12-09T11:30:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__shadow_foo-FROZEN.2~uG-gN8Q48oaa0d75rjgUHLItztMWf0K.2_1 2019-12-09T11:30:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:36.822+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__multipart_foo-FROZEN.2~uG-gN8Q48oaa0d75rjgUHLItztMWf0K.3 2019-12-09T11:30:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.112+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.224+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T11:30:37.260 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.270+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:37.277 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.287+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:37.285 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.296+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:37.334 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.345+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T11:30:37.399 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.410+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:37.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.443+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:37.445 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.455+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.527+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T11:30:37.578 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.588+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:37.601 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.612+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:37.638 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.648+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T11:30:37.638 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.648+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.71', time=2019-12-09T13:29:57.809814+0000, chain.objs.size()=4 2019-12-09T11:30:37.638 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.648+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5__multipart_foo.2~ATpYXTVrxUz6u09sI5XLqPJ-Jeatwmn.1 2019-12-09T11:30:37.638 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.648+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5__multipart_foo.2~ATpYXTVrxUz6u09sI5XLqPJ-Jeatwmn.2 2019-12-09T11:30:37.638 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.648+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5__multipart_foo.2~ATpYXTVrxUz6u09sI5XLqPJ-Jeatwmn.3 2019-12-09T11:30:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.648+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.5__multipart_foo.2~ATpYXTVrxUz6u09sI5XLqPJ-Jeatwmn.4 2019-12-09T11:30:37.851 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.862+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:37.980+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T11:30:38.020 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.031+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:38.044 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.054+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.082+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T11:30:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.082+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='_xH932Hh5DK9axV2IjHLapa6vWYjy-zJ', time=2019-12-09T13:30:03.777915+0000, chain.objs.size()=2 2019-12-09T11:30:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.082+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_.UWd2BrULDwe1SqiRf9j-Gv8UQTBSNlJ_1 2019-12-09T11:30:38.072 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.082+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_.UWd2BrULDwe1SqiRf9j-Gv8UQTBSNlJ_2 2019-12-09T11:30:38.255 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.266+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.439+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T11:30:38.498 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.509+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:38.517 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.528+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:38.528 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.538+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.585+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T11:30:38.634 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.645+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.667+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:38.674 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.684+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:38.731 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.741+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T11:30:38.787 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.797+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:38.805 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.816+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.827+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:38.855 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.866+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T11:30:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.913+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.930+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:38.930 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.941+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T11:30:38.931 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.941+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.108', time=2019-12-09T13:29:59.309045+0000, chain.objs.size()=2 2019-12-09T11:30:38.931 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.941+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.Wg6s-vJ3RRvvGGlfQatUE31c-z3uHao_0 2019-12-09T11:30:38.931 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:38.941+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.Wg6s-vJ3RRvvGGlfQatUE31c-z3uHao_1 2019-12-09T11:30:38.991 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.001+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:39.063 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.074+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T11:30:39.129 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.139+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:39.173 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.173+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:39.210 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.220+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T11:30:39.210 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.220+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.20', time=2019-12-09T13:29:53.802284+0000, chain.objs.size()=4 2019-12-09T11:30:39.210 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.220+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2__multipart_foo.2~JciBjDipZRYa6t8qVZRYDjXGBcbzJsu.1 2019-12-09T11:30:39.210 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.220+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2__multipart_foo.2~JciBjDipZRYa6t8qVZRYDjXGBcbzJsu.2 2019-12-09T11:30:39.211 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.220+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2__multipart_foo.2~JciBjDipZRYa6t8qVZRYDjXGBcbzJsu.3 2019-12-09T11:30:39.211 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.220+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.2__multipart_foo.2~JciBjDipZRYa6t8qVZRYDjXGBcbzJsu.4 2019-12-09T11:30:39.211 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.220+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='_GieuXIrkKzlZCNpYePuTSIkUAa8d1JJ', time=2019-12-09T13:30:05.136936+0000, chain.objs.size()=1 2019-12-09T11:30:39.211 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.220+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_.2tJZsh3dH6K857ITcvnH9ZmBuxWkszo_0 2019-12-09T11:30:39.342 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.353+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:39.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.473+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T11:30:39.515 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.525+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.542+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:39.540 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.551+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:39.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.586+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T11:30:39.625 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.635+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:39.639 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.650+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:39.670 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.680+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T11:30:39.671 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.680+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.40', time=2019-12-09T13:29:54.965910+0000, chain.objs.size()=4 2019-12-09T11:30:39.671 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.680+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3__multipart_foo.2~SldALux2KsXYhKJi1n_dI00qKr7gp1L.1 2019-12-09T11:30:39.671 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.680+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3__multipart_foo.2~SldALux2KsXYhKJi1n_dI00qKr7gp1L.2 2019-12-09T11:30:39.671 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.680+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3__multipart_foo.2~SldALux2KsXYhKJi1n_dI00qKr7gp1L.3 2019-12-09T11:30:39.671 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.680+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.3__multipart_foo.2~SldALux2KsXYhKJi1n_dI00qKr7gp1L.4 2019-12-09T11:30:39.865 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:39.875+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.045+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T11:30:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.091+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:40.100 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.111+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:40.109 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.120+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:40.153 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.162+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T11:30:40.203 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.213+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:40.222 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.232+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.249+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T11:30:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.249+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='_8rF8S_R08hKL9tszdEENJGK9xj96wmU', time=2019-12-09T13:29:59.981521+0000, chain.objs.size()=1 2019-12-09T11:30:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.249+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.PL6VLR8O6Uictw_sjJ1sIqvqjTKCKSK_1 2019-12-09T11:30:40.240 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.250+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.210', time=2019-12-09T13:30:06.708025+0000, chain.objs.size()=3 2019-12-09T11:30:40.240 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.250+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__multipart_foo-STANDARD.2~3mgpVbZOZRK2A46SLEv-jVseRss6asH.1 2019-12-09T11:30:40.240 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.250+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__multipart_foo-STANDARD.2~3mgpVbZOZRK2A46SLEv-jVseRss6asH.2 2019-12-09T11:30:40.240 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.250+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__multipart_foo-STANDARD.2~3mgpVbZOZRK2A46SLEv-jVseRss6asH.3 2019-12-09T11:30:40.616 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.626+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:40.731 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.740+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T11:30:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.782+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:40.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.798+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:40.815 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.812+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T11:30:40.815 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.812+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.114', time=2019-12-09T13:30:00.619840+0000, chain.objs.size()=2 2019-12-09T11:30:40.815 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.812+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.sBtysuMOWaO1IloXKtk2loEzWNNHsGM_0 2019-12-09T11:30:40.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.812+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.sBtysuMOWaO1IloXKtk2loEzWNNHsGM_1 2019-12-09T11:30:40.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.812+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.224', time=2019-12-09T13:30:03.182822+0000, chain.objs.size()=5 2019-12-09T11:30:40.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.812+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-FROZEN.2~T9sjSxLMWFDwIWYs4N46hnzcIVyhHEv.1 2019-12-09T11:30:40.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.812+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_foo-FROZEN.2~T9sjSxLMWFDwIWYs4N46hnzcIVyhHEv.1_1 2019-12-09T11:30:40.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.812+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-FROZEN.2~T9sjSxLMWFDwIWYs4N46hnzcIVyhHEv.2 2019-12-09T11:30:40.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.812+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_foo-FROZEN.2~T9sjSxLMWFDwIWYs4N46hnzcIVyhHEv.2_1 2019-12-09T11:30:40.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.812+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-FROZEN.2~T9sjSxLMWFDwIWYs4N46hnzcIVyhHEv.3 2019-12-09T11:30:40.919 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:40.929+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:41.008 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.017+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T11:30:41.083 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.093+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:41.113 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.123+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:41.132 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.142+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:41.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.203+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T11:30:41.242 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.252+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.272+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:41.276 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.286+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:41.314 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.324+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T11:30:41.371 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.380+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:41.405 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.414+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:41.423 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.433+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T11:30:41.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.433+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='_NjI7EDd_0fN5pdd7rnjDbQSCw0JaIB8', time=2019-12-09T13:29:59.734220+0000, chain.objs.size()=2 2019-12-09T11:30:41.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.433+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.z7CQ_2aA7YFsRMkpvGkhu3KDiOK2AK-_0 2019-12-09T11:30:41.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.433+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.z7CQ_2aA7YFsRMkpvGkhu3KDiOK2AK-_1 2019-12-09T11:30:41.655 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.665+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:41.800 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.810+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T11:30:41.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.867+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:41.885 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.895+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:41.896 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.905+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:41.937 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:41.947+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T11:30:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.006+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:42.018 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.027+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:42.029 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.039+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T11:30:42.030 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.039+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.112', time=2019-12-09T13:30:00.202851+0000, chain.objs.size()=2 2019-12-09T11:30:42.030 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.039+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.sBtysuMOWaO1IloXKtk2loEzWNNHsGM_0 2019-12-09T11:30:42.030 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.039+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.sBtysuMOWaO1IloXKtk2loEzWNNHsGM_1 2019-12-09T11:30:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.212+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:42.348 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.357+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T11:30:42.405 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.413+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:42.419 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.429+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:42.447 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.456+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T11:30:42.448 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.457+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.84', time=2019-12-09T13:30:07.802231+0000, chain.objs.size()=3 2019-12-09T11:30:42.448 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.457+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6__shadow_.yJl5M06FpzaIjQrJisJBkwcwyKPyw-S_0 2019-12-09T11:30:42.448 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.457+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6__shadow_.yJl5M06FpzaIjQrJisJBkwcwyKPyw-S_1 2019-12-09T11:30:42.449 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.457+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.6__shadow_.yJl5M06FpzaIjQrJisJBkwcwyKPyw-S_2 2019-12-09T11:30:42.699 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.708+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:42.870 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.879+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T11:30:42.932 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.942+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:42.956 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.965+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:42.969 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.978+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T11:30:42.969 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.978+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.242', time=2019-12-09T13:30:04.766402+0000, chain.objs.size()=3 2019-12-09T11:30:42.970 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.978+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-STANDARD.2~dPqTZITR8ILCfhZN7l96voHn4XAkSya.1 2019-12-09T11:30:42.970 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.978+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-STANDARD.2~dPqTZITR8ILCfhZN7l96voHn4XAkSya.2 2019-12-09T11:30:42.970 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:42.978+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-STANDARD.2~dPqTZITR8ILCfhZN7l96voHn4XAkSya.3 2019-12-09T11:30:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.139+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:43.225 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.234+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T11:30:43.265 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.274+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:43.281 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.291+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.302+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T11:30:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.302+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='_ev4XAcOfOwQRFtB6wAtEy7NM_q7TgDh', time=2019-12-09T13:30:04.187055+0000, chain.objs.size()=3 2019-12-09T11:30:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.302+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_.PTyFbKqtoi8ry9mW5xjuRMR_H2j-RYq_0 2019-12-09T11:30:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.302+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_.PTyFbKqtoi8ry9mW5xjuRMR_H2j-RYq_1 2019-12-09T11:30:43.293 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.302+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_.PTyFbKqtoi8ry9mW5xjuRMR_H2j-RYq_2 2019-12-09T11:30:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.490+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.610+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T11:30:43.661 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.670+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:43.677 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.687+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:43.693 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-09T11:30:43.694 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.55', time=2019-12-09T13:29:56.250851+0000, chain.objs.size()=4 2019-12-09T11:30:43.694 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4__multipart_foo.2~9OwoyjawWJusutoBtI5H2eAGyDPW5NO.1 2019-12-09T11:30:43.694 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4__multipart_foo.2~9OwoyjawWJusutoBtI5H2eAGyDPW5NO.2 2019-12-09T11:30:43.694 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4__multipart_foo.2~9OwoyjawWJusutoBtI5H2eAGyDPW5NO.3 2019-12-09T11:30:43.694 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.4__multipart_foo.2~9OwoyjawWJusutoBtI5H2eAGyDPW5NO.4 2019-12-09T11:30:43.694 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='_qbgjabFzYe0TlXR30sFF9QVeZHIUQUz', time=2019-12-09T13:30:04.961314+0000, chain.objs.size()=1 2019-12-09T11:30:43.695 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_.NWPvABTNmBjl3P0A5I6WhjhXD2u8KA1_0 2019-12-09T11:30:43.695 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.203', time=2019-12-09T13:30:06.549606+0000, chain.objs.size()=5 2019-12-09T11:30:43.695 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__multipart_foo-LUKEWARM.2~GUJ5Y2A1hqH3UpctbsaBSWIebPmmcnt.1 2019-12-09T11:30:43.695 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__shadow_foo-LUKEWARM.2~GUJ5Y2A1hqH3UpctbsaBSWIebPmmcnt.1_1 2019-12-09T11:30:43.695 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__multipart_foo-LUKEWARM.2~GUJ5Y2A1hqH3UpctbsaBSWIebPmmcnt.2 2019-12-09T11:30:43.695 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__shadow_foo-LUKEWARM.2~GUJ5Y2A1hqH3UpctbsaBSWIebPmmcnt.2_1 2019-12-09T11:30:43.695 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:43.702+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.8__multipart_foo-LUKEWARM.2~GUJ5Y2A1hqH3UpctbsaBSWIebPmmcnt.3 2019-12-09T11:30:44.056 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.065+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:44.158 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.168+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T11:30:44.206 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.215+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:44.250 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.259+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:44.268 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.277+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T11:30:44.268 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.277+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.109', time=2019-12-09T13:29:59.478130+0000, chain.objs.size()=2 2019-12-09T11:30:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.277+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.Wg6s-vJ3RRvvGGlfQatUE31c-z3uHao_0 2019-12-09T11:30:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.277+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.Wg6s-vJ3RRvvGGlfQatUE31c-z3uHao_1 2019-12-09T11:30:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.277+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='_WTIygmoWPnlawYS2NgLQnj6XCzgnZEx', time=2019-12-09T13:30:00.436816+0000, chain.objs.size()=2 2019-12-09T11:30:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.277+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.YnkOBAjoUDrL5xvMwc8yQkXqBKI0IHk_0 2019-12-09T11:30:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.277+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.7__shadow_.YnkOBAjoUDrL5xvMwc8yQkXqBKI0IHk_1 2019-12-09T11:30:44.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.543+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:44.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.669+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T11:30:44.712 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.721+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:44.733 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.743+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-09T11:30:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.225', time=2019-12-09T13:30:03.380688+0000, chain.objs.size()=5 2019-12-09T11:30:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-FROZEN.2~T9sjSxLMWFDwIWYs4N46hnzcIVyhHEv.1 2019-12-09T11:30:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_foo-FROZEN.2~T9sjSxLMWFDwIWYs4N46hnzcIVyhHEv.1_1 2019-12-09T11:30:44.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-FROZEN.2~T9sjSxLMWFDwIWYs4N46hnzcIVyhHEv.2 2019-12-09T11:30:44.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_foo-FROZEN.2~T9sjSxLMWFDwIWYs4N46hnzcIVyhHEv.2_1 2019-12-09T11:30:44.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__multipart_foo-FROZEN.2~T9sjSxLMWFDwIWYs4N46hnzcIVyhHEv.3 2019-12-09T11:30:44.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='_2PzDqP6XVOeary0St7tChC6Z-Ef4Cb1', time=2019-12-09T13:30:03.540398+0000, chain.objs.size()=3 2019-12-09T11:30:44.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_.nepxpb8ymxKF9iedlgD_vmRTNR5J9OF_0 2019-12-09T11:30:44.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_.nepxpb8ymxKF9iedlgD_vmRTNR5J9OF_1 2019-12-09T11:30:44.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_.nepxpb8ymxKF9iedlgD_vmRTNR5J9OF_2 2019-12-09T11:30:44.758 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process iterating over entry tag='_Py-8m1CvFXRj0wtG7jkNwxPraMKkpQl', time=2019-12-09T13:30:04.541661+0000, chain.objs.size()=2 2019-12-09T11:30:44.758 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_.1GtxWWGuCv-Y26WnNIHck3HEGnWvj1V_1 2019-12-09T11:30:44.758 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:44.765+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.9__shadow_.1GtxWWGuCv-Y26WnNIHck3HEGnWvj1V_2 2019-12-09T11:30:45.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.104+0000 7f8a74da5ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T11:30:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.174+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T11:30:45.213 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.222+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.238+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.247+0000 7f8a74da5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:45.326 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.335+0000 7f8a74da5ec0 20 remove_watcher() i=0 2019-12-09T11:30:45.326 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.335+0000 7f8a74da5ec0 2 removed watcher, disabling cache 2019-12-09T11:30:45.358 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.368+0000 7f8a74da5ec0 20 remove_watcher() i=1 2019-12-09T11:30:45.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.403+0000 7f8a74da5ec0 20 remove_watcher() i=2 2019-12-09T11:30:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.450+0000 7f8a74da5ec0 20 remove_watcher() i=3 2019-12-09T11:30:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.486+0000 7f8a74da5ec0 20 remove_watcher() i=4 2019-12-09T11:30:45.521 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.531+0000 7f8a74da5ec0 20 remove_watcher() i=5 2019-12-09T11:30:45.585 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.596+0000 7f8a74da5ec0 20 remove_watcher() i=6 2019-12-09T11:30:45.649 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.659+0000 7f8a74da5ec0 20 remove_watcher() i=7 2019-12-09T11:30:45.657 INFO:teuthology.orchestra.run.smithi146:> radosgw-admin gc process --include-all 2019-12-09T11:30:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.829+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:45.847 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.857+0000 7f690b825ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:45.847 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.857+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.866+0000 7f690b825ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.866+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.871+0000 7f690b825ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.871+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:45.879+0000 7f690b825ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:46.051 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.061+0000 7f690b825ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T11:30:46.051 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.061+0000 7f690b825ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T11:30:46.051 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.061+0000 7f690b825ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T11:30:46.051 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.061+0000 7f690b825ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T11:30:46.051 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.061+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.068+0000 7f690b825ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.068+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:46.067 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.077+0000 7f690b825ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:30:46.067 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.077+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.085+0000 7f690b825ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:46.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.085+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.105+0000 7f690b825ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:30:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.105+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:46.100 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.111+0000 7f690b825ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:46.100 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.111+0000 7f690b825ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T11:30:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.111+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:46.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.127+0000 7f690b825ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:46.118 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.127+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:46.129 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.139+0000 7f690b825ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:46.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.139+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:46.148 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.158+0000 7f690b825ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T11:30:46.149 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.158+0000 7f690b825ec0 20 zonegroup default 2019-12-09T11:30:46.149 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.158+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:46.153 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.163+0000 7f690b825ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:46.153 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.163+0000 7f690b825ec0 10 Cannot find current period zone using local zone 2019-12-09T11:30:46.153 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.163+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:46.158 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.168+0000 7f690b825ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T11:30:46.158 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.168+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.175+0000 7f690b825ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T11:30:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.175+0000 7f690b825ec0 20 rados->read ofs=0 len=0 2019-12-09T11:30:46.175 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.185+0000 7f690b825ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T11:30:46.175 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.185+0000 7f690b825ec0 20 zone default found 2019-12-09T11:30:46.175 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.185+0000 7f690b825ec0 20 started sync module instance, tier type = 2019-12-09T11:30:46.175 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.185+0000 7f690b825ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T11:30:46.619 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.628+0000 7f690b825ec0 20 add_watcher() i=0 2019-12-09T11:30:46.620 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.628+0000 7f690b825ec0 20 add_watcher() i=1 2019-12-09T11:30:46.621 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.628+0000 7f690b825ec0 20 add_watcher() i=2 2019-12-09T11:30:46.621 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.628+0000 7f690b825ec0 20 add_watcher() i=3 2019-12-09T11:30:46.622 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.628+0000 7f690b825ec0 20 add_watcher() i=4 2019-12-09T11:30:46.623 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.628+0000 7f690b825ec0 20 add_watcher() i=5 2019-12-09T11:30:46.653 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.663+0000 7f690b825ec0 20 add_watcher() i=6 2019-12-09T11:30:46.659 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.670+0000 7f690b825ec0 20 add_watcher() i=7 2019-12-09T11:30:46.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.670+0000 7f690b825ec0 2 all 8 watchers are set, enabling cache 2019-12-09T11:30:46.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.670+0000 7f68c97e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T11:30:46.664 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.674+0000 7f68f9250700 0 -- 172.21.15.146:0/1794105297 >> v1:172.21.15.194:6789/0 conn(0x55993d2c9230 legacy=0x55993d2f4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-09T11:30:46.722 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:46.732+0000 7f68f9250700 0 -- 172.21.15.146:0/1508099438 >> [v2:172.21.15.146:6800/9590,v1:172.21.15.146:6801/9590] conn(0x7f683c022480 msgr2=0x7f683c024990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T11:30:48.060 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.069+0000 7f683b7fe700 20 reqs_thread_entry: start 2019-12-09T11:30:48.060 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.069+0000 7f68397fa700 20 reqs_thread_entry: start 2019-12-09T11:30:48.061 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.069+0000 7f690b825ec0 20 init_complete bucket index max shards: 0 2019-12-09T11:30:48.061 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.070+0000 7f68277fe700 20 reqs_thread_entry: start 2019-12-09T11:30:48.061 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.070+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T11:30:48.110 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.120+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.126 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.136+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:48.136 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.146+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.168 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.178+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T11:30:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.216+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.222 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.232+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:48.230 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.240+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.258 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.268+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T11:30:48.311 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.321+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.336+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:48.335 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.345+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.382 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.392+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T11:30:48.434 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.444+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.450 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.460+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:48.458 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.468+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.500 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.511+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T11:30:48.565 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.575+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.583 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.593+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:48.594 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.604+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.637 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.647+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T11:30:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.682+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.688 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.697+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:48.695 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.706+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.724 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.734+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T11:30:48.763 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.773+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.781 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.791+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:48.792 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.802+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.829 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.839+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T11:30:48.885 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.895+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.904 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.915+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.924+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:48.960 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:48.970+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T11:30:49.048 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.058+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:49.081 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.091+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:49.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.105+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:49.158 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.168+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T11:30:49.219 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.229+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:49.239 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.249+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:49.253 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.263+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:49.307 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.315+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T11:30:49.381 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.391+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:49.411 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.421+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:49.421 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.432+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.486+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T11:30:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.536+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:49.555 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.565+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:49.564 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.574+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.622+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T11:30:49.673 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.683+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:49.688 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.698+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:49.697 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.707+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:49.731 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.740+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T11:30:49.829 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.839+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:49.852 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.863+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:49.867 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.877+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.927+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T11:30:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:49.991+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.001 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.011+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:50.010 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.020+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.048 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.058+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T11:30:50.114 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.124+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.134 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.145+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:50.145 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.155+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.190 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.200+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T11:30:50.282 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.291+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.304 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.313+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:50.324 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.333+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.357 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.367+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T11:30:50.414 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.424+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.442+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:50.441 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.451+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.502 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.512+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T11:30:50.554 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.564+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.572 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.582+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:50.581 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.592+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.642 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.652+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T11:30:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.719+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.750 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.755+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:50.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.783+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.874 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.884+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T11:30:50.917 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.927+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:50.944 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.954+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:50.964 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:50.974+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.001 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.011+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T11:30:51.057 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.067+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.086 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.096+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:51.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.105+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.136+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T11:30:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.175+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.192+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:51.192 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.202+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.221 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.231+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T11:30:51.305 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.315+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.329 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.339+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:51.341 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.351+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.379 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.389+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T11:30:51.421 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.431+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.436 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.446+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:51.444 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.454+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.476 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.486+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T11:30:51.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.529+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.543+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.552+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.581 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.591+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T11:30:51.620 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.630+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.634 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.645+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:51.647 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.653+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.671 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.681+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T11:30:51.721 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.731+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.740 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.750+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:51.749 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.759+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.784 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.794+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T11:30:51.821 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.831+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.838 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.848+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:51.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.856+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.880 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.890+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T11:30:51.956 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:51.966+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:51.990 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.000+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:52.010 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.020+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:52.064 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.074+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T11:30:52.149 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.159+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.189+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:52.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.204+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:52.258 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.267+0000 7f690b825ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T11:30:52.353 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.363+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:52.377 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.387+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T11:30:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.400+0000 7f690b825ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T11:30:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.520+0000 7f690b825ec0 20 remove_watcher() i=0 2019-12-09T11:30:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.520+0000 7f690b825ec0 2 removed watcher, disabling cache 2019-12-09T11:30:52.556 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.564+0000 7f690b825ec0 20 remove_watcher() i=1 2019-12-09T11:30:52.597 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.601+0000 7f690b825ec0 20 remove_watcher() i=2 2019-12-09T11:30:52.648 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.658+0000 7f690b825ec0 20 remove_watcher() i=3 2019-12-09T11:30:52.690 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.700+0000 7f690b825ec0 20 remove_watcher() i=4 2019-12-09T11:30:52.730 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.740+0000 7f690b825ec0 20 remove_watcher() i=5 2019-12-09T11:30:52.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.788+0000 7f690b825ec0 20 remove_watcher() i=6 2019-12-09T11:30:52.841 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T11:30:52.851+0000 7f690b825ec0 20 remove_watcher() i=7 2019-12-09T11:30:52.850 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2019-12-09T11:30:53.400 INFO:teuthology.orchestra.run.smithi146.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2019-12-09T11:30:56.500 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.pom 2019-12-09T11:30:56.700 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.jar 2019-12-09T11:30:58.002 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :clean UP-TO-DATE 2019-12-09T11:30:58.100 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-bom/1.11.549/aws-java-sdk-bom-1.11.549.pom 2019-12-09T11:30:58.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.549/aws-java-sdk-pom-1.11.549.pom 2019-12-09T11:30:58.300 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.pom 2019-12-09T11:30:58.301 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.pom 2019-12-09T11:30:58.301 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.pom 2019-12-09T11:30:58.301 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.pom 2019-12-09T11:30:58.301 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.pom 2019-12-09T11:30:58.301 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.pom 2019-12-09T11:30:58.302 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.pom 2019-12-09T11:30:58.302 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-parent/2.44.0/selenium-parent-2.44.0.pom 2019-12-09T11:30:58.302 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom 2019-12-09T11:30:58.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.pom 2019-12-09T11:30:58.402 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.pom 2019-12-09T11:30:58.402 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.pom 2019-12-09T11:30:58.402 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.pom 2019-12-09T11:30:58.402 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.pom 2019-12-09T11:30:58.402 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.pom 2019-12-09T11:30:58.402 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.5/httpcomponents-client-4.5.5.pom 2019-12-09T11:30:58.402 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/28/commons-parent-28.pom 2019-12-09T11:30:58.403 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.2/jackson-parent-2.6.2.pom 2019-12-09T11:30:58.403 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/10/httpcomponents-parent-10.pom 2019-12-09T11:30:58.403 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2019-12-09T11:30:58.403 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2019-12-09T11:30:58.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/24/oss-parent-24.pom 2019-12-09T11:30:58.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.pom 2019-12-09T11:30:58.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.pom 2019-12-09T11:30:58.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.pom 2019-12-09T11:30:58.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.pom 2019-12-09T11:30:58.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.pom 2019-12-09T11:30:58.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.pom 2019-12-09T11:30:58.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.pom 2019-12-09T11:30:58.600 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.pom 2019-12-09T11:30:58.600 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.pom 2019-12-09T11:30:58.600 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.pom 2019-12-09T11:30:58.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.pom 2019-12-09T11:30:58.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.pom 2019-12-09T11:30:58.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.pom 2019-12-09T11:30:58.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.pom 2019-12-09T11:30:58.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.pom 2019-12-09T11:30:58.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.pom 2019-12-09T11:30:58.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.pom 2019-12-09T11:30:58.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.pom 2019-12-09T11:30:58.603 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.pom 2019-12-09T11:30:58.603 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.pom 2019-12-09T11:30:58.603 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.pom 2019-12-09T11:30:58.603 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.pom 2019-12-09T11:30:58.603 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.pom 2019-12-09T11:30:58.603 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.pom 2019-12-09T11:30:58.603 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.pom 2019-12-09T11:30:58.604 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.pom 2019-12-09T11:30:58.604 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.pom 2019-12-09T11:30:58.604 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.pom 2019-12-09T11:30:58.604 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.pom 2019-12-09T11:30:58.604 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.pom 2019-12-09T11:30:58.605 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.pom 2019-12-09T11:30:58.605 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.pom 2019-12-09T11:30:58.605 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.pom 2019-12-09T11:30:58.605 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.pom 2019-12-09T11:30:58.605 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.pom 2019-12-09T11:30:58.605 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.pom 2019-12-09T11:30:58.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.pom 2019-12-09T11:30:58.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.pom 2019-12-09T11:30:58.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.pom 2019-12-09T11:30:58.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.pom 2019-12-09T11:30:58.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.pom 2019-12-09T11:30:58.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.pom 2019-12-09T11:30:58.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.pom 2019-12-09T11:30:58.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.pom 2019-12-09T11:30:58.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.pom 2019-12-09T11:30:58.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.pom 2019-12-09T11:30:58.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.pom 2019-12-09T11:30:58.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.pom 2019-12-09T11:30:58.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.pom 2019-12-09T11:30:58.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.pom 2019-12-09T11:30:58.704 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.pom 2019-12-09T11:30:58.704 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.pom 2019-12-09T11:30:58.704 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.pom 2019-12-09T11:30:58.704 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.pom 2019-12-09T11:30:58.704 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.pom 2019-12-09T11:30:58.704 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.pom 2019-12-09T11:30:58.704 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.pom 2019-12-09T11:30:58.801 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.pom 2019-12-09T11:30:58.802 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.pom 2019-12-09T11:30:58.802 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.pom 2019-12-09T11:30:58.802 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.pom 2019-12-09T11:30:58.802 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.pom 2019-12-09T11:30:58.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.pom 2019-12-09T11:30:58.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.pom 2019-12-09T11:30:58.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.pom 2019-12-09T11:30:58.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.pom 2019-12-09T11:30:58.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.pom 2019-12-09T11:30:58.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.pom 2019-12-09T11:30:58.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.pom 2019-12-09T11:30:58.804 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.pom 2019-12-09T11:30:58.804 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.pom 2019-12-09T11:30:58.804 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.pom 2019-12-09T11:30:58.804 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.pom 2019-12-09T11:30:58.804 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.pom 2019-12-09T11:30:58.804 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.pom 2019-12-09T11:30:58.804 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.pom 2019-12-09T11:30:58.805 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.pom 2019-12-09T11:30:58.805 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.pom 2019-12-09T11:30:58.805 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.pom 2019-12-09T11:30:58.805 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.pom 2019-12-09T11:30:58.805 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.pom 2019-12-09T11:30:58.805 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.pom 2019-12-09T11:30:58.805 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.pom 2019-12-09T11:30:58.806 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.pom 2019-12-09T11:30:58.806 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.pom 2019-12-09T11:30:58.806 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.pom 2019-12-09T11:30:58.806 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.pom 2019-12-09T11:30:58.806 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.pom 2019-12-09T11:30:58.806 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.pom 2019-12-09T11:30:58.806 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.pom 2019-12-09T11:30:58.806 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.pom 2019-12-09T11:30:58.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.pom 2019-12-09T11:30:58.931 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.pom 2019-12-09T11:30:58.931 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.pom 2019-12-09T11:30:58.931 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.pom 2019-12-09T11:30:58.931 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.pom 2019-12-09T11:30:58.932 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.pom 2019-12-09T11:30:58.932 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.pom 2019-12-09T11:30:58.932 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.pom 2019-12-09T11:30:58.932 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.pom 2019-12-09T11:30:58.933 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.pom 2019-12-09T11:30:58.933 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.pom 2019-12-09T11:30:58.933 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.pom 2019-12-09T11:30:58.933 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.pom 2019-12-09T11:30:58.933 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.pom 2019-12-09T11:30:58.934 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.pom 2019-12-09T11:30:58.934 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.pom 2019-12-09T11:30:58.934 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.pom 2019-12-09T11:30:58.934 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.pom 2019-12-09T11:30:58.935 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.pom 2019-12-09T11:30:58.935 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.pom 2019-12-09T11:30:58.935 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.pom 2019-12-09T11:30:58.935 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.pom 2019-12-09T11:30:58.936 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.pom 2019-12-09T11:30:58.936 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.pom 2019-12-09T11:30:58.936 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.pom 2019-12-09T11:30:58.937 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.pom 2019-12-09T11:30:58.937 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.pom 2019-12-09T11:30:58.937 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.pom 2019-12-09T11:30:58.937 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.pom 2019-12-09T11:30:58.938 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.pom 2019-12-09T11:30:58.938 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.pom 2019-12-09T11:30:58.938 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.pom 2019-12-09T11:30:58.938 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.pom 2019-12-09T11:30:58.938 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.pom 2019-12-09T11:30:58.939 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.pom 2019-12-09T11:30:59.005 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.pom 2019-12-09T11:30:59.005 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.pom 2019-12-09T11:30:59.005 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.pom 2019-12-09T11:30:59.005 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.pom 2019-12-09T11:30:59.006 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.pom 2019-12-09T11:30:59.006 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.pom 2019-12-09T11:30:59.006 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.pom 2019-12-09T11:30:59.006 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.pom 2019-12-09T11:30:59.006 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.pom 2019-12-09T11:30:59.006 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.pom 2019-12-09T11:30:59.006 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.pom 2019-12-09T11:30:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.pom 2019-12-09T11:30:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.pom 2019-12-09T11:30:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.pom 2019-12-09T11:30:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.pom 2019-12-09T11:30:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.pom 2019-12-09T11:30:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.pom 2019-12-09T11:30:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.pom 2019-12-09T11:30:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.pom 2019-12-09T11:30:59.008 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.pom 2019-12-09T11:30:59.008 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.pom 2019-12-09T11:30:59.008 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.pom 2019-12-09T11:30:59.008 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.pom 2019-12-09T11:30:59.008 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.pom 2019-12-09T11:30:59.008 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.pom 2019-12-09T11:30:59.008 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.pom 2019-12-09T11:30:59.009 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.pom 2019-12-09T11:30:59.009 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.pom 2019-12-09T11:30:59.009 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.pom 2019-12-09T11:30:59.009 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.pom 2019-12-09T11:30:59.009 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.pom 2019-12-09T11:30:59.009 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.pom 2019-12-09T11:30:59.010 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.pom 2019-12-09T11:30:59.010 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.pom 2019-12-09T11:30:59.010 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.pom 2019-12-09T11:30:59.011 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.pom 2019-12-09T11:30:59.100 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.pom 2019-12-09T11:30:59.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.pom 2019-12-09T11:30:59.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.22/aws-java-sdk-pom-1.11.22.pom 2019-12-09T11:30:59.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.pom 2019-12-09T11:30:59.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.pom 2019-12-09T11:30:59.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.pom 2019-12-09T11:30:59.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.pom 2019-12-09T11:30:59.102 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.pom 2019-12-09T11:30:59.103 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.pom 2019-12-09T11:30:59.103 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.pom 2019-12-09T11:30:59.104 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.pom 2019-12-09T11:30:59.104 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.pom 2019-12-09T11:30:59.104 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.pom 2019-12-09T11:30:59.104 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/project/6.1.9/project-6.1.9.pom 2019-12-09T11:30:59.105 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.9/commons-codec-1.9.pom 2019-12-09T11:30:59.105 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.pom 2019-12-09T11:30:59.105 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/32/commons-parent-32.pom 2019-12-09T11:30:59.205 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.pom 2019-12-09T11:30:59.205 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.pom 2019-12-09T11:30:59.205 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.pom 2019-12-09T11:30:59.206 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/beanshell/2.0b4/beanshell-2.0b4.pom 2019-12-09T11:30:59.206 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.pom 2019-12-09T11:30:59.206 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/34/commons-parent-34.pom 2019-12-09T11:30:59.206 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.pom 2019-12-09T11:30:59.207 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/35/commons-parent-35.pom 2019-12-09T11:30:59.207 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2019-12-09T11:30:59.300 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.pom 2019-12-09T11:30:59.300 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.9/httpcomponents-core-4.4.9.pom 2019-12-09T11:30:59.301 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/9/httpcomponents-parent-9.pom 2019-12-09T11:30:59.301 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.pom 2019-12-09T11:30:59.301 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.pom 2019-12-09T11:30:59.301 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.1/jackson-parent-2.6.1.pom 2019-12-09T11:30:59.301 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/23/oss-parent-23.pom 2019-12-09T11:30:59.302 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.pom 2019-12-09T11:30:59.302 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.pom 2019-12-09T11:30:59.400 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-parent/4.1.17.Final/netty-parent-4.1.17.Final.pom 2019-12-09T11:30:59.400 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2019-12-09T11:30:59.400 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.pom 2019-12-09T11:30:59.400 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.pom 2019-12-09T11:30:59.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.pom 2019-12-09T11:30:59.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.pom 2019-12-09T11:30:59.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.pom 2019-12-09T11:30:59.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.pom 2019-12-09T11:30:59.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.pom 2019-12-09T11:30:59.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/6/oss-parent-6.pom 2019-12-09T11:30:59.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.pom 2019-12-09T11:30:59.500 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.pom 2019-12-09T11:30:59.500 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.pom 2019-12-09T11:30:59.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.pom 2019-12-09T11:30:59.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.pom 2019-12-09T11:30:59.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.pom 2019-12-09T11:30:59.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.pom 2019-12-09T11:30:59.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/17/commons-parent-17.pom 2019-12-09T11:30:59.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/25/commons-parent-25.pom 2019-12-09T11:30:59.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/9/apache-9.pom 2019-12-09T11:30:59.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/7/apache-7.pom 2019-12-09T11:30:59.600 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.pom 2019-12-09T11:30:59.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.pom 2019-12-09T11:30:59.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.pom 2019-12-09T11:30:59.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2019-12-09T11:30:59.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.pom 2019-12-09T11:30:59.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.pom 2019-12-09T11:30:59.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.pom 2019-12-09T11:30:59.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.pom 2019-12-09T11:30:59.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.pom 2019-12-09T11:30:59.603 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.pom 2019-12-09T11:30:59.603 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/18.0/guava-parent-18.0.pom 2019-12-09T11:30:59.700 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.pom 2019-12-09T11:30:59.700 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.pom 2019-12-09T11:30:59.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.pom 2019-12-09T11:30:59.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.pom 2019-12-09T11:30:59.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.pom 2019-12-09T11:30:59.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.pom 2019-12-09T11:30:59.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.pom 2019-12-09T11:30:59.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.pom 2019-12-09T11:30:59.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/33/commons-parent-33.pom 2019-12-09T11:30:59.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/9/commons-parent-9.pom 2019-12-09T11:30:59.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.pom 2019-12-09T11:30:59.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/4/apache-4.pom 2019-12-09T11:30:59.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom 2019-12-09T11:30:59.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-project/8.1.15.v20140411/jetty-project-8.1.15.v20140411.pom 2019-12-09T11:30:59.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/project/7/project-7.pom 2019-12-09T11:30:59.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-parent/20/jetty-parent-20.pom 2019-12-09T11:30:59.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.pom 2019-12-09T11:30:59.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.pom 2019-12-09T11:30:59.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.pom 2019-12-09T11:30:59.800 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.pom 2019-12-09T11:30:59.800 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.pom 2019-12-09T11:30:59.800 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.pom 2019-12-09T11:31:00.600 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.jar 2019-12-09T11:31:00.600 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.jar 2019-12-09T11:31:00.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.jar 2019-12-09T11:31:00.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.jar 2019-12-09T11:31:00.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.jar 2019-12-09T11:31:00.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.jar 2019-12-09T11:31:00.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.jar 2019-12-09T11:31:00.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.jar 2019-12-09T11:31:00.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.jar 2019-12-09T11:31:00.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.jar 2019-12-09T11:31:00.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.jar 2019-12-09T11:31:00.700 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.jar 2019-12-09T11:31:00.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.jar 2019-12-09T11:31:00.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.jar 2019-12-09T11:31:00.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.jar 2019-12-09T11:31:00.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.jar 2019-12-09T11:31:00.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.jar 2019-12-09T11:31:00.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.jar 2019-12-09T11:31:00.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.jar 2019-12-09T11:31:00.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.jar 2019-12-09T11:31:00.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.jar 2019-12-09T11:31:00.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.jar 2019-12-09T11:31:00.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.jar 2019-12-09T11:31:00.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.jar 2019-12-09T11:31:00.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.jar 2019-12-09T11:31:00.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.jar 2019-12-09T11:31:00.801 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.jar 2019-12-09T11:31:00.801 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.jar 2019-12-09T11:31:00.801 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.jar 2019-12-09T11:31:00.801 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.jar 2019-12-09T11:31:00.801 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.jar 2019-12-09T11:31:00.801 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.jar 2019-12-09T11:31:00.802 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.jar 2019-12-09T11:31:00.802 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.jar 2019-12-09T11:31:00.802 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.jar 2019-12-09T11:31:00.802 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.jar 2019-12-09T11:31:00.802 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.jar 2019-12-09T11:31:00.802 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.jar 2019-12-09T11:31:00.802 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.jar 2019-12-09T11:31:00.802 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.jar 2019-12-09T11:31:00.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.jar 2019-12-09T11:31:00.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.jar 2019-12-09T11:31:00.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.jar 2019-12-09T11:31:00.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.jar 2019-12-09T11:31:00.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.jar 2019-12-09T11:31:00.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.jar 2019-12-09T11:31:00.803 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.jar 2019-12-09T11:31:00.804 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.jar 2019-12-09T11:31:00.804 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.jar 2019-12-09T11:31:00.804 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.jar 2019-12-09T11:31:00.804 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.jar 2019-12-09T11:31:00.804 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.jar 2019-12-09T11:31:00.900 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.jar 2019-12-09T11:31:00.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.jar 2019-12-09T11:31:00.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.jar 2019-12-09T11:31:00.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.jar 2019-12-09T11:31:00.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.jar 2019-12-09T11:31:00.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.jar 2019-12-09T11:31:00.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.jar 2019-12-09T11:31:00.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.jar 2019-12-09T11:31:00.902 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.jar 2019-12-09T11:31:00.902 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.jar 2019-12-09T11:31:00.902 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.jar 2019-12-09T11:31:00.902 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.jar 2019-12-09T11:31:00.902 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.jar 2019-12-09T11:31:00.902 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.jar 2019-12-09T11:31:00.902 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.jar 2019-12-09T11:31:00.903 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.jar 2019-12-09T11:31:00.903 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.jar 2019-12-09T11:31:00.903 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.jar 2019-12-09T11:31:00.903 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.jar 2019-12-09T11:31:00.903 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.jar 2019-12-09T11:31:01.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.jar 2019-12-09T11:31:01.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.jar 2019-12-09T11:31:01.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.jar 2019-12-09T11:31:01.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.jar 2019-12-09T11:31:01.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.jar 2019-12-09T11:31:01.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.jar 2019-12-09T11:31:01.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.jar 2019-12-09T11:31:01.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.jar 2019-12-09T11:31:01.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.jar 2019-12-09T11:31:01.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.jar 2019-12-09T11:31:01.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.jar 2019-12-09T11:31:01.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.jar 2019-12-09T11:31:01.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.jar 2019-12-09T11:31:01.003 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.jar 2019-12-09T11:31:01.003 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.jar 2019-12-09T11:31:01.003 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.jar 2019-12-09T11:31:01.100 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.jar 2019-12-09T11:31:01.100 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.jar 2019-12-09T11:31:01.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.jar 2019-12-09T11:31:01.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.jar 2019-12-09T11:31:01.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.jar 2019-12-09T11:31:01.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.jar 2019-12-09T11:31:01.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.jar 2019-12-09T11:31:01.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.jar 2019-12-09T11:31:01.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.jar 2019-12-09T11:31:01.102 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.jar 2019-12-09T11:31:01.102 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.jar 2019-12-09T11:31:01.200 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.jar 2019-12-09T11:31:01.201 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.jar 2019-12-09T11:31:01.201 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.jar 2019-12-09T11:31:01.201 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.jar 2019-12-09T11:31:01.201 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.jar 2019-12-09T11:31:01.201 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.jar 2019-12-09T11:31:01.201 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.jar 2019-12-09T11:31:01.202 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.jar 2019-12-09T11:31:01.202 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.jar 2019-12-09T11:31:01.202 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.jar 2019-12-09T11:31:01.202 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.jar 2019-12-09T11:31:01.202 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.jar 2019-12-09T11:31:01.313 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.jar 2019-12-09T11:31:01.313 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.jar 2019-12-09T11:31:01.314 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.jar 2019-12-09T11:31:01.314 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.jar 2019-12-09T11:31:01.314 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.jar 2019-12-09T11:31:01.314 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.jar 2019-12-09T11:31:01.314 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.jar 2019-12-09T11:31:01.314 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.jar 2019-12-09T11:31:01.314 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.jar 2019-12-09T11:31:01.315 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.jar 2019-12-09T11:31:01.315 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.jar 2019-12-09T11:31:01.315 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.jar 2019-12-09T11:31:01.400 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.jar 2019-12-09T11:31:01.400 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.jar 2019-12-09T11:31:01.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.jar 2019-12-09T11:31:01.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.jar 2019-12-09T11:31:01.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.jar 2019-12-09T11:31:01.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.jar 2019-12-09T11:31:01.401 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.jar 2019-12-09T11:31:01.402 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.jar 2019-12-09T11:31:01.500 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.jar 2019-12-09T11:31:01.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.jar 2019-12-09T11:31:01.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.jar 2019-12-09T11:31:01.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.jar 2019-12-09T11:31:01.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.jar 2019-12-09T11:31:01.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.jar 2019-12-09T11:31:01.501 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.jar 2019-12-09T11:31:01.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.jar 2019-12-09T11:31:01.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.jar 2019-12-09T11:31:01.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.jar 2019-12-09T11:31:01.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.jar 2019-12-09T11:31:01.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.jar 2019-12-09T11:31:01.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.jar 2019-12-09T11:31:01.502 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.jar 2019-12-09T11:31:01.503 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.jar 2019-12-09T11:31:01.503 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.jar 2019-12-09T11:31:01.503 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.jar 2019-12-09T11:31:01.503 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.jar 2019-12-09T11:31:01.600 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.jar 2019-12-09T11:31:01.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.jar 2019-12-09T11:31:01.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.jar 2019-12-09T11:31:01.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.jar 2019-12-09T11:31:01.601 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.jar 2019-12-09T11:31:01.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.jar 2019-12-09T11:31:01.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.jar 2019-12-09T11:31:01.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.jar 2019-12-09T11:31:01.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.jar 2019-12-09T11:31:01.602 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.jar 2019-12-09T11:31:01.603 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.jar 2019-12-09T11:31:01.700 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.jar 2019-12-09T11:31:01.700 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.jar 2019-12-09T11:31:01.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.jar 2019-12-09T11:31:01.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.jar 2019-12-09T11:31:01.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.jar 2019-12-09T11:31:01.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.jar 2019-12-09T11:31:01.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.jar 2019-12-09T11:31:01.701 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.jar 2019-12-09T11:31:01.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.jar 2019-12-09T11:31:01.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.jar 2019-12-09T11:31:01.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.jar 2019-12-09T11:31:01.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.jar 2019-12-09T11:31:01.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.jar 2019-12-09T11:31:01.702 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.jar 2019-12-09T11:31:01.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.jar 2019-12-09T11:31:01.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.jar 2019-12-09T11:31:01.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.jar 2019-12-09T11:31:01.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.jar 2019-12-09T11:31:01.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.jar 2019-12-09T11:31:01.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.jar 2019-12-09T11:31:01.703 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.jar 2019-12-09T11:31:01.704 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.jar 2019-12-09T11:31:01.704 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.jar 2019-12-09T11:31:01.704 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar 2019-12-09T11:31:01.809 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.jar 2019-12-09T11:31:01.809 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.jar 2019-12-09T11:31:01.809 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.jar 2019-12-09T11:31:01.809 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.jar 2019-12-09T11:31:01.809 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.jar 2019-12-09T11:31:01.809 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.jar 2019-12-09T11:31:01.810 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.jar 2019-12-09T11:31:01.810 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.jar 2019-12-09T11:31:01.810 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.jar 2019-12-09T11:31:01.810 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.jar 2019-12-09T11:31:01.810 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.jar 2019-12-09T11:31:01.810 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.jar 2019-12-09T11:31:01.811 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.jar 2019-12-09T11:31:01.811 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.jar 2019-12-09T11:31:01.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar 2019-12-09T11:31:01.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar 2019-12-09T11:31:01.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.jar 2019-12-09T11:31:01.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.jar 2019-12-09T11:31:01.901 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.jar 2019-12-09T11:31:01.902 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.jar 2019-12-09T11:31:01.902 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.jar 2019-12-09T11:31:01.902 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.jar 2019-12-09T11:31:01.902 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.jar 2019-12-09T11:31:01.902 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.jar 2019-12-09T11:31:01.903 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar 2019-12-09T11:31:01.903 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.jar 2019-12-09T11:31:01.903 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar 2019-12-09T11:31:01.903 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar 2019-12-09T11:31:01.903 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.jar 2019-12-09T11:31:01.903 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.jar 2019-12-09T11:31:02.000 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.jar 2019-12-09T11:31:02.000 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.jar 2019-12-09T11:31:02.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.jar 2019-12-09T11:31:02.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.jar 2019-12-09T11:31:02.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.jar 2019-12-09T11:31:02.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar 2019-12-09T11:31:02.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.jar 2019-12-09T11:31:02.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.jar 2019-12-09T11:31:02.001 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar 2019-12-09T11:31:02.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar 2019-12-09T11:31:02.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.jar 2019-12-09T11:31:02.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.jar 2019-12-09T11:31:02.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.jar 2019-12-09T11:31:02.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.jar 2019-12-09T11:31:02.002 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.jar 2019-12-09T11:31:02.100 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.jar 2019-12-09T11:31:02.100 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.jar 2019-12-09T11:31:02.100 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar 2019-12-09T11:31:02.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.jar 2019-12-09T11:31:02.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.jar 2019-12-09T11:31:02.101 INFO:teuthology.orchestra.run.smithi146.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.jar 2019-12-09T11:31:11.301 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :compileJava 2019-12-09T11:31:11.301 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :processResources 2019-12-09T11:31:11.301 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :classes 2019-12-09T11:31:11.801 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:31:11.801 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :compileTestJava 2019-12-09T11:31:11.802 INFO:teuthology.orchestra.run.smithi146.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-12-09T11:31:11.802 INFO:teuthology.orchestra.run.smithi146.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-12-09T11:31:11.802 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:31:11.802 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :processTestResources NO-SOURCE 2019-12-09T11:31:11.802 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :testClasses 2019-12-09T11:31:20.101 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:31:20.101 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :test 2019-12-09T11:31:20.101 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:31:20.101 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2019-12-09T11:31:33.699 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:25:54.767 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:31:33.718 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:25:54.786 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:31:33.734 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:25:54.802 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:31:33.745 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:25:54.813 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:31:33.795 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:25:54.831 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:31:33.805 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:25:54.842 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:31:33.831 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:25:54.898 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:31:33.851 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:25:54.918 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:31:33.929 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:25:54.968 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:32:21.204 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:32:21.206 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2019-12-09T11:32:27.405 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:32:27.405 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2019-12-09T11:32:29.705 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:32:29.705 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2019-12-09T11:32:39.005 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:32:39.006 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2019-12-09T11:33:49.709 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:33:49.709 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2019-12-09T11:33:59.009 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:33:59.009 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2019-12-09T11:34:00.309 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:34:00.310 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2019-12-09T11:34:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:34:01.409 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2019-12-09T11:34:03.809 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:34:03.811 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2019-12-09T11:34:09.609 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:34:09.609 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2019-12-09T11:34:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:34:57.121 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2019-12-09T11:35:11.711 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:35:11.711 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2019-12-09T11:37:39.733 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:32:00.790 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:39.755 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:32:00.792 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:39.756 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:32:00.796 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:39.757 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:32:00.815 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:39.762 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:32:00.801 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:39.764 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:32:00.821 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:39.949 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:32:01.007 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:39.957 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:32:01.014 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:39.996 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:32:01.035 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:39:22.113 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:39:22.114 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2019-12-09T11:39:39.013 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:39:39.013 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2019-12-09T11:39:40.213 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:39:40.213 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2019-12-09T11:39:48.413 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:39:48.413 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2019-12-09T11:39:53.513 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:39:53.514 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2019-12-09T11:40:04.314 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:40:04.314 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2019-12-09T11:40:49.214 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:40:49.214 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2019-12-09T11:40:59.414 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:40:59.414 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2019-12-09T11:40:59.614 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:40:59.614 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2019-12-09T11:41:00.914 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:41:00.914 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2019-12-09T11:41:48.286 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T11:41:48.245+0000 120037700 -1 handle_data failed with exit code -104 2019-12-09T11:41:49.613 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:41:49.614 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2019-12-09T11:41:58.913 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:41:58.914 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2019-12-09T11:42:49.255 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:37:10.311 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:42:49.262 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:37:10.319 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:42:49.267 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:37:10.324 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:42:49.273 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:37:10.328 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:42:49.279 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:37:10.317 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:42:49.287 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:37:10.325 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:42:49.451 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:37:10.508 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:42:49.457 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:37:10.513 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:42:49.514 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:37:10.552 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:42:59.213 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:42:59.214 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2019-12-09T11:43:10.713 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:43:10.714 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2019-12-09T11:43:42.214 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:43:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2019-12-09T11:43:50.713 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:43:50.714 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2019-12-09T11:48:01.417 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:42:22.472 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:01.442 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:42:22.479 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:01.443 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:42:22.489 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:01.443 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:42:22.493 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:01.445 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:42:22.484 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:01.453 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:42:22.492 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:01.618 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:42:22.673 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:01.629 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:42:22.684 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:01.664 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:42:22.702 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:16.493 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:42:37.548 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:16.498 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:42:37.553 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:16.520 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:42:37.574 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:16.533 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:42:37.571 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:16.539 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:42:37.578 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:16.552 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:42:37.604 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:16.555 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:42:37.610 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:16.576 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:42:37.615 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:48:16.577 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:42:37.632 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:13.377 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:47:34.430 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:13.394 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:47:34.440 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:13.395 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:47:34.448 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:13.402 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:47:34.441 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:13.403 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:47:34.457 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:13.409 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:47:34.448 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:13.603 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:47:34.642 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:13.613 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:47:34.666 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:13.620 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:47:34.673 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:56:16.218 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:56:16.232 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2019-12-09T11:56:24.118 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:56:24.118 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2019-12-09T11:56:42.899 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:51:03.951 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:56:42.922 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:51:03.974 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:56:42.925 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:51:03.977 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:56:42.971 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:51:04.023 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:56:43.000 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:51:04.039 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:56:43.003 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:51:04.042 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:56:43.038 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:51:04.090 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:56:43.058 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:51:04.110 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:56:43.169 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:51:04.208 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:58:06.518 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:58:06.519 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2019-12-09T11:58:14.218 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:58:14.218 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2019-12-09T11:58:23.201 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:52:44.253 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:58:23.211 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:52:44.262 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:58:23.221 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:52:44.260 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:58:23.222 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:52:44.273 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:58:23.224 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:52:44.263 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:58:23.227 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:52:44.278 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:58:23.282 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:52:44.334 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T11:58:23.297 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:52:44.349 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T11:58:23.298 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:52:44.337 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T11:59:05.618 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:59:05.618 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2019-12-09T11:59:12.718 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:59:12.719 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2019-12-09T11:59:30.518 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:59:30.519 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2019-12-09T11:59:50.118 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:59:50.119 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2019-12-09T11:59:56.018 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T11:59:56.019 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2019-12-09T12:00:11.018 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:00:11.018 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2019-12-09T12:00:13.818 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:00:13.818 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2019-12-09T12:00:29.318 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:00:29.318 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2019-12-09T12:00:33.918 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:00:33.918 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2019-12-09T12:00:59.418 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:00:59.419 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2019-12-09T12:01:13.018 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:01:13.019 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2019-12-09T12:01:36.918 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:01:36.919 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2019-12-09T12:01:47.118 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:01:47.118 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2019-12-09T12:02:25.718 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:02:25.718 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2019-12-09T12:02:41.018 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:02:41.018 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2019-12-09T12:03:33.978 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:57:55.030 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:03:33.982 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:57:55.034 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:03:33.991 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:57:55.043 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:03:33.995 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:57:55.047 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:03:34.005 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:57:55.044 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:03:34.011 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:57:55.050 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:03:34.166 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:57:55.218 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:03:34.178 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:57:55.230 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:03:34.340 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:57:55.379 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:04:02.918 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:04:02.918 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2019-12-09T12:04:17.318 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:04:17.318 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2019-12-09T12:05:09.170 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:59:30.221 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:09.193 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:59:30.244 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:09.225 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:59:30.273 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:09.230 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:59:30.276 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:09.246 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:00:59:30.298 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:09.256 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:59:30.294 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:09.267 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:59:30.306 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:09.294 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:00:59:30.334 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:09.398 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:00:59:30.434 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:20.518 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:05:20.535 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2019-12-09T12:08:46.929 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:03:07.981 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:08:46.941 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:03:07.987 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:08:46.942 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:03:07.994 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:08:46.947 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:03:07.999 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:08:46.954 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:03:07.987 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:08:46.957 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:03:07.994 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:08:47.077 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:03:08.129 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:08:47.086 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:03:08.138 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:08:47.138 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:03:08.175 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:35.518 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:07:56.571 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:35.523 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:07:56.576 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:35.528 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:07:56.566 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:35.532 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:07:56.570 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:35.544 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:07:56.597 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:35.551 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:07:56.604 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:35.641 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:07:56.694 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:35.658 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:07:56.695 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:35.668 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:07:56.721 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:57.129 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:08:18.182 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:57.136 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:08:18.189 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:57.146 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:08:18.199 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:57.155 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:08:18.208 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:57.158 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:08:18.195 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:57.166 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:08:18.203 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:57.180 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:08:18.232 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:57.188 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:08:18.241 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:13:57.222 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:08:18.259 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:14:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:14:05.517 INFO:teuthology.orchestra.run.smithi146.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2019-12-09T12:14:34.017 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:14:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:---------------------------------------------------------------------- 2019-12-09T12:14:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2019-12-09T12:14:34.017 INFO:teuthology.orchestra.run.smithi146.stdout:---------------------------------------------------------------------- 2019-12-09T12:14:34.280 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:14:34.280 INFO:teuthology.orchestra.run.smithi146.stdout:BUILD SUCCESSFUL in 43m 41s 2019-12-09T12:14:34.280 INFO:teuthology.orchestra.run.smithi146.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2019-12-09T12:14:34.597 INFO:teuthology.orchestra.run.smithi146:> radosgw-admin gc process --include-all 2019-12-09T12:14:34.754 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.745+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:34.781 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.773+0000 7fe837369ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:34.782 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.773+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:34.790 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.782+0000 7fe837369ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:34.791 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.782+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:34.795 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.787+0000 7fe837369ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:34.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.787+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:34.803 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.794+0000 7fe837369ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.954+0000 7fe837369ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T12:14:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.954+0000 7fe837369ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T12:14:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.954+0000 7fe837369ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:14:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.954+0000 7fe837369ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:14:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.954+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:34.972 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.963+0000 7fe837369ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:34.972 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.963+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:34.980 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.972+0000 7fe837369ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:14:34.981 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.972+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:34.991 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.983+0000 7fe837369ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:34.991 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:34.983+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:35.011 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.003+0000 7fe837369ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:14:35.012 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.003+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:35.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.008+0000 7fe837369ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:35.017 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.008+0000 7fe837369ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:14:35.017 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.008+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:35.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.013+0000 7fe837369ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:35.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.013+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:35.030 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.021+0000 7fe837369ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:35.030 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.021+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:35.040 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.031+0000 7fe837369ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:14:35.040 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.031+0000 7fe837369ec0 20 zonegroup default 2019-12-09T12:14:35.040 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.031+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:35.053 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.044+0000 7fe837369ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:35.053 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.044+0000 7fe837369ec0 10 Cannot find current period zone using local zone 2019-12-09T12:14:35.053 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.044+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:35.057 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.049+0000 7fe837369ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:35.057 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.049+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:35.065 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.057+0000 7fe837369ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:35.065 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.057+0000 7fe837369ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:35.074 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.065+0000 7fe837369ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:14:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.065+0000 7fe837369ec0 20 zone default found 2019-12-09T12:14:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.065+0000 7fe837369ec0 20 started sync module instance, tier type = 2019-12-09T12:14:35.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.065+0000 7fe837369ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T12:14:35.463 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.454+0000 7fe837369ec0 20 add_watcher() i=0 2019-12-09T12:14:35.463 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.454+0000 7fe837369ec0 20 add_watcher() i=1 2019-12-09T12:14:35.463 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.454+0000 7fe837369ec0 20 add_watcher() i=2 2019-12-09T12:14:35.463 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.454+0000 7fe837369ec0 20 add_watcher() i=3 2019-12-09T12:14:35.464 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.454+0000 7fe837369ec0 20 add_watcher() i=4 2019-12-09T12:14:35.464 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.454+0000 7fe837369ec0 20 add_watcher() i=5 2019-12-09T12:14:35.464 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.454+0000 7fe837369ec0 20 add_watcher() i=6 2019-12-09T12:14:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.499+0000 7fe837369ec0 20 add_watcher() i=7 2019-12-09T12:14:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.499+0000 7fe837369ec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:14:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.499+0000 7fe7f4fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:14:35.516 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.507+0000 7fe824593700 0 -- 172.21.15.146:0/1079764578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55ebef4fb7b0 msgr2=0x55ebef4fbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T12:14:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.709+0000 7fe824593700 0 --2- 172.21.15.146:0/1079764578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55ebef4fb7b0 0x55ebef4fbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-09T12:14:35.770 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:35.761+0000 7fe824593700 0 -- 172.21.15.146:0/1261986216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55ebef501fa0 msgr2=0x55ebef4d41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:14:37.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.094+0000 7fe766ffd700 20 reqs_thread_entry: start 2019-12-09T12:14:37.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.094+0000 7fe764ff9700 20 reqs_thread_entry: start 2019-12-09T12:14:37.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.094+0000 7fe837369ec0 20 init_complete bucket index max shards: 0 2019-12-09T12:14:37.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.094+0000 7fe75affd700 20 reqs_thread_entry: start 2019-12-09T12:14:37.104 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.094+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T12:14:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.148+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.163+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:37.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T12:14:37.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.553', time=2019-12-09T13:43:01.032431+0000, chain.objs.size()=9 2019-12-09T12:14:37.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.26__multipart_file.mpg.2~ubqrRf3HjBwuCNErXbZd42sdQecp2JW.1 2019-12-09T12:14:37.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.26__shadow_file.mpg.2~ubqrRf3HjBwuCNErXbZd42sdQecp2JW.1_1 2019-12-09T12:14:37.195 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.26__multipart_file.mpg.2~ubqrRf3HjBwuCNErXbZd42sdQecp2JW.2 2019-12-09T12:14:37.195 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.26__shadow_file.mpg.2~ubqrRf3HjBwuCNErXbZd42sdQecp2JW.2_1 2019-12-09T12:14:37.195 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.26__multipart_file.mpg.2~ubqrRf3HjBwuCNErXbZd42sdQecp2JW.3 2019-12-09T12:14:37.195 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.26__shadow_file.mpg.2~ubqrRf3HjBwuCNErXbZd42sdQecp2JW.3_1 2019-12-09T12:14:37.195 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.26__multipart_file.mpg.2~ubqrRf3HjBwuCNErXbZd42sdQecp2JW.4 2019-12-09T12:14:37.195 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.26__shadow_file.mpg.2~ubqrRf3HjBwuCNErXbZd42sdQecp2JW.4_1 2019-12-09T12:14:37.195 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.26__multipart_file.mpg.2~ubqrRf3HjBwuCNErXbZd42sdQecp2JW.5 2019-12-09T12:14:37.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.600', time=2019-12-09T13:50:01.965177+0000, chain.objs.size()=21 2019-12-09T12:14:37.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.1 2019-12-09T12:14:37.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.1_1 2019-12-09T12:14:37.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.184+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.2 2019-12-09T12:14:37.539 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.530+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.2_1 2019-12-09T12:14:37.539 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.530+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.3 2019-12-09T12:14:37.539 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.530+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.3_1 2019-12-09T12:14:37.539 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.530+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.4 2019-12-09T12:14:37.539 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.530+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.4_1 2019-12-09T12:14:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.593+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.5 2019-12-09T12:14:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.593+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.5_1 2019-12-09T12:14:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.593+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.6 2019-12-09T12:14:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.593+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.6_1 2019-12-09T12:14:37.725 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.716+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.7 2019-12-09T12:14:37.725 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.716+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.7_1 2019-12-09T12:14:37.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.849+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.8 2019-12-09T12:14:37.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.849+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.8_1 2019-12-09T12:14:37.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.849+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.9 2019-12-09T12:14:37.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.849+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.9_1 2019-12-09T12:14:37.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.849+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.10 2019-12-09T12:14:37.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.849+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.10_1 2019-12-09T12:14:37.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:37.849+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~Me9AbVGSU3oYkmbwjbDQxFu_DWxAlTH.11 2019-12-09T12:14:38.198 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.189+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:38.308 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.299+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T12:14:38.358 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.349+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:38.376 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.368+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:38.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:14:38.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.612', time=2019-12-09T13:51:50.437141+0000, chain.objs.size()=19 2019-12-09T12:14:38.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.1 2019-12-09T12:14:38.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.1_1 2019-12-09T12:14:38.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.2 2019-12-09T12:14:38.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.2_1 2019-12-09T12:14:38.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.3 2019-12-09T12:14:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.3_1 2019-12-09T12:14:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.4 2019-12-09T12:14:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.4_1 2019-12-09T12:14:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.5 2019-12-09T12:14:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.5_1 2019-12-09T12:14:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.6 2019-12-09T12:14:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.389+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.6_1 2019-12-09T12:14:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.566+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.7 2019-12-09T12:14:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.649+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.7_1 2019-12-09T12:14:38.669 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.660+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.8 2019-12-09T12:14:38.669 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.660+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.8_1 2019-12-09T12:14:38.776 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.768+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.9 2019-12-09T12:14:38.777 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.768+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.9_1 2019-12-09T12:14:38.777 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.768+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~9TvoW6q1KvGCMS-gR_nye7QKoz_xp8y.10 2019-12-09T12:14:38.981 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:38.973+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:39.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.129+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T12:14:39.186 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.178+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:39.202 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.194+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:39.211 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.202+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:39.247 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.239+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T12:14:39.298 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.289+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:39.314 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.306+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.315+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:39.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.341+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T12:14:39.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.386+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:39.412 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.403+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:39.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.421+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T12:14:39.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.421+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~ad2OqHHYNDHdbCRtwuM4ZqjDesuPePL', time=2019-12-09T13:32:20.194981+0000, chain.objs.size()=9 2019-12-09T12:14:39.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.421+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.13__multipart_key1.2~ad2OqHHYNDHdbCRtwuM4ZqjDesuPePL.1 2019-12-09T12:14:39.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.421+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.13__shadow_key1.2~ad2OqHHYNDHdbCRtwuM4ZqjDesuPePL.1_1 2019-12-09T12:14:39.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.421+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.13__multipart_key1.2~ad2OqHHYNDHdbCRtwuM4ZqjDesuPePL.2 2019-12-09T12:14:39.431 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.421+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.13__shadow_key1.2~ad2OqHHYNDHdbCRtwuM4ZqjDesuPePL.2_1 2019-12-09T12:14:39.431 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.421+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.13__multipart_key1.2~ad2OqHHYNDHdbCRtwuM4ZqjDesuPePL.3 2019-12-09T12:14:39.431 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.421+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.13__shadow_key1.2~ad2OqHHYNDHdbCRtwuM4ZqjDesuPePL.3_1 2019-12-09T12:14:39.431 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.421+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.13__multipart_key1.2~ad2OqHHYNDHdbCRtwuM4ZqjDesuPePL.4 2019-12-09T12:14:39.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.421+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.13__shadow_key1.2~ad2OqHHYNDHdbCRtwuM4ZqjDesuPePL.4_1 2019-12-09T12:14:39.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.421+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.13__multipart_key1.2~ad2OqHHYNDHdbCRtwuM4ZqjDesuPePL.5 2019-12-09T12:14:39.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.421+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~jW-iEhc_2e3PVhZheTIF30EcG3USWNb', time=2019-12-09T14:14:28.056852+0000, chain.objs.size()=0 2019-12-09T12:14:39.664 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.656+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:39.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.765+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T12:14:39.808 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.800+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:39.827 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.818+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:39.844 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.835+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:14:39.845 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.835+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.438', time=2019-12-09T13:37:35.047405+0000, chain.objs.size()=9 2019-12-09T12:14:39.845 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.835+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~eRxr2hPhPqdU4Z92u5oypatT73ODGe2.1 2019-12-09T12:14:39.845 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.835+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~eRxr2hPhPqdU4Z92u5oypatT73ODGe2.1_1 2019-12-09T12:14:39.845 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.835+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~eRxr2hPhPqdU4Z92u5oypatT73ODGe2.2 2019-12-09T12:14:39.845 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.835+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~eRxr2hPhPqdU4Z92u5oypatT73ODGe2.2_1 2019-12-09T12:14:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.835+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~eRxr2hPhPqdU4Z92u5oypatT73ODGe2.3 2019-12-09T12:14:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.835+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~eRxr2hPhPqdU4Z92u5oypatT73ODGe2.3_1 2019-12-09T12:14:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.835+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~eRxr2hPhPqdU4Z92u5oypatT73ODGe2.4 2019-12-09T12:14:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.835+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~eRxr2hPhPqdU4Z92u5oypatT73ODGe2.4_1 2019-12-09T12:14:39.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:39.835+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~eRxr2hPhPqdU4Z92u5oypatT73ODGe2.5 2019-12-09T12:14:40.160 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.151+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.255+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T12:14:40.319 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.310+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:40.337 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.329+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:40.353 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.342+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:14:40.353 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.342+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.666', time=2019-12-09T13:59:07.677915+0000, chain.objs.size()=9 2019-12-09T12:14:40.353 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.342+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.30__multipart_key1.2~PoUeXQ1oU7zrkIH4eJwvxGcIw8t7A_T.1 2019-12-09T12:14:40.353 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.342+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.30__shadow_key1.2~PoUeXQ1oU7zrkIH4eJwvxGcIw8t7A_T.1_1 2019-12-09T12:14:40.353 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.343+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.30__multipart_key1.2~PoUeXQ1oU7zrkIH4eJwvxGcIw8t7A_T.2 2019-12-09T12:14:40.353 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.343+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.30__shadow_key1.2~PoUeXQ1oU7zrkIH4eJwvxGcIw8t7A_T.2_1 2019-12-09T12:14:40.353 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.343+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.30__multipart_key1.2~PoUeXQ1oU7zrkIH4eJwvxGcIw8t7A_T.3 2019-12-09T12:14:40.354 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.343+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.30__shadow_key1.2~PoUeXQ1oU7zrkIH4eJwvxGcIw8t7A_T.3_1 2019-12-09T12:14:40.354 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.343+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.30__multipart_key1.2~PoUeXQ1oU7zrkIH4eJwvxGcIw8t7A_T.4 2019-12-09T12:14:40.354 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.343+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.30__shadow_key1.2~PoUeXQ1oU7zrkIH4eJwvxGcIw8t7A_T.4_1 2019-12-09T12:14:40.354 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.343+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.30__multipart_key1.2~PoUeXQ1oU7zrkIH4eJwvxGcIw8t7A_T.5 2019-12-09T12:14:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.558+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:40.738 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.730+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T12:14:40.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.771+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:40.797 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.788+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:40.813 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.803+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:14:40.813 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.803+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.620', time=2019-12-09T13:54:22.514857+0000, chain.objs.size()=16 2019-12-09T12:14:40.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.803+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.1 2019-12-09T12:14:40.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.803+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.1_1 2019-12-09T12:14:40.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.803+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.1_2 2019-12-09T12:14:40.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.804+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.2 2019-12-09T12:14:40.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.804+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.2_1 2019-12-09T12:14:40.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.804+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.2_2 2019-12-09T12:14:40.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.804+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.3 2019-12-09T12:14:40.815 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.804+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.3_1 2019-12-09T12:14:40.815 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.804+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.3_2 2019-12-09T12:14:40.815 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.804+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.4 2019-12-09T12:14:40.815 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.804+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.4_1 2019-12-09T12:14:40.815 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:40.804+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.4_2 2019-12-09T12:14:41.114 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.105+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.5 2019-12-09T12:14:41.114 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.105+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.5_1 2019-12-09T12:14:41.114 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.105+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.5_2 2019-12-09T12:14:41.115 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.105+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~ZocpStEZLs_98OJUM-zlpYlnEySt2dt.6 2019-12-09T12:14:41.316 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.307+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:41.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.423+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T12:14:41.498 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.489+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:41.520 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.511+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:41.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.522+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:41.571 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.562+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T12:14:41.629 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.620+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:41.659 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.650+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:41.676 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.667+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:41.723 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.714+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T12:14:41.765 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.756+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:41.781 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.772+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:41.791 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.782+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:41.822 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.813+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T12:14:41.878 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.869+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:41.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.885+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:41.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T12:14:41.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.446', time=2019-12-09T13:38:03.895854+0000, chain.objs.size()=9 2019-12-09T12:14:41.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~6M1YBDBfyWzqP-G0Aduimo-JIylRUQa.1 2019-12-09T12:14:41.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~6M1YBDBfyWzqP-G0Aduimo-JIylRUQa.1_1 2019-12-09T12:14:41.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~6M1YBDBfyWzqP-G0Aduimo-JIylRUQa.2 2019-12-09T12:14:41.922 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~6M1YBDBfyWzqP-G0Aduimo-JIylRUQa.2_1 2019-12-09T12:14:41.922 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~6M1YBDBfyWzqP-G0Aduimo-JIylRUQa.3 2019-12-09T12:14:41.922 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~6M1YBDBfyWzqP-G0Aduimo-JIylRUQa.3_1 2019-12-09T12:14:41.922 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~6M1YBDBfyWzqP-G0Aduimo-JIylRUQa.4 2019-12-09T12:14:41.922 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~6M1YBDBfyWzqP-G0Aduimo-JIylRUQa.4_1 2019-12-09T12:14:41.922 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~6M1YBDBfyWzqP-G0Aduimo-JIylRUQa.5 2019-12-09T12:14:41.922 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD', time=2019-12-09T13:59:44.259243+0000, chain.objs.size()=28 2019-12-09T12:14:41.923 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.1 2019-12-09T12:14:41.923 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.2 2019-12-09T12:14:41.923 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:41.911+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.3 2019-12-09T12:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.183+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.4 2019-12-09T12:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.183+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.5 2019-12-09T12:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.183+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.6 2019-12-09T12:14:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.235+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.7 2019-12-09T12:14:42.371 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.362+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.8 2019-12-09T12:14:42.408 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.399+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.9 2019-12-09T12:14:42.409 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.399+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.10 2019-12-09T12:14:42.423 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.414+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.11 2019-12-09T12:14:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.415+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.12 2019-12-09T12:14:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.415+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.13 2019-12-09T12:14:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.415+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.14 2019-12-09T12:14:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.415+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.Pj88R3m9FVvOt66f7yXmdgrO2ZbclHz.15 2019-12-09T12:14:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.415+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.16 2019-12-09T12:14:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.415+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.17 2019-12-09T12:14:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.415+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.18 2019-12-09T12:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.740+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.Dvfr2jFz3kMOdKHe28cTpD_pLeyybVe.19 2019-12-09T12:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.740+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.9Dwg3TCLWSHHokCWULwIyfdMmQHvuMm.20 2019-12-09T12:14:42.750 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.740+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.21 2019-12-09T12:14:42.750 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.740+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.22 2019-12-09T12:14:42.750 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.740+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.23 2019-12-09T12:14:42.750 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.740+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.24 2019-12-09T12:14:42.750 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.740+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.25 2019-12-09T12:14:42.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.850+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.26 2019-12-09T12:14:42.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.850+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.27 2019-12-09T12:14:42.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:42.850+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.31__multipart_key1.2~DCNpDO--fD2ean8B0dOxhgqUWDIhJxD.28 2019-12-09T12:14:43.098 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.090+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:43.213 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.204+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T12:14:43.273 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.264+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:43.286 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.278+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:43.300 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.291+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:14:43.300 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.291+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.509', time=2019-12-09T13:40:52.969006+0000, chain.objs.size()=9 2019-12-09T12:14:43.301 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.291+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.24__multipart_key1.2~Mr3opgXxiHpChgCRBizF--cjmZXUnyp.1 2019-12-09T12:14:43.301 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.291+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.24__shadow_key1.2~Mr3opgXxiHpChgCRBizF--cjmZXUnyp.1_1 2019-12-09T12:14:43.301 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.291+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.24__multipart_key1.2~Mr3opgXxiHpChgCRBizF--cjmZXUnyp.2 2019-12-09T12:14:43.301 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.291+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.24__shadow_key1.2~Mr3opgXxiHpChgCRBizF--cjmZXUnyp.2_1 2019-12-09T12:14:43.301 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.291+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.24__multipart_key1.2~Mr3opgXxiHpChgCRBizF--cjmZXUnyp.3 2019-12-09T12:14:43.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.291+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.24__shadow_key1.2~Mr3opgXxiHpChgCRBizF--cjmZXUnyp.3_1 2019-12-09T12:14:43.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.291+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.24__multipart_key1.2~Mr3opgXxiHpChgCRBizF--cjmZXUnyp.4 2019-12-09T12:14:43.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.291+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.24__shadow_key1.2~Mr3opgXxiHpChgCRBizF--cjmZXUnyp.4_1 2019-12-09T12:14:43.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.291+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.24__multipart_key1.2~Mr3opgXxiHpChgCRBizF--cjmZXUnyp.5 2019-12-09T12:14:43.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.678+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:43.771 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.763+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T12:14:43.831 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.823+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:43.852 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.843+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:43.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.850+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:43.911 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.903+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T12:14:43.994 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:43.981+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:44.027 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.019+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.030+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.095+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T12:14:44.159 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.150+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.173+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:44.195 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.186+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:14:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.186+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.430', time=2019-12-09T13:39:31.699355+0000, chain.objs.size()=5 2019-12-09T12:14:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.186+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.19__shadow_.LIwE_ayyZAQjpE0Py-pd_6xSpvCVCkz_1 2019-12-09T12:14:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.186+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.19__shadow_.LIwE_ayyZAQjpE0Py-pd_6xSpvCVCkz_2 2019-12-09T12:14:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.186+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.19__shadow_.LIwE_ayyZAQjpE0Py-pd_6xSpvCVCkz_3 2019-12-09T12:14:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.186+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.19__shadow_.LIwE_ayyZAQjpE0Py-pd_6xSpvCVCkz_4 2019-12-09T12:14:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.186+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.19__shadow_.LIwE_ayyZAQjpE0Py-pd_6xSpvCVCkz_5 2019-12-09T12:14:44.499 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.490+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:44.610 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.601+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T12:14:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.694+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:44.725 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.717+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:44.747 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.739+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:44.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.788+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T12:14:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.831+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:44.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.849+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:44.872 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.861+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:14:44.872 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.861+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.454', time=2019-12-09T13:38:27.076277+0000, chain.objs.size()=9 2019-12-09T12:14:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.861+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~V2yxuH1qTzNIgfQ2N_HqFUDu3KI1ztS.1 2019-12-09T12:14:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.861+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~V2yxuH1qTzNIgfQ2N_HqFUDu3KI1ztS.1_1 2019-12-09T12:14:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.861+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~V2yxuH1qTzNIgfQ2N_HqFUDu3KI1ztS.2 2019-12-09T12:14:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.861+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~V2yxuH1qTzNIgfQ2N_HqFUDu3KI1ztS.2_1 2019-12-09T12:14:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.861+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~V2yxuH1qTzNIgfQ2N_HqFUDu3KI1ztS.3 2019-12-09T12:14:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.861+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~V2yxuH1qTzNIgfQ2N_HqFUDu3KI1ztS.3_1 2019-12-09T12:14:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.861+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~V2yxuH1qTzNIgfQ2N_HqFUDu3KI1ztS.4 2019-12-09T12:14:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.861+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~V2yxuH1qTzNIgfQ2N_HqFUDu3KI1ztS.4_1 2019-12-09T12:14:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:44.861+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~V2yxuH1qTzNIgfQ2N_HqFUDu3KI1ztS.5 2019-12-09T12:14:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.155+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.288+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T12:14:45.391 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.382+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:45.408 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.399+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.411+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.411+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.466', time=2019-12-09T13:39:20.091891+0000, chain.objs.size()=7 2019-12-09T12:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.411+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~DXJTi_5Cv5zLv_EVlIs7jR4UAyyFbnS.1 2019-12-09T12:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.411+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~DXJTi_5Cv5zLv_EVlIs7jR4UAyyFbnS.1_1 2019-12-09T12:14:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.411+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~DXJTi_5Cv5zLv_EVlIs7jR4UAyyFbnS.1_2 2019-12-09T12:14:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.411+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~DXJTi_5Cv5zLv_EVlIs7jR4UAyyFbnS.2 2019-12-09T12:14:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.411+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~DXJTi_5Cv5zLv_EVlIs7jR4UAyyFbnS.2_1 2019-12-09T12:14:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.411+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~DXJTi_5Cv5zLv_EVlIs7jR4UAyyFbnS.2_2 2019-12-09T12:14:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.411+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~DXJTi_5Cv5zLv_EVlIs7jR4UAyyFbnS.3 2019-12-09T12:14:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.686+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:45.842 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.833+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T12:14:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.870+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.888+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:45.912 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.903+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:14:45.912 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.903+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.417', time=2019-12-09T13:35:07.128467+0000, chain.objs.size()=9 2019-12-09T12:14:45.912 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.903+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__multipart_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.1 2019-12-09T12:14:45.912 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.903+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__shadow_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.1_1 2019-12-09T12:14:45.913 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.903+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__multipart_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.2 2019-12-09T12:14:45.913 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.903+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__shadow_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.2_1 2019-12-09T12:14:45.913 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.903+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__multipart_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.3 2019-12-09T12:14:45.913 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.903+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__shadow_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.3_1 2019-12-09T12:14:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.903+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__multipart_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.4 2019-12-09T12:14:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.903+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__shadow_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.4_1 2019-12-09T12:14:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:45.903+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__multipart_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.5 2019-12-09T12:14:46.238 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.229+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:46.317 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.309+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T12:14:46.358 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.349+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:46.378 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.369+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:46.389 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.380+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:46.425 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.416+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T12:14:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.459+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:46.483 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.475+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:46.492 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.483+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:46.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.522+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T12:14:46.604 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.596+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:46.632 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.623+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:46.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.635+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:46.699 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.690+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T12:14:46.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.748+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:46.775 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.766+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:46.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.778+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:14:46.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.778+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.460', time=2019-12-09T13:38:54.789818+0000, chain.objs.size()=7 2019-12-09T12:14:46.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.778+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~K_wV3YB8iBNRkYgSS4sK1cWSpSivAS2.1 2019-12-09T12:14:46.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.778+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~K_wV3YB8iBNRkYgSS4sK1cWSpSivAS2.1_1 2019-12-09T12:14:46.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.778+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~K_wV3YB8iBNRkYgSS4sK1cWSpSivAS2.1_2 2019-12-09T12:14:46.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.778+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~K_wV3YB8iBNRkYgSS4sK1cWSpSivAS2.2 2019-12-09T12:14:46.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.778+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~K_wV3YB8iBNRkYgSS4sK1cWSpSivAS2.2_1 2019-12-09T12:14:46.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.778+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~K_wV3YB8iBNRkYgSS4sK1cWSpSivAS2.2_2 2019-12-09T12:14:46.790 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:46.778+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~K_wV3YB8iBNRkYgSS4sK1cWSpSivAS2.3 2019-12-09T12:14:47.113 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.105+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:47.337 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.329+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T12:14:47.405 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.396+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:47.434 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.425+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:47.461 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T12:14:47.461 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.415', time=2019-12-09T13:34:59.913162+0000, chain.objs.size()=9 2019-12-09T12:14:47.461 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__multipart_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.1 2019-12-09T12:14:47.461 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__shadow_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.1_1 2019-12-09T12:14:47.461 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__multipart_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.2 2019-12-09T12:14:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__shadow_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.2_1 2019-12-09T12:14:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__multipart_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.3 2019-12-09T12:14:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__shadow_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.3_1 2019-12-09T12:14:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__multipart_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.4 2019-12-09T12:14:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__shadow_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.4_1 2019-12-09T12:14:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.17__multipart_key1.2~0gjln036zvb_SuqX8qa6K2U8m9MIhdM.5 2019-12-09T12:14:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.472', time=2019-12-09T13:39:23.708561+0000, chain.objs.size()=7 2019-12-09T12:14:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~BP4QhQEehbhujcWTo8IESBhwhIsPEEw.1 2019-12-09T12:14:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~BP4QhQEehbhujcWTo8IESBhwhIsPEEw.1_1 2019-12-09T12:14:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.451+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~BP4QhQEehbhujcWTo8IESBhwhIsPEEw.1_2 2019-12-09T12:14:47.876 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.867+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~BP4QhQEehbhujcWTo8IESBhwhIsPEEw.2 2019-12-09T12:14:47.876 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.867+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~BP4QhQEehbhujcWTo8IESBhwhIsPEEw.2_1 2019-12-09T12:14:47.876 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.867+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__shadow_key1.2~BP4QhQEehbhujcWTo8IESBhwhIsPEEw.2_2 2019-12-09T12:14:47.876 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:47.867+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.20__multipart_key1.2~BP4QhQEehbhujcWTo8IESBhwhIsPEEw.3 2019-12-09T12:14:48.098 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.089+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:48.197 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.188+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T12:14:48.238 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.229+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:48.256 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.248+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:48.265 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.256+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:48.294 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.285+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T12:14:48.348 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.340+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:48.375 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.367+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T12:14:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.386', time=2019-12-09T13:33:51.855604+0000, chain.objs.size()=9 2019-12-09T12:14:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.15__multipart_key1.2~KRuUxWGyUbWTPMf3a7dhC0-mUKocXwQ.1 2019-12-09T12:14:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.15__shadow_key1.2~KRuUxWGyUbWTPMf3a7dhC0-mUKocXwQ.1_1 2019-12-09T12:14:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.15__multipart_key1.2~KRuUxWGyUbWTPMf3a7dhC0-mUKocXwQ.2 2019-12-09T12:14:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.15__shadow_key1.2~KRuUxWGyUbWTPMf3a7dhC0-mUKocXwQ.2_1 2019-12-09T12:14:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.15__multipart_key1.2~KRuUxWGyUbWTPMf3a7dhC0-mUKocXwQ.3 2019-12-09T12:14:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.15__shadow_key1.2~KRuUxWGyUbWTPMf3a7dhC0-mUKocXwQ.3_1 2019-12-09T12:14:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.15__multipart_key1.2~KRuUxWGyUbWTPMf3a7dhC0-mUKocXwQ.4 2019-12-09T12:14:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.15__shadow_key1.2~KRuUxWGyUbWTPMf3a7dhC0-mUKocXwQ.4_1 2019-12-09T12:14:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.15__multipart_key1.2~KRuUxWGyUbWTPMf3a7dhC0-mUKocXwQ.5 2019-12-09T12:14:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.651', time=2019-12-09T13:58:09.267097+0000, chain.objs.size()=9 2019-12-09T12:14:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.29__multipart_key1.2~xZmshlKRn8ha94UVlxyCebCy7-bHBta.1 2019-12-09T12:14:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.29__shadow_key1.2~xZmshlKRn8ha94UVlxyCebCy7-bHBta.1_1 2019-12-09T12:14:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.384+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.29__multipart_key1.2~xZmshlKRn8ha94UVlxyCebCy7-bHBta.2 2019-12-09T12:14:48.656 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.647+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.29__shadow_key1.2~xZmshlKRn8ha94UVlxyCebCy7-bHBta.2_1 2019-12-09T12:14:48.711 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.702+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.29__multipart_key1.2~xZmshlKRn8ha94UVlxyCebCy7-bHBta.3 2019-12-09T12:14:48.711 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.702+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.29__shadow_key1.2~xZmshlKRn8ha94UVlxyCebCy7-bHBta.3_1 2019-12-09T12:14:48.712 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.702+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.29__multipart_key1.2~xZmshlKRn8ha94UVlxyCebCy7-bHBta.4 2019-12-09T12:14:48.712 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.702+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.29__shadow_key1.2~xZmshlKRn8ha94UVlxyCebCy7-bHBta.4_1 2019-12-09T12:14:48.712 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:48.702+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.29__multipart_key1.2~xZmshlKRn8ha94UVlxyCebCy7-bHBta.5 2019-12-09T12:14:49.017 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.009+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:49.126 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.117+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T12:14:49.170 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.161+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:49.185 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.177+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:49.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.185+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:49.227 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.218+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T12:14:49.270 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.262+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.277+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:49.297 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.288+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:14:49.297 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.288+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~4bneefZw0rETJhHeikefh7K2NDMX_33', time=2019-12-09T13:43:46.077706+0000, chain.objs.size()=5 2019-12-09T12:14:49.297 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.288+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.27__multipart_key1.2~4bneefZw0rETJhHeikefh7K2NDMX_33.7 2019-12-09T12:14:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.288+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.27__shadow_key1.2~4bneefZw0rETJhHeikefh7K2NDMX_33.7_1 2019-12-09T12:14:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.288+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.27__multipart_key1.2~4bneefZw0rETJhHeikefh7K2NDMX_33.10 2019-12-09T12:14:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.288+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.27__shadow_key1.2~4bneefZw0rETJhHeikefh7K2NDMX_33.10_1 2019-12-09T12:14:49.298 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.288+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.27__multipart_key1.2~4bneefZw0rETJhHeikefh7K2NDMX_33.13 2019-12-09T12:14:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.464+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:49.571 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.562+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T12:14:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.601+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.616+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:49.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:14:49.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.628', time=2019-12-09T13:56:14.866255+0000, chain.objs.size()=16 2019-12-09T12:14:49.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.1 2019-12-09T12:14:49.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.1_1 2019-12-09T12:14:49.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.1_2 2019-12-09T12:14:49.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.2 2019-12-09T12:14:49.644 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.2_1 2019-12-09T12:14:49.644 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.2_2 2019-12-09T12:14:49.644 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.3 2019-12-09T12:14:49.644 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.3_1 2019-12-09T12:14:49.644 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.3_2 2019-12-09T12:14:49.644 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.4 2019-12-09T12:14:49.645 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.4_1 2019-12-09T12:14:49.645 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.634+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.4_2 2019-12-09T12:14:49.935 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.926+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.5 2019-12-09T12:14:49.936 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.926+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.5_1 2019-12-09T12:14:49.936 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.926+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.5_2 2019-12-09T12:14:49.989 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:49.981+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~qD39TQbzM8qkrVN4JEsVIeZD9v9wPHb.6 2019-12-09T12:14:50.280 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.271+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:50.388 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.379+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T12:14:50.433 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.424+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:50.453 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.444+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:50.483 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-09T12:14:50.483 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.528', time=2019-12-09T13:41:52.974246+0000, chain.objs.size()=9 2019-12-09T12:14:50.483 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.25__multipart_key1.2~tY0ZD2AHWfuTr_KoGh4ceVfdq7XNH23.1 2019-12-09T12:14:50.484 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.25__shadow_key1.2~tY0ZD2AHWfuTr_KoGh4ceVfdq7XNH23.1_1 2019-12-09T12:14:50.484 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.25__multipart_key1.2~tY0ZD2AHWfuTr_KoGh4ceVfdq7XNH23.2 2019-12-09T12:14:50.484 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.25__shadow_key1.2~tY0ZD2AHWfuTr_KoGh4ceVfdq7XNH23.2_1 2019-12-09T12:14:50.484 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.25__multipart_key1.2~tY0ZD2AHWfuTr_KoGh4ceVfdq7XNH23.3 2019-12-09T12:14:50.484 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.25__shadow_key1.2~tY0ZD2AHWfuTr_KoGh4ceVfdq7XNH23.3_1 2019-12-09T12:14:50.485 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.25__multipart_key1.2~tY0ZD2AHWfuTr_KoGh4ceVfdq7XNH23.4 2019-12-09T12:14:50.485 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.25__shadow_key1.2~tY0ZD2AHWfuTr_KoGh4ceVfdq7XNH23.4_1 2019-12-09T12:14:50.485 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.25__multipart_key1.2~tY0ZD2AHWfuTr_KoGh4ceVfdq7XNH23.5 2019-12-09T12:14:50.485 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.587', time=2019-12-09T13:48:10.643851+0000, chain.objs.size()=21 2019-12-09T12:14:50.486 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.1 2019-12-09T12:14:50.486 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.1_1 2019-12-09T12:14:50.486 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.473+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.2 2019-12-09T12:14:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.770+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.2_1 2019-12-09T12:14:50.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.770+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.3 2019-12-09T12:14:50.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.770+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.3_1 2019-12-09T12:14:50.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.770+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.4 2019-12-09T12:14:50.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.770+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.4_1 2019-12-09T12:14:50.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.770+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.5 2019-12-09T12:14:50.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.770+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.5_1 2019-12-09T12:14:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.793+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.6 2019-12-09T12:14:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.793+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.6_1 2019-12-09T12:14:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.793+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.7 2019-12-09T12:14:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:50.793+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.7_1 2019-12-09T12:14:51.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.085+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.8 2019-12-09T12:14:51.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.085+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.8_1 2019-12-09T12:14:51.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.085+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.9 2019-12-09T12:14:51.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.085+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.9_1 2019-12-09T12:14:51.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.085+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.10 2019-12-09T12:14:51.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.085+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.10_1 2019-12-09T12:14:51.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.085+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~lYZzmS0jjiK9S2lEN3edtNA6xZgNxjA.11 2019-12-09T12:14:51.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.085+0000 7fe837369ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.636', time=2019-12-09T13:56:19.301169+0000, chain.objs.size()=16 2019-12-09T12:14:51.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.085+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.1 2019-12-09T12:14:51.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.085+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.1_1 2019-12-09T12:14:51.183 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.174+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.1_2 2019-12-09T12:14:51.183 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.174+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.2 2019-12-09T12:14:51.404 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.395+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.2_1 2019-12-09T12:14:51.404 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.395+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.2_2 2019-12-09T12:14:51.495 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.487+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.3 2019-12-09T12:14:51.496 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.487+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.3_1 2019-12-09T12:14:51.496 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.487+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.3_2 2019-12-09T12:14:51.496 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.487+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.4 2019-12-09T12:14:51.496 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.487+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.4_1 2019-12-09T12:14:51.496 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.487+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.4_2 2019-12-09T12:14:51.496 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.487+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.5 2019-12-09T12:14:51.496 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.487+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.5_1 2019-12-09T12:14:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.487+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__shadow_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.5_2 2019-12-09T12:14:51.691 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:51.682+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.28__multipart_key1.2~CCaUDUaXNSunB221yaSfJdKWq2BGeT-.6 2019-12-09T12:14:52.012 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.003+0000 7fe837369ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:14:52.110 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.101+0000 7fe837369ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T12:14:52.157 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.148+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:52.173 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.165+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:52.189 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.180+0000 7fe837369ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.277+0000 7fe837369ec0 20 remove_watcher() i=0 2019-12-09T12:14:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.277+0000 7fe837369ec0 2 removed watcher, disabling cache 2019-12-09T12:14:52.318 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.309+0000 7fe837369ec0 20 remove_watcher() i=1 2019-12-09T12:14:52.351 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.342+0000 7fe837369ec0 20 remove_watcher() i=2 2019-12-09T12:14:52.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.391+0000 7fe837369ec0 20 remove_watcher() i=3 2019-12-09T12:14:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.442+0000 7fe837369ec0 20 remove_watcher() i=4 2019-12-09T12:14:52.501 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.492+0000 7fe837369ec0 20 remove_watcher() i=5 2019-12-09T12:14:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.571+0000 7fe837369ec0 20 remove_watcher() i=6 2019-12-09T12:14:52.656 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.647+0000 7fe837369ec0 20 remove_watcher() i=7 2019-12-09T12:14:52.664 INFO:teuthology.orchestra.run.smithi146:> radosgw-admin gc process --include-all 2019-12-09T12:14:52.778 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.769+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:52.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.792+0000 7f9dd3887ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:52.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.792+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:52.820 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.811+0000 7f9dd3887ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:52.820 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.811+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:52.825 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.816+0000 7f9dd3887ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:52.825 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.816+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:52.832 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.823+0000 7f9dd3887ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.964+0000 7f9dd3887ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T12:14:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.964+0000 7f9dd3887ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T12:14:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.964+0000 7f9dd3887ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:14:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.964+0000 7f9dd3887ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:14:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.964+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:52.985 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.976+0000 7f9dd3887ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.976+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:52.997 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.988+0000 7f9dd3887ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:14:52.997 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.988+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:53.006 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.997+0000 7f9dd3887ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:53.006 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:52.997+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:53.027 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.018+0000 7f9dd3887ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:14:53.027 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.018+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:53.037 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.027+0000 7f9dd3887ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:53.037 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.027+0000 7f9dd3887ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:14:53.037 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.027+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:53.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.033+0000 7f9dd3887ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:53.042 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.033+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:53.048 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.040+0000 7f9dd3887ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:53.049 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.040+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:53.074 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.066+0000 7f9dd3887ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:14:53.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.066+0000 7f9dd3887ec0 20 zonegroup default 2019-12-09T12:14:53.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.066+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:53.079 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.070+0000 7f9dd3887ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:53.079 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.070+0000 7f9dd3887ec0 10 Cannot find current period zone using local zone 2019-12-09T12:14:53.079 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.070+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:53.086 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.077+0000 7f9dd3887ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:53.086 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.077+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:53.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.087+0000 7f9dd3887ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:53.096 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.087+0000 7f9dd3887ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:53.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.094+0000 7f9dd3887ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:14:53.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.094+0000 7f9dd3887ec0 20 zone default found 2019-12-09T12:14:53.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.094+0000 7f9dd3887ec0 20 started sync module instance, tier type = 2019-12-09T12:14:53.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.094+0000 7f9dd3887ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T12:14:53.459 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.450+0000 7f9dd3887ec0 20 add_watcher() i=0 2019-12-09T12:14:53.459 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.450+0000 7f9dd3887ec0 20 add_watcher() i=1 2019-12-09T12:14:53.459 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.450+0000 7f9dd3887ec0 20 add_watcher() i=2 2019-12-09T12:14:53.460 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.450+0000 7f9dd3887ec0 20 add_watcher() i=3 2019-12-09T12:14:53.460 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.450+0000 7f9dd3887ec0 20 add_watcher() i=4 2019-12-09T12:14:53.460 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.450+0000 7f9dd3887ec0 20 add_watcher() i=5 2019-12-09T12:14:53.482 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.474+0000 7f9dd3887ec0 20 add_watcher() i=6 2019-12-09T12:14:53.491 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.482+0000 7f9dd3887ec0 20 add_watcher() i=7 2019-12-09T12:14:53.491 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.482+0000 7f9dd3887ec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:14:53.491 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.482+0000 7f9d90fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:14:53.493 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.485+0000 7f9dc12b2700 0 -- 172.21.15.146:0/4095538241 >> v1:172.21.15.146:6789/0 conn(0x562ac2c7f4a0 legacy=0x562ac2caac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-09T12:14:53.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:53.524+0000 7f9dbbfff700 0 -- 172.21.15.146:0/2668025040 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x562ac2cbf580 msgr2=0x562ac2cc19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T12:14:55.160 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.152+0000 7f9d02ffd700 20 reqs_thread_entry: start 2019-12-09T12:14:55.160 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.152+0000 7f9d00ff9700 20 reqs_thread_entry: start 2019-12-09T12:14:55.160 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.152+0000 7f9dd3887ec0 20 init_complete bucket index max shards: 0 2019-12-09T12:14:55.160 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.152+0000 7f9cf6ffd700 20 reqs_thread_entry: start 2019-12-09T12:14:55.161 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.152+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T12:14:55.199 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.191+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:55.216 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.208+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.217+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:55.279 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.271+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T12:14:55.356 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.348+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:55.375 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.367+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:55.384 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.377+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:55.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.424+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T12:14:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.504+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:55.532 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.524+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:55.547 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.539+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:55.593 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.585+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T12:14:55.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.652+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:55.722 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.714+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:55.734 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.726+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:55.776 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.768+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T12:14:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.848+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:55.896 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.888+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:55.916 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.908+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:55.977 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:55.969+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T12:14:56.038 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.030+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.061 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.054+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.071+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.130 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.123+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T12:14:56.184 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.176+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.194+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:56.211 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.203+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.240+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T12:14:56.327 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.320+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.349+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:56.371 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.363+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.419 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.412+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T12:14:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.495+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.545 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.537+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:56.569 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.561+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.616 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.609+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T12:14:56.670 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.662+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.680+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.688+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.739 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.731+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T12:14:56.793 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.785+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.837 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.829+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:56.848 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.840+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.901+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T12:14:56.976 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.969+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:56.994 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.987+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:57.006 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:56.998+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:57.056 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.048+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T12:14:57.112 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.104+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:57.127 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.120+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:57.136 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.128+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:57.180 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.172+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T12:14:57.257 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.249+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:57.291 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.283+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:57.314 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.306+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:57.382 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.374+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T12:14:57.449 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.442+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:57.473 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.465+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.478+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:57.535 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.528+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T12:14:57.615 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.607+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:57.681 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.673+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:57.697 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.690+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:57.763 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.755+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T12:14:57.834 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.826+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:57.853 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.846+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.855+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:57.898 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.891+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T12:14:57.981 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:57.973+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.011 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.004+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:58.026 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.019+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.068+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T12:14:58.131 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.124+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.153 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.146+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.159+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.216+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T12:14:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.275+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.290+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:58.306 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.299+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.378+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T12:14:58.441 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.434+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.450+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:58.467 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.460+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.507 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.499+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T12:14:58.556 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.549+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.568+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:58.588 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.580+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.625 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.617+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T12:14:58.664 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.657+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.679 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.672+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:58.690 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.682+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.722 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.714+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T12:14:58.806 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.799+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.829+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:58.852 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.844+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.903 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.895+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T12:14:58.978 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.970+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:58.994 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.987+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:59.003 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:58.995+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.049+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T12:14:59.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.096+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.120 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.113+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:59.130 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.122+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.179 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.172+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T12:14:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.262+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.304 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.297+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:59.316 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.308+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.357 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.349+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T12:14:59.404 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.396+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.422 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.415+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:59.431 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.423+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.462 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.455+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T12:14:59.529 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.521+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.543+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:59.562 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.554+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.603+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T12:14:59.683 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.676+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.696+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:59.715 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.708+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.764 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.756+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T12:14:59.837 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.830+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.852+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.863+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.928 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.920+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T12:14:59.970 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.962+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:14:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.978+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:14:59.994 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:14:59.986+0000 7f9dd3887ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:00.093 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.085+0000 7f9dd3887ec0 20 remove_watcher() i=0 2019-12-09T12:15:00.093 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.085+0000 7f9dd3887ec0 2 removed watcher, disabling cache 2019-12-09T12:15:00.136 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.128+0000 7f9dd3887ec0 20 remove_watcher() i=1 2019-12-09T12:15:00.164 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.157+0000 7f9dd3887ec0 20 remove_watcher() i=2 2019-12-09T12:15:00.222 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.213+0000 7f9dd3887ec0 20 remove_watcher() i=3 2019-12-09T12:15:00.268 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.260+0000 7f9dd3887ec0 20 remove_watcher() i=4 2019-12-09T12:15:00.326 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.318+0000 7f9dd3887ec0 20 remove_watcher() i=5 2019-12-09T12:15:00.383 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.375+0000 7f9dd3887ec0 20 remove_watcher() i=6 2019-12-09T12:15:00.444 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.437+0000 7f9dd3887ec0 20 remove_watcher() i=7 2019-12-09T12:15:00.451 INFO:teuthology.orchestra.run.smithi146:> radosgw-admin gc process --include-all 2019-12-09T12:15:00.582 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.575+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.604 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.597+0000 7f8febb2eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:00.604 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.597+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.612 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.605+0000 7f8febb2eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:00.612 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.605+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.610+0000 7f8febb2eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.610+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.626 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.618+0000 7f8febb2eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.813+0000 7f8febb2eec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T12:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.813+0000 7f8febb2eec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T12:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.813+0000 7f8febb2eec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.813+0000 7f8febb2eec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.813+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.829 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.821+0000 7f8febb2eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:00.829 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.821+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.829+0000 7f8febb2eec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:00.839 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.829+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.837+0000 7f8febb2eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.837+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.861 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.853+0000 7f8febb2eec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:00.861 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.853+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.865 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.857+0000 7f8febb2eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:00.865 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.857+0000 7f8febb2eec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:15:00.865 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.857+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.870 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.862+0000 7f8febb2eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:00.870 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.862+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.870+0000 7f8febb2eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.870+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.895 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.887+0000 7f8febb2eec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:00.895 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.887+0000 7f8febb2eec0 20 zonegroup default 2019-12-09T12:15:00.895 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.887+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.900 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.892+0000 7f8febb2eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:00.900 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.892+0000 7f8febb2eec0 10 Cannot find current period zone using local zone 2019-12-09T12:15:00.900 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.892+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.906 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.899+0000 7f8febb2eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:00.907 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.899+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.915 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.908+0000 7f8febb2eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:00.916 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.908+0000 7f8febb2eec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:00.924 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.916+0000 7f8febb2eec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:00.924 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.916+0000 7f8febb2eec0 20 zone default found 2019-12-09T12:15:00.924 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.916+0000 7f8febb2eec0 20 started sync module instance, tier type = 2019-12-09T12:15:00.924 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:00.916+0000 7f8febb2eec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T12:15:01.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:01.294+0000 7f8febb2eec0 20 add_watcher() i=0 2019-12-09T12:15:01.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:01.294+0000 7f8febb2eec0 20 add_watcher() i=1 2019-12-09T12:15:01.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:01.294+0000 7f8febb2eec0 20 add_watcher() i=2 2019-12-09T12:15:01.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:01.294+0000 7f8febb2eec0 20 add_watcher() i=3 2019-12-09T12:15:01.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:01.294+0000 7f8febb2eec0 20 add_watcher() i=4 2019-12-09T12:15:01.303 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:01.294+0000 7f8febb2eec0 20 add_watcher() i=5 2019-12-09T12:15:01.303 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:01.294+0000 7f8febb2eec0 20 add_watcher() i=6 2019-12-09T12:15:01.339 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:01.331+0000 7f8febb2eec0 20 add_watcher() i=7 2019-12-09T12:15:01.340 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:01.331+0000 7f8febb2eec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:15:01.340 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:01.332+0000 7f8fa97e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:15:01.345 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:01.338+0000 7f8fd9559700 0 -- 172.21.15.146:0/3488488862 >> v1:172.21.15.194:6789/0 conn(0x55fb75e686a0 legacy=0x55fb75e67a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-09T12:15:01.388 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:01.380+0000 7f8fd8557700 0 -- 172.21.15.146:0/501730051 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x55fb75ea4400 msgr2=0x55fb75ea6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:15:03.125 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.117+0000 7f8f1b7fe700 20 reqs_thread_entry: start 2019-12-09T12:15:03.125 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.117+0000 7f8f197fa700 20 reqs_thread_entry: start 2019-12-09T12:15:03.126 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.117+0000 7f8febb2eec0 20 init_complete bucket index max shards: 0 2019-12-09T12:15:03.126 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.118+0000 7f8f077fe700 20 reqs_thread_entry: start 2019-12-09T12:15:03.126 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.118+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T12:15:03.188 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.180+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.214 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.206+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:03.231 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.223+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.294 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.287+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T12:15:03.362 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.355+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.383 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.375+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:03.393 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.385+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.423 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.415+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T12:15:03.553 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.546+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.586 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.579+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:03.604 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.597+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.665 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.657+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T12:15:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.744+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.765+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:03.787 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.779+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.831 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.824+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T12:15:03.889 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.881+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.904 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.897+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:03.912 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.905+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.958 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:03.951+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T12:15:04.007 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.000+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.023 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.016+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:04.033 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.025+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.068 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.060+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T12:15:04.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.100+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.123 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.115+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:04.131 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.123+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.177 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.170+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T12:15:04.225 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.217+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.239 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.231+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:04.248 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.240+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.270+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T12:15:04.369 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.362+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.397 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.390+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:04.412 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.405+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.460 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.452+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T12:15:04.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.523+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.557 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.550+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:04.570 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.562+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.636 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.629+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T12:15:04.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.696+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.723 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.715+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.733+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.793+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T12:15:04.857 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.849+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.877 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.869+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.880+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.942 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.934+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T12:15:04.985 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.977+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.003 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:04.995+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.008+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.047 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.039+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T12:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.091+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.109+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.128 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.120+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.177 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.169+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T12:15:05.233 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.225+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.250 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.242+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.261 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.253+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.349 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.341+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T12:15:05.426 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.418+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.447 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.439+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.458 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.450+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.505+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T12:15:05.578 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.570+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.608 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.600+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.617 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.610+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.647 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.639+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T12:15:05.692 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.684+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.712+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.729 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.722+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.767 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.759+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T12:15:05.822 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.814+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.838 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.830+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.838+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.893 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.886+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T12:15:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.953+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.981 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.973+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.992 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:05.984+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.040+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T12:15:06.123 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.115+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.143 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.136+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:06.158 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.150+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.203 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.195+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T12:15:06.274 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.266+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.304 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.296+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:06.321 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.313+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.381 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.372+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T12:15:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.440+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.472 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.465+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:06.485 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.477+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.521 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.514+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T12:15:06.559 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.551+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.569+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:06.589 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.581+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.613+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T12:15:06.691 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.683+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.721 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.713+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:06.739 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.731+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.787 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.779+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T12:15:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.867+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.891 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.883+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:06.902 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.894+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.939 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:06.932+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T12:15:07.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.008+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.037 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.029+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:07.048 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.041+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.096 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.088+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T12:15:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.177+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.219 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.212+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:07.235 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.227+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.286 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.278+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T12:15:07.335 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.327+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.343+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:07.360 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.352+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.489 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.482+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T12:15:07.564 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.556+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.583 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.576+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:07.592 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.585+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.633+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T12:15:07.732 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.724+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.756+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.770+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.836 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.828+0000 7f8febb2eec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T12:15:07.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.887+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.923 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.915+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:07.936 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:07.928+0000 7f8febb2eec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.033+0000 7f8febb2eec0 20 remove_watcher() i=0 2019-12-09T12:15:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.033+0000 7f8febb2eec0 2 removed watcher, disabling cache 2019-12-09T12:15:08.071 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.064+0000 7f8febb2eec0 20 remove_watcher() i=1 2019-12-09T12:15:08.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.101+0000 7f8febb2eec0 20 remove_watcher() i=2 2019-12-09T12:15:08.157 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.150+0000 7f8febb2eec0 20 remove_watcher() i=3 2019-12-09T12:15:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.199+0000 7f8febb2eec0 20 remove_watcher() i=4 2019-12-09T12:15:08.253 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.245+0000 7f8febb2eec0 20 remove_watcher() i=5 2019-12-09T12:15:08.285 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.277+0000 7f8febb2eec0 20 remove_watcher() i=6 2019-12-09T12:15:08.317 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.310+0000 7f8febb2eec0 20 remove_watcher() i=7 2019-12-09T12:15:08.327 INFO:teuthology.orchestra.run.smithi146:> radosgw-admin gc process --include-all 2019-12-09T12:15:08.456 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.448+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.469+0000 7f4ab2940ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:08.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.469+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.487 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.479+0000 7f4ab2940ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:08.487 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.479+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.492 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.485+0000 7f4ab2940ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:08.492 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.485+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.501 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.494+0000 7f4ab2940ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:08.673 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.666+0000 7f4ab2940ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T12:15:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.666+0000 7f4ab2940ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T12:15:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.666+0000 7f4ab2940ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:15:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.666+0000 7f4ab2940ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:15:08.674 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.666+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.684 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.676+0000 7f4ab2940ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:08.684 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.676+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.685+0000 7f4ab2940ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:08.694 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.685+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.695+0000 7f4ab2940ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.695+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.720 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.712+0000 7f4ab2940ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:08.720 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.712+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.726 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.718+0000 7f4ab2940ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:08.726 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.718+0000 7f4ab2940ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:15:08.726 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.718+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.731 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.723+0000 7f4ab2940ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:08.731 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.723+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.731+0000 7f4ab2940ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.731+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.748 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.741+0000 7f4ab2940ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.741+0000 7f4ab2940ec0 20 zonegroup default 2019-12-09T12:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.741+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.752 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.745+0000 7f4ab2940ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:08.752 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.745+0000 7f4ab2940ec0 10 Cannot find current period zone using local zone 2019-12-09T12:15:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.745+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.756 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.748+0000 7f4ab2940ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:08.756 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.748+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.764 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.757+0000 7f4ab2940ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:08.765 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.757+0000 7f4ab2940ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:08.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.771+0000 7f4ab2940ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:08.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.771+0000 7f4ab2940ec0 20 zone default found 2019-12-09T12:15:08.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.771+0000 7f4ab2940ec0 20 started sync module instance, tier type = 2019-12-09T12:15:08.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:08.771+0000 7f4ab2940ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T12:15:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:09.112+0000 7f4ab2940ec0 20 add_watcher() i=0 2019-12-09T12:15:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:09.112+0000 7f4ab2940ec0 20 add_watcher() i=1 2019-12-09T12:15:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:09.112+0000 7f4ab2940ec0 20 add_watcher() i=2 2019-12-09T12:15:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:09.112+0000 7f4ab2940ec0 20 add_watcher() i=3 2019-12-09T12:15:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:09.112+0000 7f4ab2940ec0 20 add_watcher() i=4 2019-12-09T12:15:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:09.112+0000 7f4ab2940ec0 20 add_watcher() i=5 2019-12-09T12:15:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:09.112+0000 7f4ab2940ec0 20 add_watcher() i=6 2019-12-09T12:15:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:09.146+0000 7f4ab2940ec0 20 add_watcher() i=7 2019-12-09T12:15:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:09.146+0000 7f4ab2940ec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:15:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:09.146+0000 7f49f3fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:15:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:09.149+0000 7f4aa036b700 0 -- 172.21.15.146:0/3075964559 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55d8c4422670 msgr2=0x55d8c4421a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T12:15:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:09.178+0000 7f4aa036b700 0 -- 172.21.15.146:0/3029319726 >> v2:172.21.15.194:3300/0 conn(0x55d8c4415910 msgr2=0x55d8c443f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:15:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.534+0000 7f49de7fc700 20 reqs_thread_entry: start 2019-12-09T12:15:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.534+0000 7f49d7fff700 20 reqs_thread_entry: start 2019-12-09T12:15:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.534+0000 7f4ab2940ec0 20 init_complete bucket index max shards: 0 2019-12-09T12:15:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.535+0000 7f49d67fc700 20 reqs_thread_entry: start 2019-12-09T12:15:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.535+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T12:15:10.594 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.587+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.603+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:10.623 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.615+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.653+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T12:15:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.700+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.719+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.727+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.771+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T12:15:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.820+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:10.850 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.843+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.854+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:10.905 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.897+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T12:15:10.961 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.953+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.968+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:10.986 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:10.978+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.008+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T12:15:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.089+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.119+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:11.140 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.132+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.183 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.176+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T12:15:11.353 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.345+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.374+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.390+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.438 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.431+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T12:15:11.480 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.473+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.489+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:11.505 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.498+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.537+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T12:15:11.649 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.641+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.657+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.666+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.709 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.701+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T12:15:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.757+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.773+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:11.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.781+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.808+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T12:15:11.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.851+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.878 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.870+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:11.886 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.879+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:11.922+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T12:15:12.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.009+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.055 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.047+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:12.073 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.065+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.157 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.149+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T12:15:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.242+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.282 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.275+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:12.307 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.299+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.371 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.363+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T12:15:12.441 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.433+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.456+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:12.478 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.470+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.511+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T12:15:12.586 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.579+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.596+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:12.616 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.609+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.649 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.642+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T12:15:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.681+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.697+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:12.713 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.705+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.749 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.741+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T12:15:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.804+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.832 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.824+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:12.844 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.837+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.913 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.905+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T12:15:12.965 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.957+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:12.983 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.975+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:12.999 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:12.991+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.060 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.052+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T12:15:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.105+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.120+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:13.136 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.129+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.175+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T12:15:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.215+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.238 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.230+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.238+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.274 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.267+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T12:15:13.316 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.308+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.332 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.324+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:13.340 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.332+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.446 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.438+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T12:15:13.518 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.511+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.527+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:13.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.536+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.605 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.597+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T12:15:13.672 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.665+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.697 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.689+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:13.709 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.701+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.765 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.758+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T12:15:13.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.816+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.844 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.836+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:13.855 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.847+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:13.896 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.888+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T12:15:13.986 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:13.977+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.021 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.013+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.032+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.086+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T12:15:14.168 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.160+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.181+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:14.204 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.197+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.240 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.231+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T12:15:14.290 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.282+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.302+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.311+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.356 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.348+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T12:15:14.438 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.431+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.471 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.463+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:14.489 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.481+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.539+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T12:15:14.625 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.618+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.645 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.637+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.645+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.694 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.686+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T12:15:14.737 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.729+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.752 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.744+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:14.759 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.751+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.784+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T12:15:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.842+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.878 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.869+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.885+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:14.946 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.939+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T12:15:14.997 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:14.989+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.015 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.007+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:15.026 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.019+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.059 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.051+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T12:15:15.150 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.142+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.187+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:15.210 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.202+0000 7f4ab2940ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.382 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.374+0000 7f4ab2940ec0 20 remove_watcher() i=0 2019-12-09T12:15:15.382 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.374+0000 7f4ab2940ec0 2 removed watcher, disabling cache 2019-12-09T12:15:15.447 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.439+0000 7f4ab2940ec0 20 remove_watcher() i=1 2019-12-09T12:15:15.495 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.476+0000 7f4ab2940ec0 20 remove_watcher() i=2 2019-12-09T12:15:15.548 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.541+0000 7f4ab2940ec0 20 remove_watcher() i=3 2019-12-09T12:15:15.621 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.613+0000 7f4ab2940ec0 20 remove_watcher() i=4 2019-12-09T12:15:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.679+0000 7f4ab2940ec0 20 remove_watcher() i=5 2019-12-09T12:15:15.753 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.745+0000 7f4ab2940ec0 20 remove_watcher() i=6 2019-12-09T12:15:15.808 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:15:15.801+0000 7f4ab2940ec0 20 remove_watcher() i=7 2019-12-09T12:15:15.815 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2019-12-09T12:15:16.424 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :clean 2019-12-09T12:15:17.122 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :compileJava 2019-12-09T12:15:17.123 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :processResources 2019-12-09T12:15:17.123 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :classes 2019-12-09T12:15:17.423 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:17.423 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :compileTestJava 2019-12-09T12:15:17.423 INFO:teuthology.orchestra.run.smithi146.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-12-09T12:15:17.424 INFO:teuthology.orchestra.run.smithi146.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-12-09T12:15:17.424 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:17.424 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :processTestResources NO-SOURCE 2019-12-09T12:15:17.424 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :testClasses 2019-12-09T12:15:20.223 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:20.223 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :test 2019-12-09T12:15:20.223 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:20.223 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2019-12-09T12:15:21.922 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:21.923 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2019-12-09T12:15:27.222 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:27.223 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2019-12-09T12:15:30.222 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:30.223 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2019-12-09T12:15:36.922 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:36.922 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2019-12-09T12:15:39.422 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:39.422 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2019-12-09T12:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:44.622 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2019-12-09T12:15:53.622 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:53.623 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2019-12-09T12:15:55.222 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:55.223 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2019-12-09T12:15:58.522 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:15:58.549 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2019-12-09T12:16:05.922 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:16:05.922 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2019-12-09T12:16:07.022 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:16:07.022 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2019-12-09T12:16:08.122 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:16:08.123 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2019-12-09T12:16:13.222 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:16:13.223 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2019-12-09T12:16:26.322 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:16:26.323 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2019-12-09T12:16:28.622 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:16:28.623 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2019-12-09T12:16:35.122 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:16:35.122 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2019-12-09T12:16:35.222 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:16:35.222 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2019-12-09T12:16:36.222 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:16:36.222 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------- 2019-12-09T12:16:36.222 INFO:teuthology.orchestra.run.smithi146.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2019-12-09T12:16:36.223 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------- 2019-12-09T12:16:36.223 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:16:36.223 INFO:teuthology.orchestra.run.smithi146.stdout:BUILD SUCCESSFUL in 1m 20s 2019-12-09T12:16:36.223 INFO:teuthology.orchestra.run.smithi146.stdout:5 actionable tasks: 5 executed 2019-12-09T12:16:36.227 INFO:teuthology.orchestra.run.smithi146:> radosgw-admin gc process --include-all 2019-12-09T12:16:36.379 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.370+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.410 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.401+0000 7fa03011aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:36.410 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.401+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.419 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.410+0000 7fa03011aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:36.419 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.410+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.415+0000 7fa03011aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:36.425 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.415+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.435 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.426+0000 7fa03011aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:36.640 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.632+0000 7fa03011aec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T12:16:36.641 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.632+0000 7fa03011aec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T12:16:36.641 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.632+0000 7fa03011aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:16:36.641 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.632+0000 7fa03011aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:16:36.641 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.632+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.662 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.647+0000 7fa03011aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.647+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.662+0000 7fa03011aec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:16:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.662+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.692 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.683+0000 7fa03011aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:36.693 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.683+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.704+0000 7fa03011aec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:16:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.704+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.721 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.712+0000 7fa03011aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:36.721 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.712+0000 7fa03011aec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:16:36.721 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.712+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.727 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.719+0000 7fa03011aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:36.728 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.719+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.743 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.735+0000 7fa03011aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:36.744 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.735+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.751+0000 7fa03011aec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:16:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.751+0000 7fa03011aec0 20 zonegroup default 2019-12-09T12:16:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.751+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.769 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.761+0000 7fa03011aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.761+0000 7fa03011aec0 10 Cannot find current period zone using local zone 2019-12-09T12:16:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.761+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.776 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.767+0000 7fa03011aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:36.776 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.767+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.785 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.777+0000 7fa03011aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:36.786 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.777+0000 7fa03011aec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.787+0000 7fa03011aec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:16:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.787+0000 7fa03011aec0 20 zone default found 2019-12-09T12:16:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.787+0000 7fa03011aec0 20 started sync module instance, tier type = 2019-12-09T12:16:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:36.787+0000 7fa03011aec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T12:16:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:37.203+0000 7fa03011aec0 20 add_watcher() i=0 2019-12-09T12:16:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:37.203+0000 7fa03011aec0 20 add_watcher() i=1 2019-12-09T12:16:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:37.203+0000 7fa03011aec0 20 add_watcher() i=2 2019-12-09T12:16:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:37.203+0000 7fa03011aec0 20 add_watcher() i=3 2019-12-09T12:16:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:37.203+0000 7fa03011aec0 20 add_watcher() i=4 2019-12-09T12:16:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:37.203+0000 7fa03011aec0 20 add_watcher() i=5 2019-12-09T12:16:37.244 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:37.235+0000 7fa03011aec0 20 add_watcher() i=6 2019-12-09T12:16:37.258 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:37.247+0000 7fa03011aec0 20 add_watcher() i=7 2019-12-09T12:16:37.258 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:37.247+0000 7fa03011aec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:16:37.258 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:37.247+0000 7f9fedfdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:16:37.259 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:37.250+0000 7fa01db45700 0 -- >> v2:172.21.15.194:3300/0 conn(0x55bb7dbd2360 msgr2=0x55bb7dbe7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-09T12:16:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:37.303+0000 7fa01d344700 0 -- 172.21.15.146:0/275922006 >> [v2:172.21.15.146:6800/9590,v1:172.21.15.146:6801/9590] conn(0x7f9f600224c0 msgr2=0x7f9f60024990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:16:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:38.826+0000 7f9f5ffff700 20 reqs_thread_entry: start 2019-12-09T12:16:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:38.827+0000 7f9f5dffb700 20 reqs_thread_entry: start 2019-12-09T12:16:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:38.827+0000 7fa03011aec0 20 init_complete bucket index max shards: 0 2019-12-09T12:16:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:38.827+0000 7f9f4bfff700 20 reqs_thread_entry: start 2019-12-09T12:16:38.837 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:38.827+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T12:16:38.897 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:38.882+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:38.910 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:38.901+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:38.923 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:38.914+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:38.956+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T12:16:39.085 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.077+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.109+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:39.128 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.120+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.175 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.166+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T12:16:39.243 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.234+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.270 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.261+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:39.285 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.277+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.348 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.339+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T12:16:39.408 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.399+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.423+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:39.443 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.434+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.493 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.485+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T12:16:39.560 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.551+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.582 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.574+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:39.594 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.586+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.629 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.620+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T12:16:39.670 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.662+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.677+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:39.698 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.685+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.724 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.715+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T12:16:39.778 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.769+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.791 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.783+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:39.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.792+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.852 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.843+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T12:16:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.906+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:39.938 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.929+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.942+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.003 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:39.994+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T12:16:40.064 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.055+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.075+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:40.096 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.087+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.141 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.132+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T12:16:40.184 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.175+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.199 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.190+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:40.208 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.199+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.236+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T12:16:40.288 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.279+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.303 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.294+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:40.311 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.303+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.339 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.331+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T12:16:40.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.394+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.414+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.424+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.480 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.471+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T12:16:40.565 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.556+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.593 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.585+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:40.607 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.599+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.662 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.653+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T12:16:40.730 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.721+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.751 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.743+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:40.764 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.756+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.797 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.788+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T12:16:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.860+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.896 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.887+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:40.906 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.898+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:40.949 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:40.940+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T12:16:41.009 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.000+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.026 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.017+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:41.034 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.026+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.065 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.056+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T12:16:41.107 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.098+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.126 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.117+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:41.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.128+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.168 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.159+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T12:16:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.254+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.325 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.316+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.334+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.378+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T12:16:41.447 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.439+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.466 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.457+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:41.476 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.468+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.509+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T12:16:41.580 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.571+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.600 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.590+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.600+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.661 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.652+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T12:16:41.753 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.744+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.779+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:41.806 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.797+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.857 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.848+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T12:16:41.905 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.895+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.922 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.914+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:41.937 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.928+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:41.975 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:41.967+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T12:16:42.024 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.015+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.032+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:42.055 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.046+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.107 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.098+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T12:16:42.175 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.166+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.215 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.206+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:42.231 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.222+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.293+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T12:16:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.343+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.368 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.359+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:42.381 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.373+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.424 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.415+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T12:16:42.517 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.508+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.546 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.537+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:42.568 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.559+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.615 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.607+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T12:16:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.657+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.683 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.675+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:42.692 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.684+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.712+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T12:16:42.804 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.795+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.845 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.829+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:42.855 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.846+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.902+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T12:16:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.970+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:42.998 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.989+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:42.998+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:43.060 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.051+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T12:16:43.111 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.102+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.122+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:43.140 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.132+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:43.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.169+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T12:16:43.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.214+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:43.244 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.235+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:43.255 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.246+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:43.287 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.278+0000 7fa03011aec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T12:16:43.333 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.324+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:43.352 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.344+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:43.361 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.353+0000 7fa03011aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:43.488 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.479+0000 7fa03011aec0 20 remove_watcher() i=0 2019-12-09T12:16:43.489 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.479+0000 7fa03011aec0 2 removed watcher, disabling cache 2019-12-09T12:16:43.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.535+0000 7fa03011aec0 20 remove_watcher() i=1 2019-12-09T12:16:43.590 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.582+0000 7fa03011aec0 20 remove_watcher() i=2 2019-12-09T12:16:43.700 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.691+0000 7fa03011aec0 20 remove_watcher() i=3 2019-12-09T12:16:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.730+0000 7fa03011aec0 20 remove_watcher() i=4 2019-12-09T12:16:43.786 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.777+0000 7fa03011aec0 20 remove_watcher() i=5 2019-12-09T12:16:43.827 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.818+0000 7fa03011aec0 20 remove_watcher() i=6 2019-12-09T12:16:43.867 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.858+0000 7fa03011aec0 20 remove_watcher() i=7 2019-12-09T12:16:43.874 INFO:teuthology.orchestra.run.smithi146:> radosgw-admin gc process --include-all 2019-12-09T12:16:43.989 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:43.980+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.008+0000 7ff5c4f32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:44.017 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.008+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.028 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.019+0000 7ff5c4f32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:44.029 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.019+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.035 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.026+0000 7ff5c4f32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:44.035 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.026+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.052 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.043+0000 7ff5c4f32ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.170+0000 7ff5c4f32ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T12:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.170+0000 7ff5c4f32ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T12:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.170+0000 7ff5c4f32ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:16:44.180 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.170+0000 7ff5c4f32ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:16:44.180 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.170+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.187 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.178+0000 7ff5c4f32ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:44.187 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.178+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.195 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.186+0000 7ff5c4f32ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:16:44.195 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.186+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.202 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.193+0000 7ff5c4f32ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:44.202 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.193+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.218 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.210+0000 7ff5c4f32ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:16:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.210+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.214+0000 7ff5c4f32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:44.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.214+0000 7ff5c4f32ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:16:44.224 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.214+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.228 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.219+0000 7ff5c4f32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:44.228 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.219+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.226+0000 7ff5c4f32ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.226+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.255 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.246+0000 7ff5c4f32ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:16:44.255 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.246+0000 7ff5c4f32ec0 20 zonegroup default 2019-12-09T12:16:44.255 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.246+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.251+0000 7ff5c4f32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.251+0000 7ff5c4f32ec0 10 Cannot find current period zone using local zone 2019-12-09T12:16:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.251+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.264 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.255+0000 7ff5c4f32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:44.264 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.256+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.263+0000 7ff5c4f32ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.263+0000 7ff5c4f32ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:44.280 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.271+0000 7ff5c4f32ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:16:44.280 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.271+0000 7ff5c4f32ec0 20 zone default found 2019-12-09T12:16:44.280 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.271+0000 7ff5c4f32ec0 20 started sync module instance, tier type = 2019-12-09T12:16:44.280 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.271+0000 7ff5c4f32ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T12:16:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.694+0000 7ff5c4f32ec0 20 add_watcher() i=0 2019-12-09T12:16:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.694+0000 7ff5c4f32ec0 20 add_watcher() i=1 2019-12-09T12:16:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.694+0000 7ff5c4f32ec0 20 add_watcher() i=2 2019-12-09T12:16:44.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.694+0000 7ff5c4f32ec0 20 add_watcher() i=3 2019-12-09T12:16:44.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.694+0000 7ff5c4f32ec0 20 add_watcher() i=4 2019-12-09T12:16:44.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.694+0000 7ff5c4f32ec0 20 add_watcher() i=5 2019-12-09T12:16:44.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.694+0000 7ff5c4f32ec0 20 add_watcher() i=6 2019-12-09T12:16:44.748 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.739+0000 7ff5c4f32ec0 20 add_watcher() i=7 2019-12-09T12:16:44.748 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.739+0000 7ff5c4f32ec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:16:44.749 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.739+0000 7ff582fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:16:44.753 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.744+0000 7ff5b295d700 0 -- 172.21.15.146:0/3232928601 >> v1:172.21.15.194:6789/0 conn(0x5619417842d0 legacy=0x561941796ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:16:44.790 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:44.781+0000 7ff5abfff700 0 -- 172.21.15.146:0/2367510252 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x5619417cd080 msgr2=0x5619417cf4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T12:16:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.368+0000 7ff4f17fa700 20 reqs_thread_entry: start 2019-12-09T12:16:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.368+0000 7ff4eaffd700 20 reqs_thread_entry: start 2019-12-09T12:16:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.368+0000 7ff5c4f32ec0 20 init_complete bucket index max shards: 0 2019-12-09T12:16:46.378 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.369+0000 7ff4e97fa700 20 reqs_thread_entry: start 2019-12-09T12:16:46.378 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.369+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T12:16:46.426 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.417+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:46.443 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.434+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:46.453 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.444+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.481+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T12:16:46.542 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.533+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:46.563 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.554+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.565+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.603+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T12:16:46.650 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.641+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.661+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:46.681 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.672+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:46.715 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.703+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T12:16:46.793 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.784+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.817+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.836+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:46.908 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.899+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T12:16:46.992 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:46.984+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.026 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.017+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.034+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.086+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T12:16:47.144 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.135+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.165 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.156+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:47.174 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.166+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.214+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T12:16:47.278 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.269+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.294+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:47.325 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.316+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.364+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T12:16:47.427 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.418+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.440+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:47.461 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.452+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.488+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T12:16:47.591 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.581+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.613 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.604+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:47.624 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.616+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.670 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.662+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T12:16:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.743+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.771+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.786+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.828+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T12:16:47.897 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.889+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.915 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.907+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:47.924 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.915+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:47.961 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:47.952+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T12:16:48.052 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.041+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:48.085 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.076+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:48.107 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.098+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:48.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.170+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T12:16:48.237 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.228+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.250+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:48.277 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.268+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.319+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T12:16:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.525+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:48.560 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.551+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.568+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:48.619 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.608+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T12:16:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.665+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.683+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:48.701 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.693+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:48.744 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.735+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T12:16:48.822 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.813+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:48.840 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.831+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:48.848 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.839+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:48.909 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.900+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T12:16:48.963 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.954+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:48.984 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.970+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:48.987 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:48.979+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.048+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T12:16:49.110 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.102+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.127 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.118+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:49.135 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.126+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.153+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T12:16:49.203 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.194+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.219 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.210+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:49.228 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.219+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.274 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.265+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T12:16:49.354 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.345+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.389 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.380+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:49.404 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.395+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.464 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.455+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T12:16:49.537 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.529+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.562 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.553+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.570+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.620+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T12:16:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.697+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.733 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.724+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:49.747 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.738+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.792+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T12:16:49.862 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.853+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.873+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.884+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.929 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.921+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T12:16:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.966+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:49.996 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:49.987+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:50.008 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.000+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.044 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.035+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T12:16:50.101 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.092+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.118 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.109+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:50.128 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.120+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.167 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.158+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T12:16:50.217 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.208+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.231 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.223+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:50.241 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.232+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.293+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T12:16:50.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.341+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.365 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.356+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:50.373 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.364+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.421 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.412+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T12:16:50.475 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.465+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.491 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.483+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:50.500 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.491+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.524+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T12:16:50.577 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.568+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.635 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.626+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:50.648 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.639+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.687 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.678+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T12:16:50.762 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.754+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.787 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.778+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:50.794 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.785+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.848+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T12:16:50.951 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.942+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:50.979 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.970+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:51.001 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:50.992+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:51.052 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.043+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T12:16:51.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.094+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.118+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:51.136 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.127+0000 7ff5c4f32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:51.246 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.237+0000 7ff5c4f32ec0 20 remove_watcher() i=0 2019-12-09T12:16:51.247 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.237+0000 7ff5c4f32ec0 2 removed watcher, disabling cache 2019-12-09T12:16:51.299 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.290+0000 7ff5c4f32ec0 20 remove_watcher() i=1 2019-12-09T12:16:51.342 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.333+0000 7ff5c4f32ec0 20 remove_watcher() i=2 2019-12-09T12:16:51.416 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.407+0000 7ff5c4f32ec0 20 remove_watcher() i=3 2019-12-09T12:16:51.457 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.447+0000 7ff5c4f32ec0 20 remove_watcher() i=4 2019-12-09T12:16:51.516 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.507+0000 7ff5c4f32ec0 20 remove_watcher() i=5 2019-12-09T12:16:51.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.567+0000 7ff5c4f32ec0 20 remove_watcher() i=6 2019-12-09T12:16:51.634 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.625+0000 7ff5c4f32ec0 20 remove_watcher() i=7 2019-12-09T12:16:51.642 INFO:teuthology.orchestra.run.smithi146:> radosgw-admin gc process --include-all 2019-12-09T12:16:51.760 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.751+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:51.783 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.774+0000 7f60831a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:51.783 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.774+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:51.792 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.783+0000 7f60831a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:51.792 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.783+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:51.797 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.788+0000 7f60831a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:51.797 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.788+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:51.806 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.797+0000 7f60831a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.992+0000 7f60831a8ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T12:16:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.992+0000 7f60831a8ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T12:16:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.992+0000 7f60831a8ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:16:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.992+0000 7f60831a8ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:16:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:51.992+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:52.011 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.002+0000 7f60831a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:52.011 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.002+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:52.020 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.011+0000 7f60831a8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:16:52.021 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.011+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:52.029 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.020+0000 7f60831a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:52.029 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.020+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:52.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.032+0000 7f60831a8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:16:52.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.032+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:52.046 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.037+0000 7f60831a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:52.046 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.037+0000 7f60831a8ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:16:52.046 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.037+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:52.051 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.042+0000 7f60831a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:52.051 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.042+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.052+0000 7f60831a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.052+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:52.074 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.066+0000 7f60831a8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:16:52.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.066+0000 7f60831a8ec0 20 zonegroup default 2019-12-09T12:16:52.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.066+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:52.089 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.080+0000 7f60831a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:52.089 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.080+0000 7f60831a8ec0 10 Cannot find current period zone using local zone 2019-12-09T12:16:52.090 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.080+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:52.093 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.084+0000 7f60831a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:52.093 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.084+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.092+0000 7f60831a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.092+0000 7f60831a8ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:52.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.099+0000 7f60831a8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:16:52.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.099+0000 7f60831a8ec0 20 zone default found 2019-12-09T12:16:52.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.099+0000 7f60831a8ec0 20 started sync module instance, tier type = 2019-12-09T12:16:52.109 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.099+0000 7f60831a8ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T12:16:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.484+0000 7f60831a8ec0 20 add_watcher() i=0 2019-12-09T12:16:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.484+0000 7f60831a8ec0 20 add_watcher() i=1 2019-12-09T12:16:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.484+0000 7f60831a8ec0 20 add_watcher() i=2 2019-12-09T12:16:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.484+0000 7f60831a8ec0 20 add_watcher() i=3 2019-12-09T12:16:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.484+0000 7f60831a8ec0 20 add_watcher() i=4 2019-12-09T12:16:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.484+0000 7f60831a8ec0 20 add_watcher() i=5 2019-12-09T12:16:52.496 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.484+0000 7f60831a8ec0 20 add_watcher() i=6 2019-12-09T12:16:52.521 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.512+0000 7f60831a8ec0 20 add_watcher() i=7 2019-12-09T12:16:52.521 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.512+0000 7f60831a8ec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:16:52.521 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.512+0000 7f6040fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:16:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.514+0000 7f606fbd1700 0 -- 172.21.15.146:0/2783058690 >> v2:172.21.15.194:3300/0 conn(0x5591ba6c0fc0 msgr2=0x5591ba6ea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-09T12:16:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:52.541+0000 7f6070bd3700 0 -- 172.21.15.146:0/3460680991 >> v2:172.21.15.194:3300/0 conn(0x5591ba6b6ff0 msgr2=0x5591ba6b6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:16:53.986 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:53.978+0000 7f5fb2ffd700 20 reqs_thread_entry: start 2019-12-09T12:16:53.986 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:53.978+0000 7f5fb0ff9700 20 reqs_thread_entry: start 2019-12-09T12:16:53.986 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:53.978+0000 7f60831a8ec0 20 init_complete bucket index max shards: 0 2019-12-09T12:16:53.986 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:53.978+0000 7f5fa6ffd700 20 reqs_thread_entry: start 2019-12-09T12:16:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:53.978+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T12:16:54.040 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.032+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.059 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.052+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:54.069 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.061+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.100+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T12:16:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.144+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.160+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.170+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.216 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.201+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T12:16:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.286+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.340 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.331+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:54.354 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.346+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.405 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.397+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T12:16:54.478 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.471+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.504 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.496+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:54.518 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.510+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.557 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.549+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T12:16:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.616+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.632+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:54.648 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.640+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.701 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.694+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T12:16:54.777 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.769+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.793+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:54.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.808+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.851+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T12:16:54.904 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.897+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.923 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.915+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:54.936 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.928+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:54.972 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:54.964+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T12:16:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.026+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.041+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.050+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.105 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.097+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T12:16:55.180 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.172+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.202 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.195+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:55.227 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.219+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.303+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T12:16:55.367 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.359+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.385 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.377+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.386+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.432+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T12:16:55.495 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.487+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.522 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.514+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:55.534 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.526+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.586 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.578+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T12:16:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.641+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.663+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:55.682 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.674+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.728 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.720+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T12:16:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.791+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.822 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.814+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:55.834 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.827+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.881 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.873+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T12:16:55.946 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.937+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:55.979 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.972+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:55.993 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:55.985+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.051 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.043+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T12:16:56.103 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.095+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.123 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.115+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:56.132 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.124+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.171 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.163+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T12:16:56.236 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.228+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.269 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.259+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:56.277 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.270+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.314 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.305+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T12:16:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.348+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.371 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.364+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:56.380 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.372+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.415 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.406+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T12:16:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.448+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.473 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.465+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:56.484 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.475+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.529 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.514+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T12:16:56.609 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.600+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.628+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:56.653 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.645+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.713 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.700+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T12:16:56.782 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.774+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.798+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:56.817 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.810+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.851+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T12:16:56.933 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.925+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.942+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:56.969 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:56.962+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.008 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.000+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T12:16:57.053 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.045+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.074 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.066+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:57.107 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.099+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.151 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.144+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T12:16:57.196 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.188+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.214 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.206+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:57.222 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.214+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.259 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.251+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T12:16:57.328 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.320+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.343 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.335+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:57.352 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.344+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.395 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.387+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T12:16:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.444+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.459+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.468+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.513 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.505+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T12:16:57.566 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.558+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.582 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.574+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:57.591 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.583+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.640 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.632+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T12:16:57.691 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.683+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.706+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:57.730 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.722+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.777 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.769+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T12:16:57.820 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.812+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.836 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.828+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.836+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.869+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T12:16:57.942 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.934+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:57.961 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.953+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:57.970 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:57.962+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:58.013 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.005+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T12:16:58.104 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.097+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:58.136 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.128+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:58.151 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.144+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:58.197 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.189+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T12:16:58.241 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.233+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.251+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:58.274 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.262+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.291+0000 7f60831a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T12:16:58.369 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.361+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:58.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.394+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:16:58.420 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.411+0000 7f60831a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:16:58.512 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.504+0000 7f60831a8ec0 20 remove_watcher() i=0 2019-12-09T12:16:58.513 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.504+0000 7f60831a8ec0 2 removed watcher, disabling cache 2019-12-09T12:16:58.552 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.544+0000 7f60831a8ec0 20 remove_watcher() i=1 2019-12-09T12:16:58.591 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.583+0000 7f60831a8ec0 20 remove_watcher() i=2 2019-12-09T12:16:58.662 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.654+0000 7f60831a8ec0 20 remove_watcher() i=3 2019-12-09T12:16:58.723 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.715+0000 7f60831a8ec0 20 remove_watcher() i=4 2019-12-09T12:16:58.783 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.775+0000 7f60831a8ec0 20 remove_watcher() i=5 2019-12-09T12:16:58.844 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.836+0000 7f60831a8ec0 20 remove_watcher() i=6 2019-12-09T12:16:58.906 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:58.898+0000 7f60831a8ec0 20 remove_watcher() i=7 2019-12-09T12:16:58.916 INFO:teuthology.orchestra.run.smithi146:> radosgw-admin gc process --include-all 2019-12-09T12:16:59.078 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.069+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.149 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.140+0000 7fd353ca7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:59.149 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.140+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.157 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.149+0000 7fd353ca7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:59.157 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.149+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.153+0000 7fd353ca7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.153+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.169 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.161+0000 7fd353ca7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:59.582 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.574+0000 7fd353ca7ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T12:16:59.582 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.574+0000 7fd353ca7ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T12:16:59.582 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.574+0000 7fd353ca7ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:16:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.574+0000 7fd353ca7ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:16:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.574+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.596 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.588+0000 7fd353ca7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:59.596 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.588+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.601+0000 7fd353ca7ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:16:59.613 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.601+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.618 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.609+0000 7fd353ca7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:59.618 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.609+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.637 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.629+0000 7fd353ca7ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:16:59.638 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.630+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.647 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.639+0000 7fd353ca7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:59.647 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.639+0000 7fd353ca7ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:16:59.647 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.639+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.656 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.648+0000 7fd353ca7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:59.657 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.648+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.665 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.657+0000 7fd353ca7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:59.665 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.657+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.687 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.679+0000 7fd353ca7ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:16:59.687 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.679+0000 7fd353ca7ec0 20 zonegroup default 2019-12-09T12:16:59.687 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.679+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.693 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.685+0000 7fd353ca7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:59.693 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.685+0000 7fd353ca7ec0 10 Cannot find current period zone using local zone 2019-12-09T12:16:59.694 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.685+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.696+0000 7fd353ca7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:16:59.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.696+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.714 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.706+0000 7fd353ca7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:16:59.714 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.706+0000 7fd353ca7ec0 20 rados->read ofs=0 len=0 2019-12-09T12:16:59.728 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.714+0000 7fd353ca7ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:16:59.728 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.714+0000 7fd353ca7ec0 20 zone default found 2019-12-09T12:16:59.728 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.714+0000 7fd353ca7ec0 20 started sync module instance, tier type = 2019-12-09T12:16:59.729 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:16:59.714+0000 7fd353ca7ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T12:17:00.100 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:00.092+0000 7fd353ca7ec0 20 add_watcher() i=0 2019-12-09T12:17:00.100 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:00.092+0000 7fd353ca7ec0 20 add_watcher() i=1 2019-12-09T12:17:00.101 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:00.092+0000 7fd353ca7ec0 20 add_watcher() i=2 2019-12-09T12:17:00.101 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:00.092+0000 7fd353ca7ec0 20 add_watcher() i=3 2019-12-09T12:17:00.101 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:00.092+0000 7fd353ca7ec0 20 add_watcher() i=4 2019-12-09T12:17:00.101 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:00.092+0000 7fd353ca7ec0 20 add_watcher() i=5 2019-12-09T12:17:00.124 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:00.116+0000 7fd353ca7ec0 20 add_watcher() i=6 2019-12-09T12:17:00.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:00.154+0000 7fd353ca7ec0 20 add_watcher() i=7 2019-12-09T12:17:00.163 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:00.154+0000 7fd353ca7ec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:17:00.163 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:00.154+0000 7fd3117e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:17:00.177 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:00.169+0000 7fd340ed1700 0 -- 172.21.15.146:0/3322732150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5589dcdad030 msgr2=0x5589dcd96960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:17:00.201 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:00.193+0000 7fd340ed1700 0 -- 172.21.15.146:0/3080491521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5589dcd75f70 msgr2=0x5589dcdba590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:17:01.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.535+0000 7fd2817fa700 20 reqs_thread_entry: start 2019-12-09T12:17:01.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.535+0000 7fd2837fe700 20 reqs_thread_entry: start 2019-12-09T12:17:01.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.535+0000 7fd353ca7ec0 20 init_complete bucket index max shards: 0 2019-12-09T12:17:01.544 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.536+0000 7fd26b7fe700 20 reqs_thread_entry: start 2019-12-09T12:17:01.544 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.536+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T12:17:01.603 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.595+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:01.620 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.612+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:01.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.624+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.671+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T12:17:01.751 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.743+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:01.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.781+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:01.809 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.801+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.863+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T12:17:01.912 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.904+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:01.929 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.921+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:01.937 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.929+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:01.968 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:01.960+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T12:17:02.055 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.048+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.086+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:02.110 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.102+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.164 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.156+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T12:17:02.210 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.202+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.230 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.222+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:02.239 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.231+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.294 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.286+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T12:17:02.346 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.338+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.366 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.359+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:02.382 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.374+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.412+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T12:17:02.467 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.460+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.484+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:02.507 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.500+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.545 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.537+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T12:17:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.590+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.619 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.611+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:02.637 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.629+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.683 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.673+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T12:17:02.738 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.730+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.758 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.750+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:02.770 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.762+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.810 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.802+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T12:17:02.877 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.869+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.901 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.893+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.902+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:02.974 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:02.966+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T12:17:03.019 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.011+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.037 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.029+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:03.048 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.040+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.076+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T12:17:03.145 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.132+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.169 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.161+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:03.185 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.177+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.236 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.228+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T12:17:03.285 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.277+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.302 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.294+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:03.312 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.304+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.353 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.344+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T12:17:03.408 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.400+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.431 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.423+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:03.441 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.433+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.467+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T12:17:03.525 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.513+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.536 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.528+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.540+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.612 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.604+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T12:17:03.676 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.668+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.690+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:03.711 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.703+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.748 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.740+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T12:17:03.823 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.815+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.847 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.839+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.850+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.903 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.895+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T12:17:03.961 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.953+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:03.986 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.978+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:04.002 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:03.994+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.053 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.045+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T12:17:04.147 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.139+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.180 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.172+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:04.188 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.180+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.239 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.231+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T12:17:04.282 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.274+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.300 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.293+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:04.312 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.304+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.351 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.343+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T12:17:04.391 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.383+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.411 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.404+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:04.420 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.413+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.452 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.444+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T12:17:04.486 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.479+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.502 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.494+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:04.510 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.503+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.535+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T12:17:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.614+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.654 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.646+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:04.668 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.660+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.709 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.701+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T12:17:04.758 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.750+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.786 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.778+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:04.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.793+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.843 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.835+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T12:17:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.880+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.895+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:04.912 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.904+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:04.959 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.951+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T12:17:05.004 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:04.996+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.023 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.015+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.029+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.076 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.068+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T12:17:05.131 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.123+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.138+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:05.154 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.146+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.188 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.180+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T12:17:05.239 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.231+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.255 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.247+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:05.265 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.257+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.314 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.306+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T12:17:05.375 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.367+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.391 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.383+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.391+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.452 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.444+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T12:17:05.508 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.500+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.515+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:05.532 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.524+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.573 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.565+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T12:17:05.616 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.608+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.634 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.626+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:05.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.635+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.677 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.669+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T12:17:05.716 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.708+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.730 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.723+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:17:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.732+0000 7fd353ca7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:17:05.845 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.837+0000 7fd353ca7ec0 20 remove_watcher() i=0 2019-12-09T12:17:05.845 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.837+0000 7fd353ca7ec0 2 removed watcher, disabling cache 2019-12-09T12:17:05.894 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.887+0000 7fd353ca7ec0 20 remove_watcher() i=1 2019-12-09T12:17:05.940 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.932+0000 7fd353ca7ec0 20 remove_watcher() i=2 2019-12-09T12:17:05.997 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:05.990+0000 7fd353ca7ec0 20 remove_watcher() i=3 2019-12-09T12:17:06.042 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:06.034+0000 7fd353ca7ec0 20 remove_watcher() i=4 2019-12-09T12:17:06.096 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:06.087+0000 7fd353ca7ec0 20 remove_watcher() i=5 2019-12-09T12:17:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:06.148+0000 7fd353ca7ec0 20 remove_watcher() i=6 2019-12-09T12:17:06.209 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T12:17:06.201+0000 7fd353ca7ec0 20 remove_watcher() i=7 2019-12-09T12:17:06.217 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2019-12-09T12:17:06.741 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :clean 2019-12-09T12:17:07.338 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :compileJava 2019-12-09T12:17:07.338 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :processResources 2019-12-09T12:17:07.338 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :classes 2019-12-09T12:17:07.539 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:17:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :compileTestJava 2019-12-09T12:17:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-12-09T12:17:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-12-09T12:17:07.540 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:17:07.540 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :processTestResources NO-SOURCE 2019-12-09T12:17:07.540 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :testClasses 2019-12-09T12:17:10.138 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:17:10.138 INFO:teuthology.orchestra.run.smithi146.stdout:> Task :test 2019-12-09T12:17:10.138 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:17:10.138 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2019-12-09T12:17:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:17:14.838 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2019-12-09T12:17:24.038 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:17:24.038 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2019-12-09T12:17:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:17:28.038 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2019-12-09T12:17:35.838 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:17:35.838 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2019-12-09T12:17:38.438 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:17:38.438 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2019-12-09T12:17:41.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:17:41.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2019-12-09T12:18:26.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:18:26.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2019-12-09T12:18:32.838 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:18:32.838 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2019-12-09T12:18:35.238 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:18:35.238 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2019-12-09T12:18:39.538 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:18:39.538 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2019-12-09T12:18:44.238 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:18:44.238 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2019-12-09T12:18:51.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:18:51.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2019-12-09T12:18:52.038 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:18:52.038 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2019-12-09T12:18:52.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:18:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2019-12-09T12:18:54.240 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:18:54.241 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2019-12-09T12:18:58.738 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:18:58.738 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2019-12-09T12:19:09.241 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:13:30.294 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:19:09.250 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:13:30.303 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:19:09.268 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:13:30.321 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:19:09.271 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:13:30.324 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:19:09.279 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:13:30.317 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:19:09.303 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:13:30.340 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:19:09.444 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:13:30.497 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:19:09.505 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:13:30.558 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:19:09.560 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:13:30.597 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:19:37.238 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:19:37.238 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2019-12-09T12:19:44.238 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:19:44.238 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2019-12-09T12:19:49.538 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:19:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2019-12-09T12:19:58.138 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:19:58.138 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2019-12-09T12:20:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:20:01.338 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2019-12-09T12:20:09.738 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:20:09.738 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2019-12-09T12:20:11.838 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:20:11.838 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2019-12-09T12:20:17.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:20:17.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2019-12-09T12:20:20.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:20:20.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2019-12-09T12:20:28.038 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:20:28.038 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2019-12-09T12:20:29.638 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:20:29.639 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2019-12-09T12:20:35.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:20:35.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2019-12-09T12:20:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:20:39.338 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2019-12-09T12:20:44.638 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:20:44.638 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2019-12-09T12:20:50.138 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:20:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2019-12-09T12:20:57.638 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:20:57.638 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2019-12-09T12:21:47.138 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:21:47.139 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2019-12-09T12:22:01.922 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:16:22.974 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:22:01.928 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:16:22.980 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:22:01.938 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:16:22.990 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:22:01.942 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:16:22.994 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:22:01.977 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:16:23.013 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:22:01.989 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:16:23.026 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:22:02.016 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:16:23.068 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:22:02.073 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:16:23.125 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:22:02.149 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:16:23.186 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:22:02.538 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:22:02.538 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2019-12-09T12:24:19.390 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:18:40.442 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:24:19.397 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:18:40.449 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:24:19.406 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:18:40.456 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:24:19.409 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:18:40.461 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:24:19.419 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:18:40.456 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:24:19.429 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:18:40.466 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:24:19.527 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:18:40.579 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:24:19.540 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:18:40.592 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:24:19.559 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:18:40.597 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:26:34.638 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:26:34.639 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2019-12-09T12:26:49.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:26:49.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2019-12-09T12:26:51.840 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:26:51.840 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2019-12-09T12:26:56.538 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:26:56.538 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2019-12-09T12:27:02.838 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:27:02.838 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2019-12-09T12:27:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:27:13.038 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2019-12-09T12:27:50.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:27:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2019-12-09T12:27:57.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:27:57.338 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2019-12-09T12:27:57.538 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:27:57.538 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2019-12-09T12:27:58.038 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:27:58.038 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2019-12-09T12:28:41.899 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T12:28:41.792+0000 9c730700 -1 handle_data failed with exit code -104 2019-12-09T12:28:42.938 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:28:42.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2019-12-09T12:28:49.037 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:28:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2019-12-09T12:29:31.489 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:23:52.541 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:29:31.492 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:23:52.545 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:29:31.504 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:23:52.557 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:29:31.509 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:23:52.562 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:29:31.517 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:23:52.555 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:29:31.522 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:23:52.560 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:29:31.682 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:23:52.735 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:29:31.683 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:23:52.736 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:29:31.736 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:23:52.773 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:29:41.641 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:29:41.641 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2019-12-09T12:29:52.537 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:29:52.538 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2019-12-09T12:30:23.227 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:24:44.280 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:30:23.240 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:24:44.293 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:30:23.244 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:24:44.297 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:30:23.265 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:24:44.318 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:30:23.305 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:24:44.358 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:30:23.314 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:24:44.352 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:30:23.320 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:24:44.358 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:30:23.321 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:24:44.374 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:30:23.369 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:24:44.407 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:30:47.638 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:30:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2019-12-09T12:30:57.437 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:30:57.438 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2019-12-09T12:34:41.663 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:29:02.717 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:34:41.681 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:29:02.716 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:34:41.681 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:29:02.724 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:34:41.682 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:29:02.736 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:34:41.685 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:29:02.723 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:34:41.689 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:29:02.743 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:34:41.825 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:29:02.879 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:34:41.853 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:29:02.907 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:34:41.872 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:29:02.910 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:36:50.736 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:36:50.743 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2019-12-09T12:36:58.236 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:36:58.236 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2019-12-09T12:38:20.950 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:38:20.999 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2019-12-09T12:38:29.135 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:38:29.136 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2019-12-09T12:38:44.724 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:33:05.778 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:38:44.767 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:33:05.821 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:38:44.803 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:33:05.841 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:38:44.809 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:33:05.847 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:38:44.822 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:33:05.876 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:38:44.842 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:33:05.897 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:38:44.875 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:33:05.930 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:38:44.938 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:33:05.977 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:38:44.952 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:33:06.007 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:39:40.536 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:39:40.537 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2019-12-09T12:39:48.436 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:39:48.436 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2019-12-09T12:39:50.378 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:34:11.432 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:39:50.383 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:34:11.438 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:39:50.386 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:34:11.441 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:39:50.389 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:34:11.444 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:39:50.391 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:34:11.430 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:39:50.394 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:34:11.432 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:39:50.442 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:34:11.496 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:39:50.512 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:34:11.506 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:39:50.513 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:34:11.517 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:40:00.036 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:40:00.036 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2019-12-09T12:40:15.936 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:40:15.937 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2019-12-09T12:40:17.136 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:40:17.136 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2019-12-09T12:40:23.035 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:40:23.036 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative STARTED 2019-12-09T12:40:26.236 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:40:26.236 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative PASSED 2019-12-09T12:40:42.336 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:40:42.337 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2019-12-09T12:40:47.135 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:40:47.136 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2019-12-09T12:41:04.335 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:41:04.336 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2019-12-09T12:41:09.935 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:41:09.936 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2019-12-09T12:41:41.135 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:41:41.136 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2019-12-09T12:41:51.935 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:41:51.936 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2019-12-09T12:42:28.035 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:42:28.036 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2019-12-09T12:42:38.237 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:42:38.237 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2019-12-09T12:43:21.435 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:43:21.436 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2019-12-09T12:43:27.736 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:43:27.736 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2019-12-09T12:44:37.635 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:44:37.636 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2019-12-09T12:44:57.436 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:44:57.436 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2019-12-09T12:45:03.979 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:39:25.033 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:45:03.990 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:39:25.045 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:45:03.995 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:39:25.050 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:45:03.997 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:39:25.035 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:45:03.998 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:39:25.053 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:45:04.001 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:39:25.040 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:45:04.186 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:39:25.240 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:45:04.198 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:39:25.253 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:45:04.212 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:39:25.250 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:45:52.535 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:45:52.536 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2019-12-09T12:46:01.005 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:40:22.060 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:46:01.019 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:40:22.074 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:46:01.065 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:40:22.120 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:46:01.106 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:40:22.160 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:46:01.125 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:40:22.164 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:46:01.132 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:40:22.171 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:46:01.136 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:40:22.191 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:46:01.205 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:40:22.244 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:46:01.214 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:40:22.263 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:03.136 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:47:03.144 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2019-12-09T12:47:06.201 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:41:27.255 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:06.226 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:41:27.280 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:06.240 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:41:27.295 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:06.246 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:41:27.300 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:06.285 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:41:27.339 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:06.287 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:41:27.326 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:06.297 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:41:27.336 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:06.298 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:41:27.352 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:06.368 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:41:27.407 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:48:10.636 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:48:10.637 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2019-12-09T12:49:21.036 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:49:21.037 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2019-12-09T12:50:14.122 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:44:35.176 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:50:14.126 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:44:35.180 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:50:14.140 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:44:35.191 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:50:14.142 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:44:35.196 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:50:14.152 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:44:35.190 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:50:14.179 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:44:35.219 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:50:14.247 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:44:35.298 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:50:14.268 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:44:35.322 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:50:14.362 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:44:35.401 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:51:59.636 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:51:59.640 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2019-12-09T12:53:50.037 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:53:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2019-12-09T12:55:26.238 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:49:47.291 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:26.248 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:49:47.299 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:26.256 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:49:47.309 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:26.260 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:49:47.312 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:26.264 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:49:47.304 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:26.276 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:49:47.316 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:26.433 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:49:47.487 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:26.437 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:49:47.491 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:26.545 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:49:47.585 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:27.744 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:49:48.797 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:27.771 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:49:48.786 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:27.775 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:49:48.829 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:27.785 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:49:48.839 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:27.798 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:49:48.837 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:27.822 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:49:48.862 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:27.848 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:49:48.901 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:27.852 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:49:48.905 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:55:27.902 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:49:48.956 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T12:57:18.537 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T12:57:18.538 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2019-12-09T13:00:13.438 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:00:13.439 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2019-12-09T13:00:34.608 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:54:55.661 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:34.615 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:54:55.667 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:34.626 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:54:55.678 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:34.630 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:54:55.683 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:34.632 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:54:55.672 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:34.637 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:54:55.678 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:34.786 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:54:55.839 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:34.859 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:54:55.911 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:34.878 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:54:55.919 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:03:49.063 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:58:10.115 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:03:49.096 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:58:10.149 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:03:49.134 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:58:10.186 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:03:49.135 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:58:10.188 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:03:49.177 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:58:10.217 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:03:49.181 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:58:10.221 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:03:49.197 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:01:58:10.250 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:03:49.250 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:01:58:10.302 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:03:49.273 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:01:58:10.314 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:05:46.593 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:00:07.645 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:05:46.599 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:00:07.652 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:05:46.612 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:00:07.652 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:05:46.612 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:00:07.664 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:05:46.614 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:00:07.667 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:05:46.615 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:00:07.656 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:05:46.687 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:00:07.738 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:05:46.707 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:00:07.760 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:05:46.711 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:00:07.751 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:06:00.638 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:06:00.638 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2019-12-09T13:07:58.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:07:58.862 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2019-12-09T13:10:58.768 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:05:19.821 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:10:58.785 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:05:19.827 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:10:58.785 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:05:19.835 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:10:58.786 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:05:19.839 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:10:58.799 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:05:19.839 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:10:58.809 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:05:19.849 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:10:58.960 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:05:20.013 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:10:58.993 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:05:20.046 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:10:59.121 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:05:20.161 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:11:05.437 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:11:05.437 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2019-12-09T13:12:10.587 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:06:31.640 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:12:10.616 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:06:31.669 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:12:10.669 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:06:31.709 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:12:10.680 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:06:31.711 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:12:10.685 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:06:31.737 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:12:10.685 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:06:31.738 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:12:10.701 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:06:31.754 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:12:10.734 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:06:31.773 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:12:10.749 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:06:31.802 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:13:03.037 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:13:03.038 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2019-12-09T13:14:36.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:14:36.840 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2019-12-09T13:15:48.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:15:48.838 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2019-12-09T13:16:08.869 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:10:29.922 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:16:08.882 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:10:29.935 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:16:08.887 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:10:29.940 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:16:08.894 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:10:29.947 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:16:08.900 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:10:29.936 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:16:08.903 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:10:29.941 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:16:09.021 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:10:30.070 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:16:09.036 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:10:30.089 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:16:09.091 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:10:30.130 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:16:50.937 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:16:50.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2019-12-09T13:17:07.137 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:17:07.138 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2019-12-09T13:17:18.537 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:17:18.537 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2019-12-09T13:17:25.737 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:17:25.737 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2019-12-09T13:17:36.937 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:17:36.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2019-12-09T13:17:44.337 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:17:44.338 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2019-12-09T13:17:54.637 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:17:54.638 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2019-12-09T13:18:02.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:18:02.838 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2019-12-09T13:18:12.637 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:18:12.692 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2019-12-09T13:18:17.237 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:18:17.238 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2019-12-09T13:18:24.538 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:18:24.538 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2019-12-09T13:18:30.638 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:18:30.638 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2019-12-09T13:18:37.737 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:18:37.737 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2019-12-09T13:18:46.737 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:18:46.738 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2019-12-09T13:18:56.537 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:18:56.537 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2019-12-09T13:19:04.937 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:19:04.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2019-12-09T13:19:17.037 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:19:17.037 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2019-12-09T13:19:25.137 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:19:25.137 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2019-12-09T13:19:37.438 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:19:37.438 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2019-12-09T13:19:44.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:19:44.338 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2019-12-09T13:19:56.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:19:56.837 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2019-12-09T13:20:03.838 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:20:03.838 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2019-12-09T13:20:15.237 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:20:15.237 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2019-12-09T13:20:22.937 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:20:22.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2019-12-09T13:20:31.976 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:14:53.029 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:20:31.998 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:14:53.051 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:20:32.006 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:14:53.059 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:20:32.019 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:14:53.072 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:20:32.041 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:14:53.080 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:20:32.044 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:14:53.083 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:20:32.121 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:14:53.174 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:20:32.170 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:14:53.223 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:20:32.230 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:14:53.269 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:20:35.037 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:20:35.037 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2019-12-09T13:20:41.037 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:20:41.038 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2019-12-09T13:20:51.437 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:20:51.438 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2019-12-09T13:20:57.637 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:20:57.638 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2019-12-09T13:21:06.337 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:21:06.338 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2019-12-09T13:21:14.438 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:21:14.438 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2019-12-09T13:21:20.274 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:15:41.327 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:21:20.281 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:15:41.334 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:21:20.287 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:15:41.340 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:21:20.289 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:15:41.342 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:21:20.290 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:15:41.329 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:21:20.304 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:15:41.343 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:21:20.334 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:15:41.387 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:21:20.335 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:15:41.388 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:21:20.389 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:15:41.428 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:21:21.537 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:21:21.538 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2019-12-09T13:21:25.237 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:21:25.238 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2019-12-09T13:21:33.045 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:21:33.045 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2019-12-09T13:21:35.437 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:21:35.438 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2019-12-09T13:21:43.241 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:21:43.241 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2019-12-09T13:21:48.937 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:21:48.938 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2019-12-09T13:21:57.041 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:21:57.041 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2019-12-09T13:22:00.738 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:00.738 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2019-12-09T13:22:07.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:07.838 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2019-12-09T13:22:15.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:15.338 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2019-12-09T13:22:21.537 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:21.538 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2019-12-09T13:22:22.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:22.338 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2019-12-09T13:22:23.537 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:23.538 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2019-12-09T13:22:29.237 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:29.238 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2019-12-09T13:22:37.337 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:37.338 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2019-12-09T13:22:40.638 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:40.638 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2019-12-09T13:22:48.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:48.838 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2019-12-09T13:22:51.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2019-12-09T13:22:57.237 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:57.238 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2019-12-09T13:22:59.337 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:22:59.338 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2019-12-09T13:23:07.237 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:23:07.238 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent STARTED 2019-12-09T13:23:10.838 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:23:10.838 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent PASSED 2019-12-09T13:23:19.038 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:23:19.038 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2019-12-09T13:24:15.137 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:24:15.138 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2019-12-09T13:24:23.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:24:23.837 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI STARTED 2019-12-09T13:25:03.537 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:25:03.538 INFO:teuthology.orchestra.run.smithi146.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI PASSED 2019-12-09T13:25:13.137 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:25:13.138 INFO:teuthology.orchestra.run.smithi146.stdout:---------------------------------------------------------------------- 2019-12-09T13:25:13.138 INFO:teuthology.orchestra.run.smithi146.stdout:| Results: SUCCESS (72 tests, 72 successes, 0 failures, 0 skipped) | 2019-12-09T13:25:13.139 INFO:teuthology.orchestra.run.smithi146.stdout:---------------------------------------------------------------------- 2019-12-09T13:25:13.139 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:25:13.139 INFO:teuthology.orchestra.run.smithi146.stdout:BUILD SUCCESSFUL in 1h 8m 6s 2019-12-09T13:25:13.139 INFO:teuthology.orchestra.run.smithi146.stdout:5 actionable tasks: 5 executed 2019-12-09T13:25:13.153 INFO:teuthology.orchestra.run.smithi146:> radosgw-admin gc process --include-all 2019-12-09T13:25:13.291 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.282+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.312 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.305+0000 7f982a093ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:13.313 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.305+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.321+0000 7f982a093ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.321+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.335 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.327+0000 7f982a093ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:13.335 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.327+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.335+0000 7f982a093ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.503+0000 7f982a093ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T13:25:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.503+0000 7f982a093ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T13:25:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.503+0000 7f982a093ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T13:25:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.503+0000 7f982a093ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T13:25:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.503+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.513+0000 7f982a093ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.513+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.530 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.522+0000 7f982a093ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:13.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.522+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.546 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.531+0000 7f982a093ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:13.546 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.531+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.550+0000 7f982a093ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.550+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.565 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.557+0000 7f982a093ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:13.566 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.557+0000 7f982a093ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T13:25:13.566 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.557+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.571 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.563+0000 7f982a093ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:13.571 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.563+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.572+0000 7f982a093ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.572+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.599 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.591+0000 7f982a093ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:13.600 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.591+0000 7f982a093ec0 20 zonegroup default 2019-12-09T13:25:13.600 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.591+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.606 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.598+0000 7f982a093ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:13.606 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.598+0000 7f982a093ec0 10 Cannot find current period zone using local zone 2019-12-09T13:25:13.606 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.598+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.614 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.604+0000 7f982a093ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:13.615 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.604+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.614+0000 7f982a093ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.614+0000 7f982a093ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:13.630 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.622+0000 7f982a093ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:13.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.622+0000 7f982a093ec0 20 zone default found 2019-12-09T13:25:13.635 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.622+0000 7f982a093ec0 20 started sync module instance, tier type = 2019-12-09T13:25:13.636 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:13.622+0000 7f982a093ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T13:25:14.055 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:14.046+0000 7f982a093ec0 20 add_watcher() i=0 2019-12-09T13:25:14.055 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:14.046+0000 7f982a093ec0 20 add_watcher() i=1 2019-12-09T13:25:14.055 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:14.046+0000 7f982a093ec0 20 add_watcher() i=2 2019-12-09T13:25:14.056 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:14.046+0000 7f982a093ec0 20 add_watcher() i=3 2019-12-09T13:25:14.056 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:14.046+0000 7f982a093ec0 20 add_watcher() i=4 2019-12-09T13:25:14.056 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:14.046+0000 7f982a093ec0 20 add_watcher() i=5 2019-12-09T13:25:14.056 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:14.046+0000 7f982a093ec0 20 add_watcher() i=6 2019-12-09T13:25:14.092 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:14.084+0000 7f982a093ec0 20 add_watcher() i=7 2019-12-09T13:25:14.092 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:14.084+0000 7f982a093ec0 2 all 8 watchers are set, enabling cache 2019-12-09T13:25:14.093 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:14.084+0000 7f97e7fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T13:25:14.097 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:14.090+0000 7f9817abe700 0 -- 172.21.15.146:0/3369294008 >> v1:172.21.15.194:6789/0 conn(0x5628b8ab7be0 legacy=0x5628b8ab6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T13:25:14.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:14.129+0000 7f98172bd700 0 -- 172.21.15.146:0/4093448194 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x5628b8af1220 msgr2=0x5628b8af3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T13:25:15.803 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:15.795+0000 7f97567fc700 20 reqs_thread_entry: start 2019-12-09T13:25:15.804 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:15.796+0000 7f974ffff700 20 reqs_thread_entry: start 2019-12-09T13:25:15.804 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:15.796+0000 7f982a093ec0 20 init_complete bucket index max shards: 0 2019-12-09T13:25:15.805 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:15.797+0000 7f974e7fc700 20 reqs_thread_entry: start 2019-12-09T13:25:15.805 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:15.797+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T13:25:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:15.871+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:15.911 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:15.901+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:15.919+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:15.990 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:15.981+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T13:25:16.044 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.036+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:16.063 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.055+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:16.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.067+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.109+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T13:25:16.189 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.174+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.191+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.205+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T13:25:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.205+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1068', time=2019-12-09T14:19:39.419092+0000, chain.objs.size()=2 2019-12-09T13:25:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.205+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.56__shadow_.vKeTSGF1Tno04uboihXQ_hz4_alVNBI_1 2019-12-09T13:25:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.205+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.56__shadow_.vKeTSGF1Tno04uboihXQ_hz4_alVNBI_2 2019-12-09T13:25:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.346+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:16.464 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.457+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T13:25:16.510 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.502+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:16.528 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.520+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:16.539 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.531+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:16.571 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.563+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T13:25:16.623 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.615+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:16.640 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.633+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.642+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.678+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T13:25:16.755 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.747+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:16.774 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.766+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:16.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T13:25:16.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1308', time=2019-12-09T14:33:11.908734+0000, chain.objs.size()=9 2019-12-09T13:25:16.796 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~yXDsAJdFxUFSJ1VJ7S-NrSUpGc8n0Y7.1 2019-12-09T13:25:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~yXDsAJdFxUFSJ1VJ7S-NrSUpGc8n0Y7.1_1 2019-12-09T13:25:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~yXDsAJdFxUFSJ1VJ7S-NrSUpGc8n0Y7.2 2019-12-09T13:25:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~yXDsAJdFxUFSJ1VJ7S-NrSUpGc8n0Y7.2_1 2019-12-09T13:25:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~yXDsAJdFxUFSJ1VJ7S-NrSUpGc8n0Y7.3 2019-12-09T13:25:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~yXDsAJdFxUFSJ1VJ7S-NrSUpGc8n0Y7.3_1 2019-12-09T13:25:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~yXDsAJdFxUFSJ1VJ7S-NrSUpGc8n0Y7.4 2019-12-09T13:25:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~yXDsAJdFxUFSJ1VJ7S-NrSUpGc8n0Y7.4_1 2019-12-09T13:25:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~yXDsAJdFxUFSJ1VJ7S-NrSUpGc8n0Y7.5 2019-12-09T13:25:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1367', time=2019-12-09T14:39:42.003604+0000, chain.objs.size()=9 2019-12-09T13:25:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.77__multipart_key1.2~08eD9ZCthp8tzA6s0V7Avt8vRfeMtt9.1 2019-12-09T13:25:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.77__shadow_key1.2~08eD9ZCthp8tzA6s0V7Avt8vRfeMtt9.1_1 2019-12-09T13:25:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:16.785+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.77__multipart_key1.2~08eD9ZCthp8tzA6s0V7Avt8vRfeMtt9.2 2019-12-09T13:25:17.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.086+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.77__shadow_key1.2~08eD9ZCthp8tzA6s0V7Avt8vRfeMtt9.2_1 2019-12-09T13:25:17.212 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.201+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.77__multipart_key1.2~08eD9ZCthp8tzA6s0V7Avt8vRfeMtt9.3 2019-12-09T13:25:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.201+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.77__shadow_key1.2~08eD9ZCthp8tzA6s0V7Avt8vRfeMtt9.3_1 2019-12-09T13:25:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.201+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.77__multipart_key1.2~08eD9ZCthp8tzA6s0V7Avt8vRfeMtt9.4 2019-12-09T13:25:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.201+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.77__shadow_key1.2~08eD9ZCthp8tzA6s0V7Avt8vRfeMtt9.4_1 2019-12-09T13:25:17.237 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.201+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.77__multipart_key1.2~08eD9ZCthp8tzA6s0V7Avt8vRfeMtt9.5 2019-12-09T13:25:17.613 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.605+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:17.726 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.718+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T13:25:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.760+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.776+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.785+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:17.831 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.824+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T13:25:17.891 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.883+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:17.910 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.902+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.911+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:17.951 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:17.944+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T13:25:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.027+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.062+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T13:25:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~NX878kth62I_cydA3WBwwS9ulYMkdWD', time=2019-12-09T14:40:11.269189+0000, chain.objs.size()=22 2019-12-09T13:25:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.1 2019-12-09T13:25:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.2 2019-12-09T13:25:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.3 2019-12-09T13:25:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.4 2019-12-09T13:25:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.5 2019-12-09T13:25:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.6 2019-12-09T13:25:18.109 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.7 2019-12-09T13:25:18.109 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.8 2019-12-09T13:25:18.109 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.9 2019-12-09T13:25:18.109 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.10 2019-12-09T13:25:18.109 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.099+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.11 2019-12-09T13:25:18.110 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.100+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.12 2019-12-09T13:25:18.542 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.534+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.agPSeyhcastIK7aIqYSB93pq4F-tjs3.13 2019-12-09T13:25:18.583 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.575+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.ettyIwSGe-Q5JkMNsEvkZ6uKR-zdbwg.14 2019-12-09T13:25:18.583 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.575+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.R8WAXmJ8LKx5bAlVsYbvXTX_-DL1Skk.15 2019-12-09T13:25:18.583 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.575+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.fmkgVUFSfrdkus7r2KqLC3N8PZeHhj_.16 2019-12-09T13:25:18.583 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.575+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.HKr7z_xAoOgOvgRN1dB5XPLjNiGJH5X.17 2019-12-09T13:25:18.583 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.575+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.YX3Es54vvOEiB9jP_0RvPfrikCTC891.18 2019-12-09T13:25:18.584 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.575+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.CBl4SwwyRcwsW6kYnWqaM8quFG8lVvL.19 2019-12-09T13:25:18.584 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.575+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.qCxZsWjZaj3BnBRJrtmd06o3P7-Prdr.20 2019-12-09T13:25:18.679 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.670+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.22 2019-12-09T13:25:18.679 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.670+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.78__multipart_key1.2~NX878kth62I_cydA3WBwwS9ulYMkdWD.25 2019-12-09T13:25:18.980 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:18.973+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:19.081 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.073+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T13:25:19.124 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.116+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.140+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:19.160 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.152+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:19.198 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.190+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T13:25:19.269 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.258+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:19.283 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.275+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.295+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T13:25:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.295+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1253', time=2019-12-09T14:28:44.644117+0000, chain.objs.size()=9 2019-12-09T13:25:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.295+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.72__multipart_key1.2~IowFmQYN3MX-tSnzNTw4U9_V5tKTFv0.1 2019-12-09T13:25:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.295+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.72__shadow_key1.2~IowFmQYN3MX-tSnzNTw4U9_V5tKTFv0.1_1 2019-12-09T13:25:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.295+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.72__multipart_key1.2~IowFmQYN3MX-tSnzNTw4U9_V5tKTFv0.2 2019-12-09T13:25:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.295+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.72__shadow_key1.2~IowFmQYN3MX-tSnzNTw4U9_V5tKTFv0.2_1 2019-12-09T13:25:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.296+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.72__multipart_key1.2~IowFmQYN3MX-tSnzNTw4U9_V5tKTFv0.3 2019-12-09T13:25:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.296+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.72__shadow_key1.2~IowFmQYN3MX-tSnzNTw4U9_V5tKTFv0.3_1 2019-12-09T13:25:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.296+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.72__multipart_key1.2~IowFmQYN3MX-tSnzNTw4U9_V5tKTFv0.4 2019-12-09T13:25:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.296+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.72__shadow_key1.2~IowFmQYN3MX-tSnzNTw4U9_V5tKTFv0.4_1 2019-12-09T13:25:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.296+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.72__multipart_key1.2~IowFmQYN3MX-tSnzNTw4U9_V5tKTFv0.5 2019-12-09T13:25:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.296+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.2178', time=2019-12-09T15:25:06.299791+0000, chain.objs.size()=9 2019-12-09T13:25:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.296+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.119__multipart_key1/data/file.mpg.2~yEz22haui-7QngNWuV4eyZ-a45Qy3Ju.1 2019-12-09T13:25:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.296+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.119__shadow_key1/data/file.mpg.2~yEz22haui-7QngNWuV4eyZ-a45Qy3Ju.1_1 2019-12-09T13:25:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.296+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.119__multipart_key1/data/file.mpg.2~yEz22haui-7QngNWuV4eyZ-a45Qy3Ju.2 2019-12-09T13:25:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.632+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.119__shadow_key1/data/file.mpg.2~yEz22haui-7QngNWuV4eyZ-a45Qy3Ju.2_1 2019-12-09T13:25:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.632+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.119__multipart_key1/data/file.mpg.2~yEz22haui-7QngNWuV4eyZ-a45Qy3Ju.3 2019-12-09T13:25:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.632+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.119__shadow_key1/data/file.mpg.2~yEz22haui-7QngNWuV4eyZ-a45Qy3Ju.3_1 2019-12-09T13:25:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.632+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.119__multipart_key1/data/file.mpg.2~yEz22haui-7QngNWuV4eyZ-a45Qy3Ju.4 2019-12-09T13:25:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.632+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.119__shadow_key1/data/file.mpg.2~yEz22haui-7QngNWuV4eyZ-a45Qy3Ju.4_1 2019-12-09T13:25:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.632+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.119__multipart_key1/data/file.mpg.2~yEz22haui-7QngNWuV4eyZ-a45Qy3Ju.5 2019-12-09T13:25:19.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:19.913+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:20.020 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.012+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T13:25:20.057 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.049+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:20.073 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.065+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:20.088 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.076+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T13:25:20.088 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.076+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1155', time=2019-12-09T14:26:36.504815+0000, chain.objs.size()=5 2019-12-09T13:25:20.088 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.076+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.66__shadow_.3YyAmvSG5uLj3tFog1TSirighzGafPq_1 2019-12-09T13:25:20.089 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.076+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.66__shadow_.3YyAmvSG5uLj3tFog1TSirighzGafPq_2 2019-12-09T13:25:20.089 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.076+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.66__shadow_.3YyAmvSG5uLj3tFog1TSirighzGafPq_3 2019-12-09T13:25:20.089 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.076+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.66__shadow_.3YyAmvSG5uLj3tFog1TSirighzGafPq_4 2019-12-09T13:25:20.089 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.076+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.66__shadow_.3YyAmvSG5uLj3tFog1TSirighzGafPq_5 2019-12-09T13:25:20.399 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:20.512 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.504+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T13:25:20.552 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.544+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:20.569 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.561+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:20.579 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.570+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:20.622 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.615+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T13:25:20.668 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.659+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:20.687 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.679+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:20.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.695+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T13:25:20.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.695+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1179', time=2019-12-09T14:25:40.921018+0000, chain.objs.size()=9 2019-12-09T13:25:20.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.695+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~j92E5zFz8wuHUl9Cs6pXo08-B2MxVE3.1 2019-12-09T13:25:20.705 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.695+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~j92E5zFz8wuHUl9Cs6pXo08-B2MxVE3.1_1 2019-12-09T13:25:20.705 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.695+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~j92E5zFz8wuHUl9Cs6pXo08-B2MxVE3.2 2019-12-09T13:25:20.705 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.695+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~j92E5zFz8wuHUl9Cs6pXo08-B2MxVE3.2_1 2019-12-09T13:25:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.695+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~j92E5zFz8wuHUl9Cs6pXo08-B2MxVE3.3 2019-12-09T13:25:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.695+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~j92E5zFz8wuHUl9Cs6pXo08-B2MxVE3.3_1 2019-12-09T13:25:20.707 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.695+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~j92E5zFz8wuHUl9Cs6pXo08-B2MxVE3.4 2019-12-09T13:25:20.707 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.695+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~j92E5zFz8wuHUl9Cs6pXo08-B2MxVE3.4_1 2019-12-09T13:25:20.707 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.695+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~j92E5zFz8wuHUl9Cs6pXo08-B2MxVE3.5 2019-12-09T13:25:20.993 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:20.986+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:21.074 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.067+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T13:25:21.123 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.115+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.130+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:21.159 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.151+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T13:25:21.160 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.151+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.2162', time=2019-12-09T15:24:17.424976+0000, chain.objs.size()=9 2019-12-09T13:25:21.160 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.151+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.118__multipart_key1.2~2-V4fU04L_f9KfxS5_HqGiLjaxzFE_G.1 2019-12-09T13:25:21.160 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.151+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.118__shadow_key1.2~2-V4fU04L_f9KfxS5_HqGiLjaxzFE_G.1_1 2019-12-09T13:25:21.160 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.151+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.118__multipart_key1.2~2-V4fU04L_f9KfxS5_HqGiLjaxzFE_G.2 2019-12-09T13:25:21.161 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.151+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.118__shadow_key1.2~2-V4fU04L_f9KfxS5_HqGiLjaxzFE_G.2_1 2019-12-09T13:25:21.161 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.151+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.118__multipart_key1.2~2-V4fU04L_f9KfxS5_HqGiLjaxzFE_G.3 2019-12-09T13:25:21.161 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.151+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.118__shadow_key1.2~2-V4fU04L_f9KfxS5_HqGiLjaxzFE_G.3_1 2019-12-09T13:25:21.161 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.151+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.118__multipart_key1.2~2-V4fU04L_f9KfxS5_HqGiLjaxzFE_G.4 2019-12-09T13:25:21.161 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.151+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.118__shadow_key1.2~2-V4fU04L_f9KfxS5_HqGiLjaxzFE_G.4_1 2019-12-09T13:25:21.161 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.152+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.118__multipart_key1.2~2-V4fU04L_f9KfxS5_HqGiLjaxzFE_G.5 2019-12-09T13:25:21.471 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.463+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:21.563 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.555+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T13:25:21.605 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.596+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:21.623 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.611+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:21.629 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.621+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:21.661 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.651+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T13:25:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.706+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.724+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.747+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T13:25:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.747+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~hWN0FVkO7zfDZxVE2EA9dmKur5zXvBr', time=2019-12-09T14:18:26.069045+0000, chain.objs.size()=9 2019-12-09T13:25:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.747+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.52__multipart_key1.2~hWN0FVkO7zfDZxVE2EA9dmKur5zXvBr.1 2019-12-09T13:25:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.747+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.52__shadow_key1.2~hWN0FVkO7zfDZxVE2EA9dmKur5zXvBr.1_1 2019-12-09T13:25:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.747+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.52__multipart_key1.2~hWN0FVkO7zfDZxVE2EA9dmKur5zXvBr.2 2019-12-09T13:25:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.747+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.52__shadow_key1.2~hWN0FVkO7zfDZxVE2EA9dmKur5zXvBr.2_1 2019-12-09T13:25:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.747+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.52__multipart_key1.2~hWN0FVkO7zfDZxVE2EA9dmKur5zXvBr.3 2019-12-09T13:25:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.747+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.52__shadow_key1.2~hWN0FVkO7zfDZxVE2EA9dmKur5zXvBr.3_1 2019-12-09T13:25:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.747+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.52__multipart_key1.2~hWN0FVkO7zfDZxVE2EA9dmKur5zXvBr.4 2019-12-09T13:25:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.747+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.52__shadow_key1.2~hWN0FVkO7zfDZxVE2EA9dmKur5zXvBr.4_1 2019-12-09T13:25:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:21.747+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.52__multipart_key1.2~hWN0FVkO7zfDZxVE2EA9dmKur5zXvBr.5 2019-12-09T13:25:22.076 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.068+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:22.153 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.145+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T13:25:22.198 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.185+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.203+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:22.233 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T13:25:22.233 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1163', time=2019-12-09T14:24:28.204993+0000, chain.objs.size()=9 2019-12-09T13:25:22.233 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~_HTWGgoxHT-F7i0TLIcoDd79FwfEBhm.1 2019-12-09T13:25:22.234 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~_HTWGgoxHT-F7i0TLIcoDd79FwfEBhm.1_1 2019-12-09T13:25:22.234 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~_HTWGgoxHT-F7i0TLIcoDd79FwfEBhm.2 2019-12-09T13:25:22.234 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~_HTWGgoxHT-F7i0TLIcoDd79FwfEBhm.2_1 2019-12-09T13:25:22.234 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~_HTWGgoxHT-F7i0TLIcoDd79FwfEBhm.3 2019-12-09T13:25:22.234 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~_HTWGgoxHT-F7i0TLIcoDd79FwfEBhm.3_1 2019-12-09T13:25:22.234 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~_HTWGgoxHT-F7i0TLIcoDd79FwfEBhm.4 2019-12-09T13:25:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~_HTWGgoxHT-F7i0TLIcoDd79FwfEBhm.4_1 2019-12-09T13:25:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~_HTWGgoxHT-F7i0TLIcoDd79FwfEBhm.5 2019-12-09T13:25:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1322', time=2019-12-09T14:34:54.394395+0000, chain.objs.size()=9 2019-12-09T13:25:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~4sN-H52POl3n0yV8c7QDGVjKBrep0bk.1 2019-12-09T13:25:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~4sN-H52POl3n0yV8c7QDGVjKBrep0bk.1_1 2019-12-09T13:25:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.219+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~4sN-H52POl3n0yV8c7QDGVjKBrep0bk.2 2019-12-09T13:25:22.359 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.352+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~4sN-H52POl3n0yV8c7QDGVjKBrep0bk.2_1 2019-12-09T13:25:22.452 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.445+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~4sN-H52POl3n0yV8c7QDGVjKBrep0bk.3 2019-12-09T13:25:22.467 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.459+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~4sN-H52POl3n0yV8c7QDGVjKBrep0bk.3_1 2019-12-09T13:25:22.569 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.561+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~4sN-H52POl3n0yV8c7QDGVjKBrep0bk.4 2019-12-09T13:25:22.569 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.561+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~4sN-H52POl3n0yV8c7QDGVjKBrep0bk.4_1 2019-12-09T13:25:22.569 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.561+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~4sN-H52POl3n0yV8c7QDGVjKBrep0bk.5 2019-12-09T13:25:22.772 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.764+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:22.876 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.868+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T13:25:22.919 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.912+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.927+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:22.947 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.939+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T13:25:22.947 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.939+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1332', time=2019-12-09T14:36:49.503374+0000, chain.objs.size()=7 2019-12-09T13:25:22.947 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.939+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~EnyU8PWM5VNE4CeSQxqlWL2US0UH2a1.1 2019-12-09T13:25:22.947 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.939+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~EnyU8PWM5VNE4CeSQxqlWL2US0UH2a1.1_1 2019-12-09T13:25:22.948 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.939+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~EnyU8PWM5VNE4CeSQxqlWL2US0UH2a1.1_2 2019-12-09T13:25:22.948 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.939+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~EnyU8PWM5VNE4CeSQxqlWL2US0UH2a1.2 2019-12-09T13:25:22.948 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.939+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~EnyU8PWM5VNE4CeSQxqlWL2US0UH2a1.2_1 2019-12-09T13:25:22.948 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.939+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~EnyU8PWM5VNE4CeSQxqlWL2US0UH2a1.2_2 2019-12-09T13:25:22.948 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:22.939+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~EnyU8PWM5VNE4CeSQxqlWL2US0UH2a1.3 2019-12-09T13:25:23.202 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.195+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:23.316 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.308+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T13:25:23.366 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.359+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:23.385 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.374+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T13:25:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1185', time=2019-12-09T14:26:05.612989+0000, chain.objs.size()=7 2019-12-09T13:25:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~VWr6C89CmmmsUZAPgi8XGlrPvm83g7l.1 2019-12-09T13:25:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~VWr6C89CmmmsUZAPgi8XGlrPvm83g7l.1_1 2019-12-09T13:25:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~VWr6C89CmmmsUZAPgi8XGlrPvm83g7l.1_2 2019-12-09T13:25:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~VWr6C89CmmmsUZAPgi8XGlrPvm83g7l.2 2019-12-09T13:25:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~VWr6C89CmmmsUZAPgi8XGlrPvm83g7l.2_1 2019-12-09T13:25:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~VWr6C89CmmmsUZAPgi8XGlrPvm83g7l.2_2 2019-12-09T13:25:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~VWr6C89CmmmsUZAPgi8XGlrPvm83g7l.3 2019-12-09T13:25:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1234', time=2019-12-09T14:27:52.508890+0000, chain.objs.size()=9 2019-12-09T13:25:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.71__multipart_key1.2~5opQcj1pTTW7bhDyW_TwDROf0saVN-V.1 2019-12-09T13:25:23.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.71__shadow_key1.2~5opQcj1pTTW7bhDyW_TwDROf0saVN-V.1_1 2019-12-09T13:25:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.71__multipart_key1.2~5opQcj1pTTW7bhDyW_TwDROf0saVN-V.2 2019-12-09T13:25:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.71__shadow_key1.2~5opQcj1pTTW7bhDyW_TwDROf0saVN-V.2_1 2019-12-09T13:25:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.391+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.71__multipart_key1.2~5opQcj1pTTW7bhDyW_TwDROf0saVN-V.3 2019-12-09T13:25:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.780+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.71__shadow_key1.2~5opQcj1pTTW7bhDyW_TwDROf0saVN-V.3_1 2019-12-09T13:25:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.780+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.71__multipart_key1.2~5opQcj1pTTW7bhDyW_TwDROf0saVN-V.4 2019-12-09T13:25:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.780+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.71__shadow_key1.2~5opQcj1pTTW7bhDyW_TwDROf0saVN-V.4_1 2019-12-09T13:25:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:23.780+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.71__multipart_key1.2~5opQcj1pTTW7bhDyW_TwDROf0saVN-V.5 2019-12-09T13:25:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.048+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:24.154 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.147+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T13:25:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.185+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.200+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.212+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T13:25:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.212+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1197', time=2019-12-09T14:26:44.178222+0000, chain.objs.size()=7 2019-12-09T13:25:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.212+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~hF4X9iyA8gNkG9XYWSK-UyeunKUKNca.1 2019-12-09T13:25:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.212+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~hF4X9iyA8gNkG9XYWSK-UyeunKUKNca.1_1 2019-12-09T13:25:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.212+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~hF4X9iyA8gNkG9XYWSK-UyeunKUKNca.1_2 2019-12-09T13:25:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.212+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~hF4X9iyA8gNkG9XYWSK-UyeunKUKNca.2 2019-12-09T13:25:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.212+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~hF4X9iyA8gNkG9XYWSK-UyeunKUKNca.2_1 2019-12-09T13:25:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.212+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~hF4X9iyA8gNkG9XYWSK-UyeunKUKNca.2_2 2019-12-09T13:25:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.212+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~hF4X9iyA8gNkG9XYWSK-UyeunKUKNca.3 2019-12-09T13:25:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.526+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:24.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.653+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T13:25:24.733 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.726+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:24.756 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.749+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.761+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:24.809 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.801+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T13:25:24.862 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.854+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:24.879 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.872+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.880+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.928+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T13:25:25.002 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:24.994+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:25.025 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.017+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:25.053 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2019-12-09T13:25:25.053 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1171', time=2019-12-09T14:25:10.293967+0000, chain.objs.size()=9 2019-12-09T13:25:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~OlHqDRgVL-k9_mo1S8HA5xGS2nKIyBL.1 2019-12-09T13:25:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~OlHqDRgVL-k9_mo1S8HA5xGS2nKIyBL.1_1 2019-12-09T13:25:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~OlHqDRgVL-k9_mo1S8HA5xGS2nKIyBL.2 2019-12-09T13:25:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~OlHqDRgVL-k9_mo1S8HA5xGS2nKIyBL.2_1 2019-12-09T13:25:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~OlHqDRgVL-k9_mo1S8HA5xGS2nKIyBL.3 2019-12-09T13:25:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~OlHqDRgVL-k9_mo1S8HA5xGS2nKIyBL.3_1 2019-12-09T13:25:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~OlHqDRgVL-k9_mo1S8HA5xGS2nKIyBL.4 2019-12-09T13:25:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~OlHqDRgVL-k9_mo1S8HA5xGS2nKIyBL.4_1 2019-12-09T13:25:25.055 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~OlHqDRgVL-k9_mo1S8HA5xGS2nKIyBL.5 2019-12-09T13:25:25.055 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1278', time=2019-12-09T14:29:44.268991+0000, chain.objs.size()=9 2019-12-09T13:25:25.055 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.73__multipart_file.mpg.2~00495AYSQrABcptmZTtNgkuEhCuu93b.1 2019-12-09T13:25:25.055 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.73__shadow_file.mpg.2~00495AYSQrABcptmZTtNgkuEhCuu93b.1_1 2019-12-09T13:25:25.055 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.046+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.73__multipart_file.mpg.2~00495AYSQrABcptmZTtNgkuEhCuu93b.2 2019-12-09T13:25:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.323+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.73__shadow_file.mpg.2~00495AYSQrABcptmZTtNgkuEhCuu93b.2_1 2019-12-09T13:25:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.323+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.73__multipart_file.mpg.2~00495AYSQrABcptmZTtNgkuEhCuu93b.3 2019-12-09T13:25:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.323+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.73__shadow_file.mpg.2~00495AYSQrABcptmZTtNgkuEhCuu93b.3_1 2019-12-09T13:25:25.409 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.401+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.73__multipart_file.mpg.2~00495AYSQrABcptmZTtNgkuEhCuu93b.4 2019-12-09T13:25:25.502 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.495+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.73__shadow_file.mpg.2~00495AYSQrABcptmZTtNgkuEhCuu93b.4_1 2019-12-09T13:25:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.495+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.73__multipart_file.mpg.2~00495AYSQrABcptmZTtNgkuEhCuu93b.5 2019-12-09T13:25:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.495+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~BJhSwUjQap2XM-J9UyleQbw_-ASbG80', time=2019-12-09T14:30:51.793424+0000, chain.objs.size()=9 2019-12-09T13:25:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.495+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.74__multipart_key1.2~BJhSwUjQap2XM-J9UyleQbw_-ASbG80.7 2019-12-09T13:25:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.495+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.74__shadow_key1.2~BJhSwUjQap2XM-J9UyleQbw_-ASbG80.7_1 2019-12-09T13:25:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.495+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.74__multipart_key1.2~BJhSwUjQap2XM-J9UyleQbw_-ASbG80.8 2019-12-09T13:25:25.503 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.495+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.74__shadow_key1.2~BJhSwUjQap2XM-J9UyleQbw_-ASbG80.8_1 2019-12-09T13:25:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.495+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.74__multipart_key1.2~BJhSwUjQap2XM-J9UyleQbw_-ASbG80.9 2019-12-09T13:25:25.692 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.684+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.74__shadow_key1.2~BJhSwUjQap2XM-J9UyleQbw_-ASbG80.9_1 2019-12-09T13:25:25.754 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.684+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.74__multipart_key1.2~BJhSwUjQap2XM-J9UyleQbw_-ASbG80.10 2019-12-09T13:25:25.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.805+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.74__shadow_key1.2~BJhSwUjQap2XM-J9UyleQbw_-ASbG80.10_1 2019-12-09T13:25:25.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.805+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.74__multipart_key1.2~BJhSwUjQap2XM-J9UyleQbw_-ASbG80.11 2019-12-09T13:25:25.919 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.909+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1327', time=2019-12-09T14:35:53.512003+0000, chain.objs.size()=7 2019-12-09T13:25:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.909+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~jJgYeSeGJMKjwxdtXf-W_T-jxqdxsVu.1 2019-12-09T13:25:25.983 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:25.971+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~jJgYeSeGJMKjwxdtXf-W_T-jxqdxsVu.1_1 2019-12-09T13:25:26.019 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.012+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~jJgYeSeGJMKjwxdtXf-W_T-jxqdxsVu.1_2 2019-12-09T13:25:26.093 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.085+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~jJgYeSeGJMKjwxdtXf-W_T-jxqdxsVu.2 2019-12-09T13:25:26.093 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.085+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~jJgYeSeGJMKjwxdtXf-W_T-jxqdxsVu.2_1 2019-12-09T13:25:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.085+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~jJgYeSeGJMKjwxdtXf-W_T-jxqdxsVu.2_2 2019-12-09T13:25:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.085+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~jJgYeSeGJMKjwxdtXf-W_T-jxqdxsVu.3 2019-12-09T13:25:26.340 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.333+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.417+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T13:25:26.478 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.470+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:26.499 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.491+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.500+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:26.538 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.530+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T13:25:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.580+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:26.606 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.598+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:26.630 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T13:25:26.630 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1191', time=2019-12-09T14:26:33.315563+0000, chain.objs.size()=7 2019-12-09T13:25:26.630 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~KGxlpsK2xreCp54bP7LtMDbynwgKtLv.1 2019-12-09T13:25:26.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~KGxlpsK2xreCp54bP7LtMDbynwgKtLv.1_1 2019-12-09T13:25:26.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~KGxlpsK2xreCp54bP7LtMDbynwgKtLv.1_2 2019-12-09T13:25:26.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~KGxlpsK2xreCp54bP7LtMDbynwgKtLv.2 2019-12-09T13:25:26.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~KGxlpsK2xreCp54bP7LtMDbynwgKtLv.2_1 2019-12-09T13:25:26.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__shadow_key1.2~KGxlpsK2xreCp54bP7LtMDbynwgKtLv.2_2 2019-12-09T13:25:26.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.67__multipart_key1.2~KGxlpsK2xreCp54bP7LtMDbynwgKtLv.3 2019-12-09T13:25:26.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1352', time=2019-12-09T14:38:23.613577+0000, chain.objs.size()=9 2019-12-09T13:25:26.632 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.76__multipart_key1.2~TeYkgI_VN2UoqNToA1eqof5F3eUry39.1 2019-12-09T13:25:26.632 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.76__shadow_key1.2~TeYkgI_VN2UoqNToA1eqof5F3eUry39.1_1 2019-12-09T13:25:26.632 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.76__multipart_key1.2~TeYkgI_VN2UoqNToA1eqof5F3eUry39.2 2019-12-09T13:25:26.632 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.76__shadow_key1.2~TeYkgI_VN2UoqNToA1eqof5F3eUry39.2_1 2019-12-09T13:25:26.632 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.622+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.76__multipart_key1.2~TeYkgI_VN2UoqNToA1eqof5F3eUry39.3 2019-12-09T13:25:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.954+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.76__shadow_key1.2~TeYkgI_VN2UoqNToA1eqof5F3eUry39.3_1 2019-12-09T13:25:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.954+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.76__multipart_key1.2~TeYkgI_VN2UoqNToA1eqof5F3eUry39.4 2019-12-09T13:25:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.954+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.76__shadow_key1.2~TeYkgI_VN2UoqNToA1eqof5F3eUry39.4_1 2019-12-09T13:25:26.963 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:26.954+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.76__multipart_key1.2~TeYkgI_VN2UoqNToA1eqof5F3eUry39.5 2019-12-09T13:25:27.203 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.196+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.323+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T13:25:27.381 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.368+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.384+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.393+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.431+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T13:25:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.513+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.543+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:27.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.566+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T13:25:27.578 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.566+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1315', time=2019-12-09T14:34:06.216888+0000, chain.objs.size()=9 2019-12-09T13:25:27.578 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.566+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~6_lgamH26eYtpsDMEt-ktNQ7CYDx-ik.1 2019-12-09T13:25:27.578 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.566+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~6_lgamH26eYtpsDMEt-ktNQ7CYDx-ik.1_1 2019-12-09T13:25:27.578 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.566+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~6_lgamH26eYtpsDMEt-ktNQ7CYDx-ik.2 2019-12-09T13:25:27.579 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.566+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~6_lgamH26eYtpsDMEt-ktNQ7CYDx-ik.2_1 2019-12-09T13:25:27.579 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.566+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~6_lgamH26eYtpsDMEt-ktNQ7CYDx-ik.3 2019-12-09T13:25:27.579 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.566+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~6_lgamH26eYtpsDMEt-ktNQ7CYDx-ik.3_1 2019-12-09T13:25:27.579 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.566+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~6_lgamH26eYtpsDMEt-ktNQ7CYDx-ik.4 2019-12-09T13:25:27.579 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.566+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~6_lgamH26eYtpsDMEt-ktNQ7CYDx-ik.4_1 2019-12-09T13:25:27.579 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.566+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~6_lgamH26eYtpsDMEt-ktNQ7CYDx-ik.5 2019-12-09T13:25:27.882 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.875+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:27.972+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T13:25:28.019 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.011+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:28.037 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.026+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:28.043 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.035+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:28.077 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.069+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T13:25:28.133 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.119+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.137+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.154+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T13:25:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.154+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1337', time=2019-12-09T14:36:52.995909+0000, chain.objs.size()=7 2019-12-09T13:25:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.154+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~5_9fztaSdfg0litIOQ3jKr8Gk_Vz8gr.1 2019-12-09T13:25:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.154+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~5_9fztaSdfg0litIOQ3jKr8Gk_Vz8gr.1_1 2019-12-09T13:25:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.154+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~5_9fztaSdfg0litIOQ3jKr8Gk_Vz8gr.1_2 2019-12-09T13:25:28.162 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.154+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~5_9fztaSdfg0litIOQ3jKr8Gk_Vz8gr.2 2019-12-09T13:25:28.163 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.154+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~5_9fztaSdfg0litIOQ3jKr8Gk_Vz8gr.2_1 2019-12-09T13:25:28.163 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.154+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__shadow_key1.2~5_9fztaSdfg0litIOQ3jKr8Gk_Vz8gr.2_2 2019-12-09T13:25:28.168 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.154+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.75__multipart_key1.2~5_9fztaSdfg0litIOQ3jKr8Gk_Vz8gr.3 2019-12-09T13:25:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.440+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.523+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T13:25:28.597 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.585+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:28.617 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.609+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:28.626 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.618+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:28.658 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.651+0000 7f982a093ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T13:25:28.760 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.685+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.698+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T13:25:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1140', time=2019-12-09T14:21:48.961831+0000, chain.objs.size()=9 2019-12-09T13:25:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__multipart_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.1 2019-12-09T13:25:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__shadow_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.1_1 2019-12-09T13:25:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__multipart_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.2 2019-12-09T13:25:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__shadow_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.2_1 2019-12-09T13:25:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__multipart_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.3 2019-12-09T13:25:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__shadow_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.3_1 2019-12-09T13:25:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__multipart_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.4 2019-12-09T13:25:28.792 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__shadow_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.4_1 2019-12-09T13:25:28.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__multipart_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.5 2019-12-09T13:25:28.805 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 20 garbage collection: RGWGC::process iterating over entry tag='eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4376.1142', time=2019-12-09T14:21:56.316760+0000, chain.objs.size()=9 2019-12-09T13:25:28.806 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__multipart_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.1 2019-12-09T13:25:28.806 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__shadow_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.1_1 2019-12-09T13:25:28.806 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:28.716+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__multipart_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.2 2019-12-09T13:25:29.099 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.091+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__shadow_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.2_1 2019-12-09T13:25:29.176 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.169+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__multipart_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.3 2019-12-09T13:25:29.177 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.169+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__shadow_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.3_1 2019-12-09T13:25:29.177 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.169+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__multipart_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.4 2019-12-09T13:25:29.189 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.181+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__shadow_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.4_1 2019-12-09T13:25:29.296 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.288+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.64__multipart_key1.2~rsY-GTKy4JimpRH5KNxi-aifXzyUyz4.5 2019-12-09T13:25:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.547+0000 7f982a093ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T13:25:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.664+0000 7f982a093ec0 20 remove_watcher() i=0 2019-12-09T13:25:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.664+0000 7f982a093ec0 2 removed watcher, disabling cache 2019-12-09T13:25:29.709 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.701+0000 7f982a093ec0 20 remove_watcher() i=1 2019-12-09T13:25:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.741+0000 7f982a093ec0 20 remove_watcher() i=2 2019-12-09T13:25:29.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.789+0000 7f982a093ec0 20 remove_watcher() i=3 2019-12-09T13:25:29.837 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.830+0000 7f982a093ec0 20 remove_watcher() i=4 2019-12-09T13:25:29.874 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.866+0000 7f982a093ec0 20 remove_watcher() i=5 2019-12-09T13:25:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.908+0000 7f982a093ec0 20 remove_watcher() i=6 2019-12-09T13:25:29.957 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:29.950+0000 7f982a093ec0 20 remove_watcher() i=7 2019-12-09T13:25:29.977 INFO:teuthology.orchestra.run.smithi146:> radosgw-admin gc process --include-all 2019-12-09T13:25:30.090 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.080+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.315 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.307+0000 7f382ce2cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:30.315 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.308+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.326 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.318+0000 7f382ce2cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:30.326 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.318+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.331 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.323+0000 7f382ce2cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:30.331 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.323+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.338 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.331+0000 7f382ce2cec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:30.554 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.546+0000 7f382ce2cec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T13:25:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.546+0000 7f382ce2cec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T13:25:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.546+0000 7f382ce2cec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T13:25:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.546+0000 7f382ce2cec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T13:25:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.546+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.577 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.562+0000 7f382ce2cec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:30.577 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.562+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.581 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.573+0000 7f382ce2cec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:30.581 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.573+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.589 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.581+0000 7f382ce2cec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:30.589 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.581+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.604 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.596+0000 7f382ce2cec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:30.604 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.596+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.609 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.602+0000 7f382ce2cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:30.609 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.602+0000 7f382ce2cec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T13:25:30.609 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.602+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.614 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.607+0000 7f382ce2cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:30.615 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.607+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.624 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.616+0000 7f382ce2cec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:30.624 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.616+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.644 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.636+0000 7f382ce2cec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:30.644 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.636+0000 7f382ce2cec0 20 zonegroup default 2019-12-09T13:25:30.645 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.636+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.650 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.642+0000 7f382ce2cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:30.650 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.642+0000 7f382ce2cec0 10 Cannot find current period zone using local zone 2019-12-09T13:25:30.650 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.642+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.649+0000 7f382ce2cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.649+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.667 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.660+0000 7f382ce2cec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:30.667 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.660+0000 7f382ce2cec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:30.679 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.671+0000 7f382ce2cec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:30.679 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.671+0000 7f382ce2cec0 20 zone default found 2019-12-09T13:25:30.679 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.671+0000 7f382ce2cec0 20 started sync module instance, tier type = 2019-12-09T13:25:30.679 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:30.671+0000 7f382ce2cec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T13:25:31.050 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:31.042+0000 7f382ce2cec0 20 add_watcher() i=0 2019-12-09T13:25:31.050 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:31.042+0000 7f382ce2cec0 20 add_watcher() i=1 2019-12-09T13:25:31.050 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:31.042+0000 7f382ce2cec0 20 add_watcher() i=2 2019-12-09T13:25:31.050 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:31.042+0000 7f382ce2cec0 20 add_watcher() i=3 2019-12-09T13:25:31.050 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:31.042+0000 7f382ce2cec0 20 add_watcher() i=4 2019-12-09T13:25:31.051 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:31.042+0000 7f382ce2cec0 20 add_watcher() i=5 2019-12-09T13:25:31.051 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:31.042+0000 7f382ce2cec0 20 add_watcher() i=6 2019-12-09T13:25:31.084 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:31.076+0000 7f382ce2cec0 20 add_watcher() i=7 2019-12-09T13:25:31.084 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:31.076+0000 7f382ce2cec0 2 all 8 watchers are set, enabling cache 2019-12-09T13:25:31.085 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:31.077+0000 7f37e9feb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T13:25:31.089 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:31.080+0000 7f381a857700 0 -- 172.21.15.146:0/3075692942 >> v1:172.21.15.146:6789/0 conn(0x55e1083bfd60 legacy=0x55e1083d2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T13:25:31.127 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:31.120+0000 7f381a056700 0 -- 172.21.15.146:0/2364897256 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x55e108408c90 msgr2=0x55e10840b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T13:25:32.799 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:32.790+0000 7f375bfff700 20 reqs_thread_entry: start 2019-12-09T13:25:32.799 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:32.790+0000 7f3759ffb700 20 reqs_thread_entry: start 2019-12-09T13:25:32.799 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:32.790+0000 7f382ce2cec0 20 init_complete bucket index max shards: 0 2019-12-09T13:25:32.800 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:32.791+0000 7f3747fff700 20 reqs_thread_entry: start 2019-12-09T13:25:32.800 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:32.791+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T13:25:32.842 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:32.834+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:32.862 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:32.854+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:32.888 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:32.862+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:32.915 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:32.908+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T13:25:32.983 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:32.975+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.009 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.002+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:33.025 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.018+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.078 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.071+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T13:25:33.134 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.126+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.160 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.152+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:33.197 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.189+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.244 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.236+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T13:25:33.282 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.275+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.301 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.293+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.301+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.344 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.337+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T13:25:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.472+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.507 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.500+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:33.521 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.514+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.568+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T13:25:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.605+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.621+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:33.639 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.630+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.683 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.673+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T13:25:33.743 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.735+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.781 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.774+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:33.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.782+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.820+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T13:25:33.885 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.877+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.908 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.901+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:33.930 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.913+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:33.972 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:33.963+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T13:25:34.008 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.001+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.015+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:34.031 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.024+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.062 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.053+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T13:25:34.118 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.106+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.133 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.125+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.134+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.181 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.173+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T13:25:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.378+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.407 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.397+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:34.416 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.409+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.448 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.440+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T13:25:34.488 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.479+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.498+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:34.522 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.507+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.547+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T13:25:34.599 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.591+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.614 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.607+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:34.628 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.621+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.665+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T13:25:34.727 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.719+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.745 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.738+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:34.755 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.748+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.795 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.788+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T13:25:34.876 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.868+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.907 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.900+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:34.920 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.913+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:34.958 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.951+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T13:25:35.007 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:34.999+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.015+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:35.031 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.023+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.071 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.064+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T13:25:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.150+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.190 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.183+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:35.205 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.197+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.268 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.260+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T13:25:35.309 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.299+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.314+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.322+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.361 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.354+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T13:25:35.404 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.397+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.421 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.414+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.423+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.469+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T13:25:35.534 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.526+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.551 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.543+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:35.559 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.552+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.592 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.584+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T13:25:35.674 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.666+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.702 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.694+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.710+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.763 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.755+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T13:25:35.827 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.819+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.838+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:35.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.850+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:35.897 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.889+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T13:25:35.944 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.937+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.050 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.955+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:36.050 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:35.964+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.050 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.004+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T13:25:36.070 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.062+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.086 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.079+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:36.102 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.088+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.120+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T13:25:36.191 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.183+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.205 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.198+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:36.214 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.207+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.248 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.240+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T13:25:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.304+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.324+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:36.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.343+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.402 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.394+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T13:25:36.449 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.441+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.467 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.459+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.470+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.534 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.524+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T13:25:36.581 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.574+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.601 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.593+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:36.617 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.603+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.655 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.648+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T13:25:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.687+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.702+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:36.724 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.710+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.743+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T13:25:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.782+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.805 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.797+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:36.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.809+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.838+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T13:25:36.898 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.890+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.917 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.906+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:36.927 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.919+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:36.969 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:36.962+0000 7f382ce2cec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T13:25:37.050 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:37.042+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:37.075 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:37.067+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T13:25:37.086 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:37.079+0000 7f382ce2cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T13:25:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:37.167+0000 7f382ce2cec0 20 remove_watcher() i=0 2019-12-09T13:25:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:37.167+0000 7f382ce2cec0 2 removed watcher, disabling cache 2019-12-09T13:25:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:37.209+0000 7f382ce2cec0 20 remove_watcher() i=1 2019-12-09T13:25:37.249 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:37.242+0000 7f382ce2cec0 20 remove_watcher() i=2 2019-12-09T13:25:37.304 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:37.297+0000 7f382ce2cec0 20 remove_watcher() i=3 2019-12-09T13:25:37.343 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:37.336+0000 7f382ce2cec0 20 remove_watcher() i=4 2019-12-09T13:25:37.404 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:37.397+0000 7f382ce2cec0 20 remove_watcher() i=5 2019-12-09T13:25:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:37.464+0000 7f382ce2cec0 20 remove_watcher() i=6 2019-12-09T13:25:37.526 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:37.519+0000 7f382ce2cec0 20 remove_watcher() i=7 2019-12-09T13:25:37.541 INFO:teuthology.run_tasks:Running task s3tests... 2019-12-09T13:25:37.597 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'slow_backend': True}} 2019-12-09T13:25:37.598 INFO:tasks.s3tests:Downloading s3-tests... 2019-12-09T13:25:37.598 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2019-12-09T13:25:37.598 INFO:teuthology.orchestra.run.smithi146:> git clone -b ceph-master git://git.ceph.com/git/s3-tests.git /home/ubuntu/cephtest/s3-tests 2019-12-09T13:25:37.694 INFO:teuthology.orchestra.run.smithi146.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests'... 2019-12-09T13:25:38.148 INFO:tasks.s3tests:Creating rgw users... 2019-12-09T13:25:38.149 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2019-12-09T13:25:38.149 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --access-key CSBXPENAPLMBCWZOZYGA --secret qetawkrYkbnYcofYx08uZny7GmoCKDsIifcmWuTuasaFDOZ9Nr8cgg== --email bar.client.0+test@test.test --cluster ceph 2019-12-09T13:25:38.297 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.289+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.319 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.312+0000 7f151dd52ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:38.320 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.312+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.341 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.327+0000 7f151dd52ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:38.341 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.327+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.341 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.332+0000 7f151dd52ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:38.342 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.332+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.342+0000 7f151dd52ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:38.528 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.520+0000 7f151dd52ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T13:25:38.528 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.520+0000 7f151dd52ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T13:25:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.520+0000 7f151dd52ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T13:25:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.520+0000 7f151dd52ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T13:25:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.520+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.536 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.528+0000 7f151dd52ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:38.536 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.528+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.540+0000 7f151dd52ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.540+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.557 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.550+0000 7f151dd52ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:38.558 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.550+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.569+0000 7f151dd52ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.569+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.583 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.575+0000 7f151dd52ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:38.583 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.575+0000 7f151dd52ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T13:25:38.583 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.575+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.591 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.583+0000 7f151dd52ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:38.591 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.583+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.614 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.600+0000 7f151dd52ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:38.614 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.600+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.624 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.616+0000 7f151dd52ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:38.624 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.616+0000 7f151dd52ec0 20 zonegroup default 2019-12-09T13:25:38.625 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.616+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.633 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.625+0000 7f151dd52ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:38.633 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.625+0000 7f151dd52ec0 10 Cannot find current period zone using local zone 2019-12-09T13:25:38.633 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.625+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.641 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.633+0000 7f151dd52ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:38.641 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.633+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.650 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.643+0000 7f151dd52ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:38.650 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.643+0000 7f151dd52ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.649+0000 7f151dd52ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.649+0000 7f151dd52ec0 20 zone default found 2019-12-09T13:25:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.649+0000 7f151dd52ec0 20 started sync module instance, tier type = 2019-12-09T13:25:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:38.649+0000 7f151dd52ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T13:25:39.082 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:39.075+0000 7f151dd52ec0 20 add_watcher() i=0 2019-12-09T13:25:39.083 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:39.075+0000 7f151dd52ec0 20 add_watcher() i=1 2019-12-09T13:25:39.083 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:39.075+0000 7f151dd52ec0 20 add_watcher() i=2 2019-12-09T13:25:39.083 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:39.075+0000 7f151dd52ec0 20 add_watcher() i=3 2019-12-09T13:25:39.083 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:39.075+0000 7f151dd52ec0 20 add_watcher() i=4 2019-12-09T13:25:39.083 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:39.075+0000 7f151dd52ec0 20 add_watcher() i=5 2019-12-09T13:25:39.083 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:39.075+0000 7f151dd52ec0 20 add_watcher() i=6 2019-12-09T13:25:39.116 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:39.109+0000 7f151dd52ec0 20 add_watcher() i=7 2019-12-09T13:25:39.116 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:39.109+0000 7f151dd52ec0 2 all 8 watchers are set, enabling cache 2019-12-09T13:25:39.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:39.109+0000 7f14db7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T13:25:39.120 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:39.113+0000 7f150a77b700 0 -- 172.21.15.146:0/4066294140 >> v1:172.21.15.146:6789/0 conn(0x55c0dfe97570 legacy=0x55c0dfe99a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T13:25:39.157 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:39.149+0000 7f150a77b700 0 -- 172.21.15.146:0/3757308209 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x55c0dfea9a50 msgr2=0x55c0dfeabe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T13:25:40.994 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:40.986+0000 7f1449ffb700 20 reqs_thread_entry: start 2019-12-09T13:25:40.994 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:40.986+0000 7f14437fe700 20 reqs_thread_entry: start 2019-12-09T13:25:40.994 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:40.986+0000 7f151dd52ec0 20 init_complete bucket index max shards: 0 2019-12-09T13:25:40.995 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:40.987+0000 7f1441ffb700 20 reqs_thread_entry: start 2019-12-09T13:25:40.995 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:40.987+0000 7f151dd52ec0 20 get_system_obj_state: rctx=0x7fff41a6ef28 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55c0dff16520 s->prefetch_data=0 2019-12-09T13:25:40.995 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:40.987+0000 7f151dd52ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-09T13:25:41.007 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.000+0000 7f151dd52ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-12-09T13:25:41.008 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.000+0000 7f151dd52ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T13:25:41.008 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.000+0000 7f151dd52ec0 20 get_system_obj_state: rctx=0x7fff41a6ef38 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x55c0dff182b0 s->prefetch_data=0 2019-12-09T13:25:41.008 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.000+0000 7f151dd52ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-12-09T13:25:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.004+0000 7f151dd52ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-12-09T13:25:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.004+0000 7f151dd52ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-09T13:25:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.004+0000 7f151dd52ec0 20 get_system_obj_state: rctx=0x7fff41a6ef38 obj=default.rgw.meta:users.keys:CSBXPENAPLMBCWZOZYGA state=0x55c0dff182b0 s->prefetch_data=0 2019-12-09T13:25:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.004+0000 7f151dd52ec0 10 cache get: name=default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA : miss 2019-12-09T13:25:41.017 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.010+0000 7f151dd52ec0 10 cache put: name=default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA info.flags=0x0 2019-12-09T13:25:41.018 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.010+0000 7f151dd52ec0 10 adding default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA to cache LRU end 2019-12-09T13:25:41.018 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.010+0000 7f151dd52ec0 20 get_system_obj_state: rctx=0x7fff41a6eb48 obj=default.rgw.meta:users.keys:CSBXPENAPLMBCWZOZYGA state=0x55c0dff182b0 s->prefetch_data=0 2019-12-09T13:25:41.018 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.010+0000 7f151dd52ec0 10 cache get: name=default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA : type miss (requested=0x6, cached=0x0) 2019-12-09T13:25:41.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.015+0000 7f151dd52ec0 10 cache put: name=default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA info.flags=0x0 2019-12-09T13:25:41.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.015+0000 7f151dd52ec0 10 moving default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA to cache LRU end 2019-12-09T13:25:41.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.015+0000 7f151dd52ec0 20 get_system_obj_state: rctx=0x7fff41a6ecc8 obj=default.rgw.meta:users.keys:CSBXPENAPLMBCWZOZYGA state=0x55c0dff182b0 s->prefetch_data=0 2019-12-09T13:25:41.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.015+0000 7f151dd52ec0 10 cache get: name=default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA : type miss (requested=0x6, cached=0x0) 2019-12-09T13:25:41.028 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.020+0000 7f151dd52ec0 10 cache put: name=default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA info.flags=0x0 2019-12-09T13:25:41.028 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.020+0000 7f151dd52ec0 10 moving default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA to cache LRU end 2019-12-09T13:25:41.111 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.103+0000 7f151dd52ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T13:25:41.111 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.103+0000 7f151dd52ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T13:25:41.111 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.103+0000 7f151dd52ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=617 2019-12-09T13:25:41.120 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.113+0000 7f14ebfff700 10 RGWWatcher::handle_notify() notify_id 592705486886 cookie 94286878584864 notifier 4878 bl.length()=617 2019-12-09T13:25:41.120 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.113+0000 7f14ebfff700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T13:25:41.121 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.113+0000 7f14ebfff700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T13:25:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.396+0000 7f151dd52ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-09T13:25:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.396+0000 7f151dd52ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-09T13:25:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.396+0000 7f151dd52ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-12-09T13:25:41.412 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.404+0000 7f14ebfff700 10 RGWWatcher::handle_notify() notify_id 592705486887 cookie 94286878584864 notifier 4878 bl.length()=194 2019-12-09T13:25:41.412 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.404+0000 7f14ebfff700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-09T13:25:41.412 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:41.404+0000 7f14ebfff700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-09T13:25:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.317+0000 7f151dd52ec0 10 cache put: name=default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA info.flags=0x7 2019-12-09T13:25:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.317+0000 7f151dd52ec0 10 moving default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA to cache LRU end 2019-12-09T13:25:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.317+0000 7f151dd52ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=186 2019-12-09T13:25:42.343 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.335+0000 7f14ebfff700 10 RGWWatcher::handle_notify() notify_id 592705486906 cookie 94286878608688 notifier 4878 bl.length()=186 2019-12-09T13:25:42.343 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.335+0000 7f14ebfff700 10 cache put: name=default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA info.flags=0x7 2019-12-09T13:25:42.343 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.335+0000 7f14ebfff700 10 moving default.rgw.meta+users.keys+CSBXPENAPLMBCWZOZYGA to cache LRU end 2019-12-09T13:25:42.570 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2019-12-09T13:25:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: "user_id": "bar.client.0", 2019-12-09T13:25:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: "display_name": "Mr. bar.client.0", 2019-12-09T13:25:42.570 INFO:teuthology.orchestra.run.smithi146.stdout: "email": "bar.client.0+test@test.test", 2019-12-09T13:25:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "suspended": 0, 2019-12-09T13:25:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "max_buckets": 1000, 2019-12-09T13:25:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "subusers": [], 2019-12-09T13:25:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "keys": [ 2019-12-09T13:25:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: { 2019-12-09T13:25:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "user": "bar.client.0", 2019-12-09T13:25:42.571 INFO:teuthology.orchestra.run.smithi146.stdout: "access_key": "CSBXPENAPLMBCWZOZYGA", 2019-12-09T13:25:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: "secret_key": "qetawkrYkbnYcofYx08uZny7GmoCKDsIifcmWuTuasaFDOZ9Nr8cgg==" 2019-12-09T13:25:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: } 2019-12-09T13:25:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2019-12-09T13:25:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: "swift_keys": [], 2019-12-09T13:25:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": [], 2019-12-09T13:25:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: "op_mask": "read, write, delete", 2019-12-09T13:25:42.572 INFO:teuthology.orchestra.run.smithi146.stdout: "default_placement": "", 2019-12-09T13:25:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "default_storage_class": "", 2019-12-09T13:25:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "placement_tags": [], 2019-12-09T13:25:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "bucket_quota": { 2019-12-09T13:25:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T13:25:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T13:25:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T13:25:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T13:25:42.573 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T13:25:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T13:25:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "user_quota": { 2019-12-09T13:25:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T13:25:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T13:25:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T13:25:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T13:25:42.574 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T13:25:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T13:25:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: "temp_url_keys": [], 2019-12-09T13:25:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "rgw", 2019-12-09T13:25:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: "mfa_ids": [] 2019-12-09T13:25:42.575 INFO:teuthology.orchestra.run.smithi146.stdout:} 2019-12-09T13:25:42.575 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:25:42.634 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.626+0000 7f151dd52ec0 20 remove_watcher() i=0 2019-12-09T13:25:42.634 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.626+0000 7f151dd52ec0 2 removed watcher, disabling cache 2019-12-09T13:25:42.696 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.689+0000 7f151dd52ec0 20 remove_watcher() i=1 2019-12-09T13:25:42.745 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.738+0000 7f151dd52ec0 20 remove_watcher() i=2 2019-12-09T13:25:42.816 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.808+0000 7f151dd52ec0 20 remove_watcher() i=3 2019-12-09T13:25:42.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.851+0000 7f151dd52ec0 20 remove_watcher() i=4 2019-12-09T13:25:42.899 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.891+0000 7f151dd52ec0 20 remove_watcher() i=5 2019-12-09T13:25:42.953 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.946+0000 7f151dd52ec0 20 remove_watcher() i=6 2019-12-09T13:25:42.994 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:42.986+0000 7f151dd52ec0 20 remove_watcher() i=7 2019-12-09T13:25:43.004 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 2064052446 --totp-seed V2A2LFEEFS7PSP37UHGXLOJ5NTZPEW2EJLRYWDRBMOC63QW2RUF5JKWPXJCBFHQL --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-12-09T13:25:43.166 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.158+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.186 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.179+0000 7f95fc126ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:43.187 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.179+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.187+0000 7f95fc126ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:43.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.187+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.199 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.191+0000 7f95fc126ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:43.199 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.191+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.216 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.202+0000 7f95fc126ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.457+0000 7f95fc126ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T13:25:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.457+0000 7f95fc126ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T13:25:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.457+0000 7f95fc126ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T13:25:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.457+0000 7f95fc126ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T13:25:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.457+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.476 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.469+0000 7f95fc126ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:43.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.469+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.488 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.480+0000 7f95fc126ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:43.489 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.480+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.489+0000 7f95fc126ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.489+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.516 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.509+0000 7f95fc126ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:43.516 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.509+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.524 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.515+0000 7f95fc126ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:43.524 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.515+0000 7f95fc126ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T13:25:43.524 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.515+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.528 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.521+0000 7f95fc126ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:43.529 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.521+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.541 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.534+0000 7f95fc126ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:43.542 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.534+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.559 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.550+0000 7f95fc126ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:43.559 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.550+0000 7f95fc126ec0 20 zonegroup default 2019-12-09T13:25:43.560 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.550+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.567 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.556+0000 7f95fc126ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:43.567 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.556+0000 7f95fc126ec0 10 Cannot find current period zone using local zone 2019-12-09T13:25:43.567 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.556+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.562+0000 7f95fc126ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.562+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.585 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.577+0000 7f95fc126ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:43.585 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.577+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:43.597 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.589+0000 7f95fc126ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:43.597 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.589+0000 7f95fc126ec0 20 zone default found 2019-12-09T13:25:43.597 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.589+0000 7f95fc126ec0 20 started sync module instance, tier type = 2019-12-09T13:25:43.598 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:43.589+0000 7f95fc126ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T13:25:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:44.026+0000 7f95fc126ec0 20 add_watcher() i=0 2019-12-09T13:25:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:44.027+0000 7f95fc126ec0 20 add_watcher() i=1 2019-12-09T13:25:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:44.027+0000 7f95fc126ec0 20 add_watcher() i=2 2019-12-09T13:25:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:44.027+0000 7f95fc126ec0 20 add_watcher() i=3 2019-12-09T13:25:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:44.027+0000 7f95fc126ec0 20 add_watcher() i=4 2019-12-09T13:25:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:44.027+0000 7f95fc126ec0 20 add_watcher() i=5 2019-12-09T13:25:44.061 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:44.053+0000 7f95fc126ec0 20 add_watcher() i=6 2019-12-09T13:25:44.085 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:44.076+0000 7f95fc126ec0 20 add_watcher() i=7 2019-12-09T13:25:44.085 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:44.076+0000 7f95fc126ec0 2 all 8 watchers are set, enabling cache 2019-12-09T13:25:44.085 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:44.077+0000 7f95b9fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T13:25:44.097 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:44.079+0000 7f95e8b4f700 0 -- 172.21.15.146:0/2163532399 >> v2:172.21.15.194:3300/0 conn(0x555802543e00 msgr2=0x555802546310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-09T13:25:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:44.119+0000 7f95e8b4f700 0 -- 172.21.15.146:0/4015225266 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x555802554fc0 msgr2=0x5558025573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T13:25:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.798+0000 7f952bfff700 20 reqs_thread_entry: start 2019-12-09T13:25:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.798+0000 7f9529ffb700 20 reqs_thread_entry: start 2019-12-09T13:25:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.798+0000 7f95fc126ec0 20 init_complete bucket index max shards: 0 2019-12-09T13:25:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.798+0000 7f9517fff700 20 reqs_thread_entry: start 2019-12-09T13:25:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.798+0000 7f95fc126ec0 20 get_system_obj_state: rctx=0x7ffe82e19da8 obj=default.rgw.meta:users.uid:bar.client.0 state=0x5558025c1a20 s->prefetch_data=0 2019-12-09T13:25:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.798+0000 7f95fc126ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-09T13:25:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.813+0000 7f95fc126ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-12-09T13:25:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.813+0000 7f95fc126ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T13:25:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.813+0000 7f95fc126ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T13:25:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.813+0000 7f95fc126ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T13:25:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.813+0000 7f95fc126ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T13:25:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.813+0000 7f95fc126ec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.841+0000 7f95fc126ec0 20 rados_obj.operate() r=0 bl.length=432 2019-12-09T13:25:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.841+0000 7f95fc126ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-12-09T13:25:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:45.841+0000 7f95fc126ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T13:25:48.384 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:48.377+0000 7f95fc126ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T13:25:48.385 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:48.377+0000 7f95fc126ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T13:25:48.385 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:48.377+0000 7f95fc126ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=631 2019-12-09T13:25:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:48.387+0000 7f95ca7fc700 10 RGWWatcher::handle_notify() notify_id 601295421480 cookie 93836484438816 notifier 4658 bl.length()=631 2019-12-09T13:25:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:48.387+0000 7f95ca7fc700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T13:25:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:48.387+0000 7f95ca7fc700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T13:25:48.862 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:48.855+0000 7f95fc126ec0 20 remove_watcher() i=0 2019-12-09T13:25:48.862 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:48.855+0000 7f95fc126ec0 2 removed watcher, disabling cache 2019-12-09T13:25:49.338 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:49.331+0000 7f95fc126ec0 20 remove_watcher() i=1 2019-12-09T13:25:49.372 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:49.364+0000 7f95fc126ec0 20 remove_watcher() i=2 2019-12-09T13:25:49.493 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:49.485+0000 7f95fc126ec0 20 remove_watcher() i=3 2019-12-09T13:25:49.941 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:49.934+0000 7f95fc126ec0 20 remove_watcher() i=4 2019-12-09T13:25:49.977 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:49.969+0000 7f95fc126ec0 20 remove_watcher() i=5 2019-12-09T13:25:50.026 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.018+0000 7f95fc126ec0 20 remove_watcher() i=6 2019-12-09T13:25:50.069 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.061+0000 7f95fc126ec0 20 remove_watcher() i=7 2019-12-09T13:25:50.079 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2019-12-09T13:25:50.079 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key MEMTKIBLATUWGMORCWSW --secret LnJMn0UFcHZselzFf5e0RskgEZTT14+ELRzBiBCcFBwBecna+16nlQ== --email foo.client.0+test@test.test --cluster ceph 2019-12-09T13:25:50.238 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.230+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.274 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.266+0000 7f8d5c71dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:50.274 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.266+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.283 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.276+0000 7f8d5c71dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:50.283 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.276+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.288 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.280+0000 7f8d5c71dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:50.288 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.281+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.298 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.288+0000 7f8d5c71dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.469+0000 7f8d5c71dec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T13:25:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.469+0000 7f8d5c71dec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T13:25:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.469+0000 7f8d5c71dec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T13:25:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.469+0000 7f8d5c71dec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T13:25:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.469+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.496 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.482+0000 7f8d5c71dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:50.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.482+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.499 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.492+0000 7f8d5c71dec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:50.500 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.492+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.504+0000 7f8d5c71dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:50.511 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.504+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.532 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.525+0000 7f8d5c71dec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:50.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.525+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.538 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.530+0000 7f8d5c71dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:50.538 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.530+0000 7f8d5c71dec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T13:25:50.538 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.530+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.536+0000 7f8d5c71dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:50.543 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.536+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.550 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.542+0000 7f8d5c71dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:50.551 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.542+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.567 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.559+0000 7f8d5c71dec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:50.567 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.559+0000 7f8d5c71dec0 20 zonegroup default 2019-12-09T13:25:50.568 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.559+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.568+0000 7f8d5c71dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:50.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.568+0000 7f8d5c71dec0 10 Cannot find current period zone using local zone 2019-12-09T13:25:50.576 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.568+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.578+0000 7f8d5c71dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.578+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.596 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.588+0000 7f8d5c71dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:50.596 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.588+0000 7f8d5c71dec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:50.604 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.596+0000 7f8d5c71dec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:50.604 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.596+0000 7f8d5c71dec0 20 zone default found 2019-12-09T13:25:50.604 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.596+0000 7f8d5c71dec0 20 started sync module instance, tier type = 2019-12-09T13:25:50.611 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.596+0000 7f8d5c71dec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T13:25:51.005 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.997+0000 7f8d5c71dec0 20 add_watcher() i=0 2019-12-09T13:25:51.005 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.997+0000 7f8d5c71dec0 20 add_watcher() i=1 2019-12-09T13:25:51.005 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.997+0000 7f8d5c71dec0 20 add_watcher() i=2 2019-12-09T13:25:51.005 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.997+0000 7f8d5c71dec0 20 add_watcher() i=3 2019-12-09T13:25:51.005 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.997+0000 7f8d5c71dec0 20 add_watcher() i=4 2019-12-09T13:25:51.006 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:50.997+0000 7f8d5c71dec0 20 add_watcher() i=5 2019-12-09T13:25:51.010 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:51.003+0000 7f8d5c71dec0 20 add_watcher() i=6 2019-12-09T13:25:51.056 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:51.049+0000 7f8d5c71dec0 20 add_watcher() i=7 2019-12-09T13:25:51.057 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:51.049+0000 7f8d5c71dec0 2 all 8 watchers are set, enabling cache 2019-12-09T13:25:51.057 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:51.049+0000 7f8d1a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T13:25:51.062 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:51.054+0000 7f8d49146700 0 -- 172.21.15.146:0/2425521724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613757d0bf0 msgr2=0x5613757d3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-09T13:25:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:51.256+0000 7f8d49146700 0 --2- 172.21.15.146:0/2425521724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5613757d0bf0 0x5613757d3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-09T13:25:51.324 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:51.313+0000 7f8d49947700 0 -- 172.21.15.146:0/998226006 >> [v2:172.21.15.146:6800/9590,v1:172.21.15.146:6801/9590] conn(0x7f8c8c022470 msgr2=0x7f8c8c024960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T13:25:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.609+0000 7f8c90ff9700 20 reqs_thread_entry: start 2019-12-09T13:25:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.610+0000 7f8c8a7fc700 20 reqs_thread_entry: start 2019-12-09T13:25:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.610+0000 7f8d5c71dec0 20 init_complete bucket index max shards: 0 2019-12-09T13:25:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.610+0000 7f8c88ff9700 20 reqs_thread_entry: start 2019-12-09T13:25:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.610+0000 7f8d5c71dec0 20 get_system_obj_state: rctx=0x7ffea81f82e8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x56137584e920 s->prefetch_data=0 2019-12-09T13:25:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.610+0000 7f8d5c71dec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-09T13:25:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.618+0000 7f8d5c71dec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-12-09T13:25:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.618+0000 7f8d5c71dec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T13:25:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.618+0000 7f8d5c71dec0 20 get_system_obj_state: rctx=0x7ffea81f82f8 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x5613758506b0 s->prefetch_data=0 2019-12-09T13:25:52.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.618+0000 7f8d5c71dec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-12-09T13:25:52.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.623+0000 7f8d5c71dec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-12-09T13:25:52.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.623+0000 7f8d5c71dec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-09T13:25:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.623+0000 7f8d5c71dec0 20 get_system_obj_state: rctx=0x7ffea81f82f8 obj=default.rgw.meta:users.keys:MEMTKIBLATUWGMORCWSW state=0x5613758506b0 s->prefetch_data=0 2019-12-09T13:25:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.623+0000 7f8d5c71dec0 10 cache get: name=default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW : miss 2019-12-09T13:25:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.630+0000 7f8d5c71dec0 10 cache put: name=default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW info.flags=0x0 2019-12-09T13:25:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.630+0000 7f8d5c71dec0 10 adding default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW to cache LRU end 2019-12-09T13:25:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.630+0000 7f8d5c71dec0 20 get_system_obj_state: rctx=0x7ffea81f7f08 obj=default.rgw.meta:users.keys:MEMTKIBLATUWGMORCWSW state=0x5613758506b0 s->prefetch_data=0 2019-12-09T13:25:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.630+0000 7f8d5c71dec0 10 cache get: name=default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW : type miss (requested=0x6, cached=0x0) 2019-12-09T13:25:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.636+0000 7f8d5c71dec0 10 cache put: name=default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW info.flags=0x0 2019-12-09T13:25:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.636+0000 7f8d5c71dec0 10 moving default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW to cache LRU end 2019-12-09T13:25:52.666 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.636+0000 7f8d5c71dec0 20 get_system_obj_state: rctx=0x7ffea81f8088 obj=default.rgw.meta:users.keys:MEMTKIBLATUWGMORCWSW state=0x5613758506b0 s->prefetch_data=0 2019-12-09T13:25:52.666 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.636+0000 7f8d5c71dec0 10 cache get: name=default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW : type miss (requested=0x6, cached=0x0) 2019-12-09T13:25:52.666 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.641+0000 7f8d5c71dec0 10 cache put: name=default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW info.flags=0x0 2019-12-09T13:25:52.667 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.641+0000 7f8d5c71dec0 10 moving default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW to cache LRU end 2019-12-09T13:25:52.700 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.692+0000 7f8d5c71dec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T13:25:52.700 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.692+0000 7f8d5c71dec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T13:25:52.700 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.692+0000 7f8d5c71dec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=617 2019-12-09T13:25:52.709 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.702+0000 7f8d2affd700 10 RGWWatcher::handle_notify() notify_id 605590388773 cookie 94641575373792 notifier 4885 bl.length()=617 2019-12-09T13:25:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.702+0000 7f8d2affd700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T13:25:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:52.702+0000 7f8d2affd700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T13:25:53.161 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.153+0000 7f8d5c71dec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-09T13:25:53.161 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.153+0000 7f8d5c71dec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-09T13:25:53.161 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.153+0000 7f8d5c71dec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-12-09T13:25:53.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.170+0000 7f8d2affd700 10 RGWWatcher::handle_notify() notify_id 605590388793 cookie 94641575415472 notifier 4885 bl.length()=194 2019-12-09T13:25:53.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.170+0000 7f8d2affd700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-09T13:25:53.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.170+0000 7f8d2affd700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-09T13:25:53.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.392+0000 7f8d5c71dec0 10 cache put: name=default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW info.flags=0x7 2019-12-09T13:25:53.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.392+0000 7f8d5c71dec0 10 moving default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW to cache LRU end 2019-12-09T13:25:53.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.392+0000 7f8d5c71dec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=186 2019-12-09T13:25:53.411 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.403+0000 7f8d2affd700 10 RGWWatcher::handle_notify() notify_id 605590388777 cookie 94641575375776 notifier 4885 bl.length()=186 2019-12-09T13:25:53.411 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.403+0000 7f8d2affd700 10 cache put: name=default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW info.flags=0x7 2019-12-09T13:25:53.412 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.404+0000 7f8d2affd700 10 moving default.rgw.meta+users.keys+MEMTKIBLATUWGMORCWSW to cache LRU end 2019-12-09T13:25:53.438 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2019-12-09T13:25:53.439 INFO:teuthology.orchestra.run.smithi146.stdout: "user_id": "foo.client.0", 2019-12-09T13:25:53.439 INFO:teuthology.orchestra.run.smithi146.stdout: "display_name": "Mr. foo.client.0", 2019-12-09T13:25:53.439 INFO:teuthology.orchestra.run.smithi146.stdout: "email": "foo.client.0+test@test.test", 2019-12-09T13:25:53.439 INFO:teuthology.orchestra.run.smithi146.stdout: "suspended": 0, 2019-12-09T13:25:53.439 INFO:teuthology.orchestra.run.smithi146.stdout: "max_buckets": 1000, 2019-12-09T13:25:53.439 INFO:teuthology.orchestra.run.smithi146.stdout: "subusers": [], 2019-12-09T13:25:53.440 INFO:teuthology.orchestra.run.smithi146.stdout: "keys": [ 2019-12-09T13:25:53.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2019-12-09T13:25:53.440 INFO:teuthology.orchestra.run.smithi146.stdout: "user": "foo.client.0", 2019-12-09T13:25:53.440 INFO:teuthology.orchestra.run.smithi146.stdout: "access_key": "MEMTKIBLATUWGMORCWSW", 2019-12-09T13:25:53.440 INFO:teuthology.orchestra.run.smithi146.stdout: "secret_key": "LnJMn0UFcHZselzFf5e0RskgEZTT14+ELRzBiBCcFBwBecna+16nlQ==" 2019-12-09T13:25:53.440 INFO:teuthology.orchestra.run.smithi146.stdout: } 2019-12-09T13:25:53.440 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2019-12-09T13:25:53.441 INFO:teuthology.orchestra.run.smithi146.stdout: "swift_keys": [], 2019-12-09T13:25:53.441 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": [], 2019-12-09T13:25:53.441 INFO:teuthology.orchestra.run.smithi146.stdout: "op_mask": "read, write, delete", 2019-12-09T13:25:53.441 INFO:teuthology.orchestra.run.smithi146.stdout: "default_placement": "", 2019-12-09T13:25:53.441 INFO:teuthology.orchestra.run.smithi146.stdout: "default_storage_class": "", 2019-12-09T13:25:53.441 INFO:teuthology.orchestra.run.smithi146.stdout: "placement_tags": [], 2019-12-09T13:25:53.441 INFO:teuthology.orchestra.run.smithi146.stdout: "bucket_quota": { 2019-12-09T13:25:53.442 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T13:25:53.442 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T13:25:53.442 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T13:25:53.442 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T13:25:53.442 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T13:25:53.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T13:25:53.442 INFO:teuthology.orchestra.run.smithi146.stdout: "user_quota": { 2019-12-09T13:25:53.443 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T13:25:53.443 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T13:25:53.443 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T13:25:53.443 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T13:25:53.443 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T13:25:53.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T13:25:53.443 INFO:teuthology.orchestra.run.smithi146.stdout: "temp_url_keys": [], 2019-12-09T13:25:53.443 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "rgw", 2019-12-09T13:25:53.444 INFO:teuthology.orchestra.run.smithi146.stdout: "mfa_ids": [] 2019-12-09T13:25:53.444 INFO:teuthology.orchestra.run.smithi146.stdout:} 2019-12-09T13:25:53.444 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:25:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.509+0000 7f8d5c71dec0 20 remove_watcher() i=0 2019-12-09T13:25:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.509+0000 7f8d5c71dec0 2 removed watcher, disabling cache 2019-12-09T13:25:53.567 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.560+0000 7f8d5c71dec0 20 remove_watcher() i=1 2019-12-09T13:25:53.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.623+0000 7f8d5c71dec0 20 remove_watcher() i=2 2019-12-09T13:25:53.708 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.700+0000 7f8d5c71dec0 20 remove_watcher() i=3 2019-12-09T13:25:53.764 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.754+0000 7f8d5c71dec0 20 remove_watcher() i=4 2019-12-09T13:25:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.811+0000 7f8d5c71dec0 20 remove_watcher() i=5 2019-12-09T13:25:53.871 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.864+0000 7f8d5c71dec0 20 remove_watcher() i=6 2019-12-09T13:25:53.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:53.914+0000 7f8d5c71dec0 20 remove_watcher() i=7 2019-12-09T13:25:53.929 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 9678082988 --totp-seed KPLCQSTKXTWDOSAS6PUB7MVY5VNV2HKCWXDOOPNM357PPNHOJFCSDT6IKYR4OKSP --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-12-09T13:25:54.058 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.050+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.088 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.081+0000 7f38f5d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:54.089 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.081+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.102 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.093+0000 7f38f5d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:54.102 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.093+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.107 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.099+0000 7f38f5d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:54.107 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.099+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.116 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.109+0000 7f38f5d6fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.300+0000 7f38f5d6fec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T13:25:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.300+0000 7f38f5d6fec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T13:25:54.308 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.300+0000 7f38f5d6fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T13:25:54.308 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.300+0000 7f38f5d6fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T13:25:54.308 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.300+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.315 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.307+0000 7f38f5d6fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:54.315 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.307+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.327 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.319+0000 7f38f5d6fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:54.327 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.319+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.341 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.333+0000 7f38f5d6fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:54.341 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.333+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.363 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.355+0000 7f38f5d6fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:54.363 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.355+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.367 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.359+0000 7f38f5d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:54.367 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.359+0000 7f38f5d6fec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T13:25:54.367 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.359+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.372 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.365+0000 7f38f5d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:54.372 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.365+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.380 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.373+0000 7f38f5d6fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:54.380 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.373+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.399 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.391+0000 7f38f5d6fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:54.399 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.391+0000 7f38f5d6fec0 20 zonegroup default 2019-12-09T13:25:54.399 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.391+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.405 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.397+0000 7f38f5d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:54.405 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.397+0000 7f38f5d6fec0 10 Cannot find current period zone using local zone 2019-12-09T13:25:54.405 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.397+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.412 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.401+0000 7f38f5d6fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:54.412 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.401+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.408+0000 7f38f5d6fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.409+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:54.427 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.419+0000 7f38f5d6fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:54.427 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.419+0000 7f38f5d6fec0 20 zone default found 2019-12-09T13:25:54.428 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.419+0000 7f38f5d6fec0 20 started sync module instance, tier type = 2019-12-09T13:25:54.428 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.419+0000 7f38f5d6fec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T13:25:54.865 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.857+0000 7f38f5d6fec0 20 add_watcher() i=0 2019-12-09T13:25:54.865 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.857+0000 7f38f5d6fec0 20 add_watcher() i=1 2019-12-09T13:25:54.865 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.857+0000 7f38f5d6fec0 20 add_watcher() i=2 2019-12-09T13:25:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.857+0000 7f38f5d6fec0 20 add_watcher() i=3 2019-12-09T13:25:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.857+0000 7f38f5d6fec0 20 add_watcher() i=4 2019-12-09T13:25:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.857+0000 7f38f5d6fec0 20 add_watcher() i=5 2019-12-09T13:25:54.895 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.888+0000 7f38f5d6fec0 20 add_watcher() i=6 2019-12-09T13:25:54.907 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.900+0000 7f38f5d6fec0 20 add_watcher() i=7 2019-12-09T13:25:54.908 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.900+0000 7f38f5d6fec0 2 all 8 watchers are set, enabling cache 2019-12-09T13:25:54.908 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.900+0000 7f38b37de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T13:25:54.921 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.908+0000 7f38e2f99700 0 -- 172.21.15.146:0/2722696578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559214701d40 msgr2=0x5592147041c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T13:25:54.965 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:54.942+0000 7f38e2f99700 0 -- 172.21.15.146:0/3704247346 >> v2:172.21.15.194:3300/0 conn(0x559214708210 msgr2=0x55921470a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T13:25:56.569 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.560+0000 7f3821ffb700 20 reqs_thread_entry: start 2019-12-09T13:25:56.569 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.561+0000 7f381b7fe700 20 reqs_thread_entry: start 2019-12-09T13:25:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.561+0000 7f38f5d6fec0 20 init_complete bucket index max shards: 0 2019-12-09T13:25:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.562+0000 7f3819ffb700 20 reqs_thread_entry: start 2019-12-09T13:25:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.562+0000 7f38f5d6fec0 20 get_system_obj_state: rctx=0x7fff33952578 obj=default.rgw.meta:users.uid:foo.client.0 state=0x559214783920 s->prefetch_data=0 2019-12-09T13:25:56.571 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.562+0000 7f38f5d6fec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-09T13:25:56.594 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.585+0000 7f38f5d6fec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-12-09T13:25:56.594 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.585+0000 7f38f5d6fec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T13:25:56.594 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.585+0000 7f38f5d6fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T13:25:56.595 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.585+0000 7f38f5d6fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T13:25:56.595 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.585+0000 7f38f5d6fec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T13:25:56.595 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.585+0000 7f38f5d6fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:56.623 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.614+0000 7f38f5d6fec0 20 rados_obj.operate() r=0 bl.length=432 2019-12-09T13:25:56.623 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.614+0000 7f38f5d6fec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-12-09T13:25:56.623 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.614+0000 7f38f5d6fec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T13:25:56.794 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.782+0000 7f38f5d6fec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T13:25:56.794 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.782+0000 7f38f5d6fec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T13:25:56.794 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.782+0000 7f38f5d6fec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=631 2019-12-09T13:25:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.797+0000 7f38c3fff700 10 RGWWatcher::handle_notify() notify_id 605590388774 cookie 94085896371264 notifier 4920 bl.length()=631 2019-12-09T13:25:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.797+0000 7f38c3fff700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T13:25:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:56.797+0000 7f38c3fff700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T13:25:57.312 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.304+0000 7f38f5d6fec0 20 remove_watcher() i=0 2019-12-09T13:25:57.313 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.304+0000 7f38f5d6fec0 2 removed watcher, disabling cache 2019-12-09T13:25:57.367 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.359+0000 7f38f5d6fec0 20 remove_watcher() i=1 2019-12-09T13:25:57.397 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.389+0000 7f38f5d6fec0 20 remove_watcher() i=2 2019-12-09T13:25:57.460 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.452+0000 7f38f5d6fec0 20 remove_watcher() i=3 2019-12-09T13:25:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.502+0000 7f38f5d6fec0 20 remove_watcher() i=4 2019-12-09T13:25:57.564 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.555+0000 7f38f5d6fec0 20 remove_watcher() i=5 2019-12-09T13:25:57.630 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.622+0000 7f38f5d6fec0 20 remove_watcher() i=6 2019-12-09T13:25:57.701 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.685+0000 7f38f5d6fec0 20 remove_watcher() i=7 2019-12-09T13:25:57.704 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2019-12-09T13:25:57.704 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --access-key LIMOZFEXHGALFWUJAXEK --secret ErOUIyqXgEyXApTLiNm1o1Vf5kCsmTCDfsH7Am138X6/otwVHzV06A== --email 'testx$tenanteduser.client.0+test@test.test' --cluster ceph 2019-12-09T13:25:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.854+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.903+0000 7fefae24fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.903+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.914+0000 7fefae24fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.914+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:57.927 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.919+0000 7fefae24fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:57.927 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.919+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:57.935 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:57.926+0000 7fefae24fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:58.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.099+0000 7fefae24fec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T13:25:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.099+0000 7fefae24fec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T13:25:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.099+0000 7fefae24fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T13:25:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.099+0000 7fefae24fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T13:25:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.099+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.109+0000 7fefae24fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.109+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.117+0000 7fefae24fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.117+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.127+0000 7fefae24fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.127+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.145+0000 7fefae24fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.146+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.150+0000 7fefae24fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.150+0000 7fefae24fec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T13:25:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.150+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.156+0000 7fefae24fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.156+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.166+0000 7fefae24fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.166+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:58.192 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.183+0000 7fefae24fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:25:58.192 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.183+0000 7fefae24fec0 20 zonegroup default 2019-12-09T13:25:58.199 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.183+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:58.200 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.190+0000 7fefae24fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:58.200 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.190+0000 7fefae24fec0 10 Cannot find current period zone using local zone 2019-12-09T13:25:58.200 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.190+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:58.207 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.198+0000 7fefae24fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:25:58.207 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.198+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.209+0000 7fefae24fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:25:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.209+0000 7fefae24fec0 20 rados->read ofs=0 len=0 2019-12-09T13:25:58.234 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.221+0000 7fefae24fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:25:58.235 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.221+0000 7fefae24fec0 20 zone default found 2019-12-09T13:25:58.235 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.221+0000 7fefae24fec0 20 started sync module instance, tier type = 2019-12-09T13:25:58.235 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.221+0000 7fefae24fec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T13:25:58.574 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.565+0000 7fef9bc7a700 0 -- 172.21.15.146:0/3171632185 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x55a592fae0d0 msgr2=0x55a592fb04f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T13:25:58.642 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.633+0000 7fefae24fec0 20 add_watcher() i=0 2019-12-09T13:25:58.642 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.633+0000 7fefae24fec0 20 add_watcher() i=1 2019-12-09T13:25:58.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.633+0000 7fefae24fec0 20 add_watcher() i=2 2019-12-09T13:25:58.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.633+0000 7fefae24fec0 20 add_watcher() i=3 2019-12-09T13:25:58.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.633+0000 7fefae24fec0 20 add_watcher() i=4 2019-12-09T13:25:58.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.633+0000 7fefae24fec0 20 add_watcher() i=5 2019-12-09T13:25:58.643 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.633+0000 7fefae24fec0 20 add_watcher() i=6 2019-12-09T13:25:58.671 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.662+0000 7fefae24fec0 20 add_watcher() i=7 2019-12-09T13:25:58.671 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.662+0000 7fefae24fec0 2 all 8 watchers are set, enabling cache 2019-12-09T13:25:58.672 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.662+0000 7fef6bfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T13:25:58.686 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:25:58.677+0000 7fef9b479700 0 -- 172.21.15.146:0/3971889244 >> v2:172.21.15.146:3300/0 conn(0x55a592fdea70 msgr2=0x55a592fe0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T13:26:00.015 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.007+0000 7feeda7fc700 20 reqs_thread_entry: start 2019-12-09T13:26:00.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.007+0000 7feed3fff700 20 reqs_thread_entry: start 2019-12-09T13:26:00.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.007+0000 7fefae24fec0 20 init_complete bucket index max shards: 0 2019-12-09T13:26:00.016 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.008+0000 7feed27fc700 20 reqs_thread_entry: start 2019-12-09T13:26:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.008+0000 7fefae24fec0 20 get_system_obj_state: rctx=0x7ffd20267368 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55a593059210 s->prefetch_data=0 2019-12-09T13:26:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.008+0000 7fefae24fec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-12-09T13:26:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.014+0000 7fefae24fec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2019-12-09T13:26:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.014+0000 7fefae24fec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T13:26:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.014+0000 7fefae24fec0 20 get_system_obj_state: rctx=0x7ffd20267378 obj=default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test state=0x55a59305afc0 s->prefetch_data=0 2019-12-09T13:26:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.014+0000 7fefae24fec0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2019-12-09T13:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.020+0000 7fefae24fec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2019-12-09T13:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.020+0000 7fefae24fec0 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-12-09T13:26:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.020+0000 7fefae24fec0 20 get_system_obj_state: rctx=0x7ffd20267378 obj=default.rgw.meta:users.keys:LIMOZFEXHGALFWUJAXEK state=0x55a59305afc0 s->prefetch_data=0 2019-12-09T13:26:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.020+0000 7fefae24fec0 10 cache get: name=default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK : miss 2019-12-09T13:26:00.040 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.032+0000 7fefae24fec0 10 cache put: name=default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK info.flags=0x0 2019-12-09T13:26:00.040 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.032+0000 7fefae24fec0 10 adding default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK to cache LRU end 2019-12-09T13:26:00.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.032+0000 7fefae24fec0 20 get_system_obj_state: rctx=0x7ffd20266f88 obj=default.rgw.meta:users.keys:LIMOZFEXHGALFWUJAXEK state=0x55a59305afc0 s->prefetch_data=0 2019-12-09T13:26:00.041 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.032+0000 7fefae24fec0 10 cache get: name=default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK : type miss (requested=0x6, cached=0x0) 2019-12-09T13:26:00.063 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.055+0000 7fefae24fec0 10 cache put: name=default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK info.flags=0x0 2019-12-09T13:26:00.064 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.055+0000 7fefae24fec0 10 moving default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK to cache LRU end 2019-12-09T13:26:00.064 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.055+0000 7fefae24fec0 20 get_system_obj_state: rctx=0x7ffd20267108 obj=default.rgw.meta:users.keys:LIMOZFEXHGALFWUJAXEK state=0x55a59305afc0 s->prefetch_data=0 2019-12-09T13:26:00.064 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.055+0000 7fefae24fec0 10 cache get: name=default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK : type miss (requested=0x6, cached=0x0) 2019-12-09T13:26:00.073 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.065+0000 7fefae24fec0 10 cache put: name=default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK info.flags=0x0 2019-12-09T13:26:00.074 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.065+0000 7fefae24fec0 10 moving default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK to cache LRU end 2019-12-09T13:26:00.135 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.126+0000 7fefae24fec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-09T13:26:00.135 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.126+0000 7fefae24fec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T13:26:00.135 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.126+0000 7fefae24fec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=691 2019-12-09T13:26:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.135+0000 7fef80ff9700 10 RGWWatcher::handle_notify() notify_id 605590388795 cookie 94169623979056 notifier 4932 bl.length()=691 2019-12-09T13:26:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.135+0000 7fef80ff9700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-09T13:26:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.135+0000 7fef80ff9700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T13:26:00.259 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.250+0000 7fefae24fec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-12-09T13:26:00.259 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.250+0000 7fefae24fec0 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-12-09T13:26:00.259 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.250+0000 7fefae24fec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=224 2019-12-09T13:26:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.267+0000 7fef80ff9700 10 RGWWatcher::handle_notify() notify_id 605590388794 cookie 94169623997120 notifier 4932 bl.length()=224 2019-12-09T13:26:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.267+0000 7fef80ff9700 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-12-09T13:26:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.267+0000 7fef80ff9700 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-12-09T13:26:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.650+0000 7fefae24fec0 10 cache put: name=default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK info.flags=0x7 2019-12-09T13:26:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.650+0000 7fefae24fec0 10 moving default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK to cache LRU end 2019-12-09T13:26:00.665 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.650+0000 7fefae24fec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=201 2019-12-09T13:26:00.672 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.664+0000 7fef80ff9700 10 RGWWatcher::handle_notify() notify_id 605590388775 cookie 94169623953376 notifier 4932 bl.length()=201 2019-12-09T13:26:00.673 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.664+0000 7fef80ff9700 10 cache put: name=default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK info.flags=0x7 2019-12-09T13:26:00.673 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:00.664+0000 7fef80ff9700 10 moving default.rgw.meta+users.keys+LIMOZFEXHGALFWUJAXEK to cache LRU end 2019-12-09T13:26:01.186 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2019-12-09T13:26:01.197 INFO:teuthology.orchestra.run.smithi146.stdout: "user_id": "testx$tenanteduser.client.0", 2019-12-09T13:26:01.197 INFO:teuthology.orchestra.run.smithi146.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2019-12-09T13:26:01.198 INFO:teuthology.orchestra.run.smithi146.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2019-12-09T13:26:01.198 INFO:teuthology.orchestra.run.smithi146.stdout: "suspended": 0, 2019-12-09T13:26:01.198 INFO:teuthology.orchestra.run.smithi146.stdout: "max_buckets": 1000, 2019-12-09T13:26:01.199 INFO:teuthology.orchestra.run.smithi146.stdout: "subusers": [], 2019-12-09T13:26:01.199 INFO:teuthology.orchestra.run.smithi146.stdout: "keys": [ 2019-12-09T13:26:01.199 INFO:teuthology.orchestra.run.smithi146.stdout: { 2019-12-09T13:26:01.199 INFO:teuthology.orchestra.run.smithi146.stdout: "user": "testx$tenanteduser.client.0", 2019-12-09T13:26:01.200 INFO:teuthology.orchestra.run.smithi146.stdout: "access_key": "LIMOZFEXHGALFWUJAXEK", 2019-12-09T13:26:01.201 INFO:teuthology.orchestra.run.smithi146.stdout: "secret_key": "ErOUIyqXgEyXApTLiNm1o1Vf5kCsmTCDfsH7Am138X6/otwVHzV06A==" 2019-12-09T13:26:01.201 INFO:teuthology.orchestra.run.smithi146.stdout: } 2019-12-09T13:26:01.201 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2019-12-09T13:26:01.201 INFO:teuthology.orchestra.run.smithi146.stdout: "swift_keys": [], 2019-12-09T13:26:01.202 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": [], 2019-12-09T13:26:01.202 INFO:teuthology.orchestra.run.smithi146.stdout: "op_mask": "read, write, delete", 2019-12-09T13:26:01.202 INFO:teuthology.orchestra.run.smithi146.stdout: "default_placement": "", 2019-12-09T13:26:01.202 INFO:teuthology.orchestra.run.smithi146.stdout: "default_storage_class": "", 2019-12-09T13:26:01.202 INFO:teuthology.orchestra.run.smithi146.stdout: "placement_tags": [], 2019-12-09T13:26:01.203 INFO:teuthology.orchestra.run.smithi146.stdout: "bucket_quota": { 2019-12-09T13:26:01.203 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T13:26:01.203 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T13:26:01.203 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T13:26:01.204 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T13:26:01.204 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T13:26:01.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T13:26:01.204 INFO:teuthology.orchestra.run.smithi146.stdout: "user_quota": { 2019-12-09T13:26:01.205 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T13:26:01.205 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T13:26:01.205 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T13:26:01.205 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T13:26:01.206 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T13:26:01.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T13:26:01.206 INFO:teuthology.orchestra.run.smithi146.stdout: "temp_url_keys": [], 2019-12-09T13:26:01.206 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "rgw", 2019-12-09T13:26:01.206 INFO:teuthology.orchestra.run.smithi146.stdout: "mfa_ids": [] 2019-12-09T13:26:01.206 INFO:teuthology.orchestra.run.smithi146.stdout:} 2019-12-09T13:26:01.207 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:01.250 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.241+0000 7fefae24fec0 20 remove_watcher() i=0 2019-12-09T13:26:01.250 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.241+0000 7fefae24fec0 2 removed watcher, disabling cache 2019-12-09T13:26:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.276+0000 7fefae24fec0 20 remove_watcher() i=1 2019-12-09T13:26:01.324 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.312+0000 7fefae24fec0 20 remove_watcher() i=2 2019-12-09T13:26:01.390 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.381+0000 7fefae24fec0 20 remove_watcher() i=3 2019-12-09T13:26:01.443 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.434+0000 7fefae24fec0 20 remove_watcher() i=4 2019-12-09T13:26:01.491 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.483+0000 7fefae24fec0 20 remove_watcher() i=5 2019-12-09T13:26:01.540 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.531+0000 7fefae24fec0 20 remove_watcher() i=6 2019-12-09T13:26:01.588 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.579+0000 7fefae24fec0 20 remove_watcher() i=7 2019-12-09T13:26:01.597 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 6134577779 --totp-seed 4AQVQTAPLK5TTGONS5ONAISEB6KCQYGCEWCRPU6UHWLPB6RHGQBWXSKJBVUK3UG3 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-12-09T13:26:01.765 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.754+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:01.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.777+0000 7f80a17d1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:26:01.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.777+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:01.800 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.786+0000 7f80a17d1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:26:01.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.786+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:01.802 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.791+0000 7f80a17d1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:26:01.802 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.791+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.802+0000 7f80a17d1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:26:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.988+0000 7f80a17d1ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T13:26:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.988+0000 7f80a17d1ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T13:26:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.988+0000 7f80a17d1ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T13:26:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.988+0000 7f80a17d1ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T13:26:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:01.989+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:02.008 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.000+0000 7f80a17d1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:26:02.009 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.000+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.012+0000 7f80a17d1ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:26:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.013+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.026+0000 7f80a17d1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:26:02.035 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.026+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:02.052 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.043+0000 7f80a17d1ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:26:02.052 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.043+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:02.058 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.050+0000 7f80a17d1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:26:02.059 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.050+0000 7f80a17d1ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T13:26:02.059 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.050+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.056+0000 7f80a17d1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:26:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.056+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:02.073 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.064+0000 7f80a17d1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:26:02.073 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.064+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:02.090 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.081+0000 7f80a17d1ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T13:26:02.090 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.081+0000 7f80a17d1ec0 20 zonegroup default 2019-12-09T13:26:02.090 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.081+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:02.096 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.087+0000 7f80a17d1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:26:02.096 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.087+0000 7f80a17d1ec0 10 Cannot find current period zone using local zone 2019-12-09T13:26:02.096 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.087+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:02.101 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.092+0000 7f80a17d1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T13:26:02.101 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.092+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:02.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.099+0000 7f80a17d1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T13:26:02.108 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.099+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.109+0000 7f80a17d1ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T13:26:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.109+0000 7f80a17d1ec0 20 zone default found 2019-12-09T13:26:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.109+0000 7f80a17d1ec0 20 started sync module instance, tier type = 2019-12-09T13:26:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.109+0000 7f80a17d1ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T13:26:02.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.524+0000 7f80a17d1ec0 20 add_watcher() i=0 2019-12-09T13:26:02.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.524+0000 7f80a17d1ec0 20 add_watcher() i=1 2019-12-09T13:26:02.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.524+0000 7f80a17d1ec0 20 add_watcher() i=2 2019-12-09T13:26:02.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.524+0000 7f80a17d1ec0 20 add_watcher() i=3 2019-12-09T13:26:02.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.524+0000 7f80a17d1ec0 20 add_watcher() i=4 2019-12-09T13:26:02.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.524+0000 7f80a17d1ec0 20 add_watcher() i=5 2019-12-09T13:26:02.550 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.531+0000 7f808e9fb700 0 -- 172.21.15.146:0/1576432380 >> [v2:172.21.15.194:6824/10135,v1:172.21.15.194:6825/10135] conn(0x563ef7007390 msgr2=0x563ef70097b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T13:26:02.550 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.531+0000 7f80a17d1ec0 20 add_watcher() i=6 2019-12-09T13:26:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.617+0000 7f80a17d1ec0 20 add_watcher() i=7 2019-12-09T13:26:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.617+0000 7f80a17d1ec0 2 all 8 watchers are set, enabling cache 2019-12-09T13:26:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.617+0000 7f805f7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T13:26:02.646 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:02.638+0000 7f808f1fc700 0 -- 172.21.15.146:0/1488937668 >> v2:172.21.15.146:3300/0 conn(0x563ef701ab30 msgr2=0x563ef701af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T13:26:04.155 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.146+0000 7f7fcdffb700 20 reqs_thread_entry: start 2019-12-09T13:26:04.156 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.147+0000 7f7fc77fe700 20 reqs_thread_entry: start 2019-12-09T13:26:04.156 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.147+0000 7f80a17d1ec0 20 init_complete bucket index max shards: 0 2019-12-09T13:26:04.156 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.147+0000 7f7fc5ffb700 20 reqs_thread_entry: start 2019-12-09T13:26:04.157 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.147+0000 7f80a17d1ec0 20 get_system_obj_state: rctx=0x7ffdfc920f28 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x563ef7099c40 s->prefetch_data=0 2019-12-09T13:26:04.157 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.147+0000 7f80a17d1ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-12-09T13:26:04.170 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.161+0000 7f80a17d1ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-12-09T13:26:04.170 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.161+0000 7f80a17d1ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T13:26:04.170 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.161+0000 7f80a17d1ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T13:26:04.170 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.161+0000 7f80a17d1ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T13:26:04.171 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.161+0000 7f80a17d1ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T13:26:04.171 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.161+0000 7f80a17d1ec0 20 rados->read ofs=0 len=0 2019-12-09T13:26:04.189 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.180+0000 7f80a17d1ec0 20 rados_obj.operate() r=0 bl.length=491 2019-12-09T13:26:04.189 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.180+0000 7f80a17d1ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-12-09T13:26:04.189 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.180+0000 7f80a17d1ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T13:26:04.354 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.346+0000 7f80a17d1ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-09T13:26:04.355 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.346+0000 7f80a17d1ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T13:26:04.355 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.346+0000 7f80a17d1ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=705 2019-12-09T13:26:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.357+0000 7f806ffff700 10 RGWWatcher::handle_notify() notify_id 605590388796 cookie 94828431958080 notifier 4694 bl.length()=705 2019-12-09T13:26:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.358+0000 7f806ffff700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-09T13:26:04.367 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.358+0000 7f806ffff700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T13:26:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.925+0000 7f80a17d1ec0 20 remove_watcher() i=0 2019-12-09T13:26:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.925+0000 7f80a17d1ec0 2 removed watcher, disabling cache 2019-12-09T13:26:04.977 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:04.968+0000 7f80a17d1ec0 20 remove_watcher() i=1 2019-12-09T13:26:05.024 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:05.015+0000 7f80a17d1ec0 20 remove_watcher() i=2 2019-12-09T13:26:05.080 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:05.072+0000 7f80a17d1ec0 20 remove_watcher() i=3 2019-12-09T13:26:05.131 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:05.122+0000 7f80a17d1ec0 20 remove_watcher() i=4 2019-12-09T13:26:05.171 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:05.163+0000 7f80a17d1ec0 20 remove_watcher() i=5 2019-12-09T13:26:05.214 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:05.206+0000 7f80a17d1ec0 20 remove_watcher() i=6 2019-12-09T13:26:05.262 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T13:26:05.253+0000 7f80a17d1ec0 20 remove_watcher() i=7 2019-12-09T13:26:05.272 INFO:tasks.s3tests:Configuring s3-tests... 2019-12-09T13:26:05.273 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest/s3-tests && ./bootstrap 2019-12-09T13:26:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-12-09T13:26:10.849 INFO:teuthology.orchestra.run.smithi146.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T13:26:10.887 INFO:teuthology.orchestra.run.smithi146.stdout:Loading mirror speeds from cached hostfile 2019-12-09T13:26:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: * base: mirror.ash.fastserv.com 2019-12-09T13:26:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T13:26:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T13:26:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: * updates: mirror.cogentco.com 2019-12-09T13:26:11.589 INFO:teuthology.orchestra.run.smithi146.stdout:7 packages excluded due to repository priority protections 2019-12-09T13:26:11.937 INFO:teuthology.orchestra.run.smithi146.stdout:Resolving Dependencies 2019-12-09T13:26:11.938 INFO:teuthology.orchestra.run.smithi146.stdout:--> Running transaction check 2019-12-09T13:26:11.938 INFO:teuthology.orchestra.run.smithi146.stdout:---> Package libffi-devel.x86_64 0:3.0.13-18.el7 will be installed 2019-12-09T13:26:12.333 INFO:teuthology.orchestra.run.smithi146.stdout:--> Finished Dependency Resolution 2019-12-09T13:26:12.572 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:12.572 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies Resolved 2019-12-09T13:26:12.573 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:12.573 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T13:26:12.573 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2019-12-09T13:26:12.573 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T13:26:12.573 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2019-12-09T13:26:12.574 INFO:teuthology.orchestra.run.smithi146.stdout: libffi-devel x86_64 3.0.13-18.el7 base 23 k 2019-12-09T13:26:12.574 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:12.574 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2019-12-09T13:26:12.574 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2019-12-09T13:26:12.574 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2019-12-09T13:26:12.574 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:12.574 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 23 k 2019-12-09T13:26:12.575 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 27 k 2019-12-09T13:26:12.575 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading packages: 2019-12-09T13:26:12.702 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2019-12-09T13:26:12.707 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2019-12-09T13:26:12.709 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded 2019-12-09T13:26:12.709 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2019-12-09T13:26:13.224 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-12-09T13:26:13.606 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-12-09T13:26:13.606 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:13.606 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2019-12-09T13:26:13.606 INFO:teuthology.orchestra.run.smithi146.stdout: libffi-devel.x86_64 0:3.0.13-18.el7 2019-12-09T13:26:13.607 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:13.607 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2019-12-09T13:26:13.820 INFO:teuthology.orchestra.run.smithi146.stdout:New python executable in /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python 2019-12-09T13:26:15.329 INFO:teuthology.orchestra.run.smithi146.stdout:Installing setuptools, pip, wheel...done. 2019-12-09T13:26:15.608 INFO:teuthology.orchestra.run.smithi146.stderr:Cache entry deserialization failed, entry ignored 2019-12-09T13:26:15.772 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting pip 2019-12-09T13:26:15.843 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-12-09T13:26:15.915 INFO:teuthology.orchestra.run.smithi146.stdout:Installing collected packages: pip 2019-12-09T13:26:15.916 INFO:teuthology.orchestra.run.smithi146.stdout: Found existing installation: pip 9.0.1 2019-12-09T13:26:15.981 INFO:teuthology.orchestra.run.smithi146.stdout: Uninstalling pip-9.0.1: 2019-12-09T13:26:16.032 INFO:teuthology.orchestra.run.smithi146.stdout: Successfully uninstalled pip-9.0.1 2019-12-09T13:26:16.831 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully installed pip-19.3.1 2019-12-09T13:26:17.153 INFO:teuthology.orchestra.run.smithi146.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T13:26:17.606 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting setuptools==32.3.1 2019-12-09T13:26:17.609 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-12-09T13:26:17.650 INFO:teuthology.orchestra.run.smithi146.stdout:Installing collected packages: setuptools 2019-12-09T13:26:17.651 INFO:teuthology.orchestra.run.smithi146.stdout: Found existing installation: setuptools 28.8.0 2019-12-09T13:26:17.664 INFO:teuthology.orchestra.run.smithi146.stdout: Uninstalling setuptools-28.8.0: 2019-12-09T13:26:17.672 INFO:teuthology.orchestra.run.smithi146.stdout: Successfully uninstalled setuptools-28.8.0 2019-12-09T13:26:17.796 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully installed setuptools-32.3.1 2019-12-09T13:26:18.190 INFO:teuthology.orchestra.run.smithi146.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T13:26:18.392 INFO:teuthology.orchestra.run.smithi146.stdout:Processing /home/ubuntu/.cache/pip/wheels/54/b7/c7/2ada654ee54483c9329871665aaf4a6056c3ce36f29cf66e67/PyYAML-5.2-cp27-cp27mu-linux_x86_64.whl 2019-12-09T13:26:18.459 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting nose>=1.0.0 2019-12-09T13:26:18.461 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-12-09T13:26:18.566 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting boto>=2.6.0 2019-12-09T13:26:18.571 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-12-09T13:26:19.144 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting boto3>=1.0.0 2019-12-09T13:26:19.187 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/1f/a5/6b25e39aea40bc03163615c07572d90aaddc9951f5af9c21204d3da46398/boto3-1.10.34-py2.py3-none-any.whl (128kB) 2019-12-09T13:26:19.296 INFO:teuthology.orchestra.run.smithi146.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-12-09T13:26:19.548 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting gevent>=1.0 2019-12-09T13:26:19.560 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T13:26:19.798 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting isodate>=0.4.4 2019-12-09T13:26:19.808 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45kB) 2019-12-09T13:26:19.959 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting requests>=0.14.0 2019-12-09T13:26:19.969 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB) 2019-12-09T13:26:20.184 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting pytz>=2011k 2019-12-09T13:26:20.194 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/e7/f9/f0b53f88060247251bf481fa6ea62cd0d25bf1b11a87888e53ce5b7c8ad2/pytz-2019.3-py2.py3-none-any.whl (509kB) 2019-12-09T13:26:20.400 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting ordereddict 2019-12-09T13:26:20.410 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/53/25/ef88e8e45db141faa9598fbf7ad0062df8f50f881a36ed6a0073e1572126/ordereddict-1.1.tar.gz 2019-12-09T13:26:20.691 INFO:teuthology.orchestra.run.smithi146.stdout:Processing /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488/httplib2-0.14.0-cp27-none-any.whl 2019-12-09T13:26:21.089 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting lxml 2019-12-09T13:26:21.106 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T13:26:21.322 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting jmespath<1.0.0,>=0.7.1 2019-12-09T13:26:21.331 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/83/94/7179c3832a6d45b266ddb2aac329e101367fbdb11f425f13771d27f225bb/jmespath-0.9.4-py2.py3-none-any.whl 2019-12-09T13:26:21.932 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting botocore<1.14.0,>=1.13.34 2019-12-09T13:26:21.941 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/59/cb/b4772a4abc128f6fd637af9d7fc93a1db11617859af680fc2b2e6282eb95/botocore-1.13.34-py2.py3-none-any.whl (5.8MB) 2019-12-09T13:26:22.512 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting s3transfer<0.3.0,>=0.2.0 2019-12-09T13:26:22.531 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/16/8a/1fc3dba0c4923c2a76e1ff0d52b305c44606da63f718d14d3231e21c51b0/s3transfer-0.2.1-py2.py3-none-any.whl (70kB) 2019-12-09T13:26:22.751 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-12-09T13:26:22.753 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T13:26:22.820 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting six 2019-12-09T13:26:22.829 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-12-09T13:26:22.919 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting chardet<3.1.0,>=3.0.2 2019-12-09T13:26:22.929 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) 2019-12-09T13:26:23.033 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting idna<2.9,>=2.5 2019-12-09T13:26:23.041 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:20:44.094 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:23.042 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB) 2019-12-09T13:26:23.057 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:20:44.110 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:23.088 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:20:44.141 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:23.100 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:20:44.154 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:23.139 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:20:44.177 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:23.141 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:20:44.180 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:23.208 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 2019-12-09T13:26:23.214 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB) 2019-12-09T13:26:23.280 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:20:44.333 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:23.341 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting certifi>=2017.4.17 2019-12-09T13:26:23.352 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/b9/63/df50cac98ea0d5b006c55a399c3bf1db9da7b5a24de7890bc9cfd5dd9e99/certifi-2019.11.28-py2.py3-none-any.whl (156kB) 2019-12-09T13:26:23.374 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:20:44.427 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:23.434 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting docutils<0.16,>=0.10 2019-12-09T13:26:23.437 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:20:44.476 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:23.444 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/3a/dc/bf2b15d1fa15a6f7a9e77a61b74ecbbae7258558fcda8ffc9a6638a6b327/docutils-0.15.2-py2-none-any.whl (548kB) 2019-12-09T13:26:23.610 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting python-dateutil<2.8.1,>=2.1; python_version >= "2.7" 2019-12-09T13:26:23.620 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB) 2019-12-09T13:26:23.740 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" 2019-12-09T13:26:23.751 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/d8/a6/f46ae3f1da0cd4361c344888f59ec2f5785e69c872e175a748ef6071cdb5/futures-3.3.0-py2-none-any.whl 2019-12-09T13:26:23.787 INFO:teuthology.orchestra.run.smithi146.stdout:Building wheels for collected packages: ordereddict 2019-12-09T13:26:23.787 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for ordereddict (setup.py): started 2019-12-09T13:26:24.005 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for ordereddict (setup.py): finished with status 'done' 2019-12-09T13:26:24.006 INFO:teuthology.orchestra.run.smithi146.stdout: Created wheel for ordereddict: filename=ordereddict-1.1-cp27-none-any.whl size=3327 sha256=4342090475aa01ed46dc7a8708931f3819bfaae075b272d630c6cf603f6e4ce8 2019-12-09T13:26:24.006 INFO:teuthology.orchestra.run.smithi146.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/78/d3/a8/9f52c7a389a0ffba6f575a3886b5f7a55461fb6ec34aa5fd38 2019-12-09T13:26:24.008 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully built ordereddict 2019-12-09T13:26:24.116 INFO:teuthology.orchestra.run.smithi146.stdout:Installing collected packages: PyYAML, nose, boto, jmespath, docutils, six, python-dateutil, urllib3, botocore, futures, s3transfer, boto3, bunch, greenlet, gevent, isodate, chardet, idna, certifi, requests, pytz, ordereddict, httplib2, lxml 2019-12-09T13:26:24.722 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:20:45.775 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:24.723 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:20:45.775 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:24.724 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:20:45.777 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:24.724 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:20:45.777 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:24.737 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:20:45.790 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:24.738 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:20:45.791 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:24.886 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:20:45.924 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:24.887 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:20:45.926 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:24.903 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:20:45.941 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:26.683 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully installed PyYAML-5.2 boto-2.49.0 boto3-1.10.34 botocore-1.13.34 bunch-1.0.1 certifi-2019.11.28 chardet-3.0.4 docutils-0.15.2 futures-3.3.0 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 idna-2.8 isodate-0.6.0 jmespath-0.9.4 lxml-4.4.2 nose-1.3.7 ordereddict-1.1 python-dateutil-2.8.0 pytz-2019.3 requests-2.22.0 s3transfer-0.2.1 six-1.13.0 urllib3-1.25.7 2019-12-09T13:26:26.983 INFO:teuthology.orchestra.run.smithi146.stdout:running develop 2019-12-09T13:26:27.037 INFO:teuthology.orchestra.run.smithi146.stdout:running egg_info 2019-12-09T13:26:27.037 INFO:teuthology.orchestra.run.smithi146.stdout:creating s3tests.egg-info 2019-12-09T13:26:27.037 INFO:teuthology.orchestra.run.smithi146.stdout:writing requirements to s3tests.egg-info/requires.txt 2019-12-09T13:26:27.037 INFO:teuthology.orchestra.run.smithi146.stdout:writing s3tests.egg-info/PKG-INFO 2019-12-09T13:26:27.038 INFO:teuthology.orchestra.run.smithi146.stdout:writing top-level names to s3tests.egg-info/top_level.txt 2019-12-09T13:26:27.038 INFO:teuthology.orchestra.run.smithi146.stdout:writing dependency_links to s3tests.egg-info/dependency_links.txt 2019-12-09T13:26:27.039 INFO:teuthology.orchestra.run.smithi146.stdout:writing entry points to s3tests.egg-info/entry_points.txt 2019-12-09T13:26:27.040 INFO:teuthology.orchestra.run.smithi146.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-12-09T13:26:27.041 INFO:teuthology.orchestra.run.smithi146.stdout:reading manifest file 's3tests.egg-info/SOURCES.txt' 2019-12-09T13:26:27.042 INFO:teuthology.orchestra.run.smithi146.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-12-09T13:26:27.044 INFO:teuthology.orchestra.run.smithi146.stdout:running build_ext 2019-12-09T13:26:27.045 INFO:teuthology.orchestra.run.smithi146.stdout:Creating /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/s3tests.egg-link (link to .) 2019-12-09T13:26:27.045 INFO:teuthology.orchestra.run.smithi146.stdout:Adding s3tests 0.0.1 to easy-install.pth file 2019-12-09T13:26:27.047 INFO:teuthology.orchestra.run.smithi146.stdout:Installing s3tests-fuzz-headers script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-09T13:26:27.048 INFO:teuthology.orchestra.run.smithi146.stdout:Installing s3tests-generate-objects script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-09T13:26:27.048 INFO:teuthology.orchestra.run.smithi146.stdout:Installing s3tests-test-roundtrip script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-09T13:26:27.048 INFO:teuthology.orchestra.run.smithi146.stdout:Installing s3tests-analysis-rwstats script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-09T13:26:27.048 INFO:teuthology.orchestra.run.smithi146.stdout:Installing s3tests-test-readwrite script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-09T13:26:27.048 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.048 INFO:teuthology.orchestra.run.smithi146.stdout:Installed /home/ubuntu/cephtest/s3-tests 2019-12-09T13:26:27.049 INFO:teuthology.orchestra.run.smithi146.stdout:Processing dependencies for s3tests==0.0.1 2019-12-09T13:26:27.102 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for isodate==0.6.0 2019-12-09T13:26:27.102 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: isodate 0.6.0 2019-12-09T13:26:27.102 INFO:teuthology.orchestra.run.smithi146.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-12-09T13:26:27.103 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.103 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.104 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for gevent==1.4.0 2019-12-09T13:26:27.104 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: gevent 1.4.0 2019-12-09T13:26:27.104 INFO:teuthology.orchestra.run.smithi146.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-12-09T13:26:27.104 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.104 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.106 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for bunch==1.0.1 2019-12-09T13:26:27.106 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: bunch 1.0.1 2019-12-09T13:26:27.106 INFO:teuthology.orchestra.run.smithi146.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-12-09T13:26:27.106 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.107 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.107 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for PyYAML==5.2 2019-12-09T13:26:27.107 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: PyYAML 5.2 2019-12-09T13:26:27.107 INFO:teuthology.orchestra.run.smithi146.stdout:Adding PyYAML 5.2 to easy-install.pth file 2019-12-09T13:26:27.107 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.107 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.107 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for boto3==1.10.34 2019-12-09T13:26:27.107 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: boto3 1.10.34 2019-12-09T13:26:27.108 INFO:teuthology.orchestra.run.smithi146.stdout:Adding boto3 1.10.34 to easy-install.pth file 2019-12-09T13:26:27.108 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.108 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.110 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for boto==2.49.0 2019-12-09T13:26:27.110 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: boto 2.49.0 2019-12-09T13:26:27.110 INFO:teuthology.orchestra.run.smithi146.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-12-09T13:26:27.110 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.110 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.110 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for six==1.13.0 2019-12-09T13:26:27.110 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: six 1.13.0 2019-12-09T13:26:27.111 INFO:teuthology.orchestra.run.smithi146.stdout:Adding six 1.13.0 to easy-install.pth file 2019-12-09T13:26:27.111 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.111 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.111 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for greenlet==0.4.15 2019-12-09T13:26:27.111 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: greenlet 0.4.15 2019-12-09T13:26:27.111 INFO:teuthology.orchestra.run.smithi146.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-12-09T13:26:27.111 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.111 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.112 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for s3transfer==0.2.1 2019-12-09T13:26:27.112 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: s3transfer 0.2.1 2019-12-09T13:26:27.112 INFO:teuthology.orchestra.run.smithi146.stdout:Adding s3transfer 0.2.1 to easy-install.pth file 2019-12-09T13:26:27.112 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.112 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.115 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for botocore==1.13.34 2019-12-09T13:26:27.115 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: botocore 1.13.34 2019-12-09T13:26:27.116 INFO:teuthology.orchestra.run.smithi146.stdout:Adding botocore 1.13.34 to easy-install.pth file 2019-12-09T13:26:27.116 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.116 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.116 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for jmespath==0.9.4 2019-12-09T13:26:27.116 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: jmespath 0.9.4 2019-12-09T13:26:27.116 INFO:teuthology.orchestra.run.smithi146.stdout:Adding jmespath 0.9.4 to easy-install.pth file 2019-12-09T13:26:27.117 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.117 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.117 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for futures==3.3.0 2019-12-09T13:26:27.117 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: futures 3.3.0 2019-12-09T13:26:27.117 INFO:teuthology.orchestra.run.smithi146.stdout:Adding futures 3.3.0 to easy-install.pth file 2019-12-09T13:26:27.117 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.117 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.117 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for urllib3==1.25.7 2019-12-09T13:26:27.118 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: urllib3 1.25.7 2019-12-09T13:26:27.118 INFO:teuthology.orchestra.run.smithi146.stdout:Adding urllib3 1.25.7 to easy-install.pth file 2019-12-09T13:26:27.118 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.118 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.118 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for python-dateutil==2.8.0 2019-12-09T13:26:27.118 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: python-dateutil 2.8.0 2019-12-09T13:26:27.118 INFO:teuthology.orchestra.run.smithi146.stdout:Adding python-dateutil 2.8.0 to easy-install.pth file 2019-12-09T13:26:27.119 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.119 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.119 INFO:teuthology.orchestra.run.smithi146.stdout:Searching for docutils==0.15.2 2019-12-09T13:26:27.119 INFO:teuthology.orchestra.run.smithi146.stdout:Best match: docutils 0.15.2 2019-12-09T13:26:27.119 INFO:teuthology.orchestra.run.smithi146.stdout:Adding docutils 0.15.2 to easy-install.pth file 2019-12-09T13:26:27.119 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T13:26:27.119 INFO:teuthology.orchestra.run.smithi146.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T13:26:27.119 INFO:teuthology.orchestra.run.smithi146.stdout:Finished processing dependencies for s3tests==0.0.1 2019-12-09T13:26:27.126 INFO:teuthology.orchestra.run.smithi146:> cat > /home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2019-12-09T13:26:27.186 INFO:tasks.s3tests:Configuring boto... 2019-12-09T13:26:27.196 INFO:teuthology.orchestra.run.smithi146:> cat > /home/ubuntu/cephtest/boto.cfg 2019-12-09T13:26:27.270 INFO:teuthology.orchestra.run.smithi146:s3 tests against rgw> S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain' 2019-12-09T13:26:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_none ... ok 2019-12-09T13:26:37.188 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_empty ... ok 2019-12-09T13:26:40.937 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_date_and_amz_date ... ok 2019-12-09T13:26:44.852 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_amz_date_and_no_date ... ok 2019-12-09T13:26:47.710 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_none ... ok 2019-12-09T13:26:50.107 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_contentlength_none ... ok 2019-12-09T13:26:54.107 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_acl_create_contentlength_none ... ok 2019-12-09T13:26:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_contentlength_none ... ok 2019-12-09T13:26:56.965 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_empty ... ok 2019-12-09T13:26:57.296 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_none ... ok 2019-12-09T13:26:59.382 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws2 ... ok 2019-12-09T13:27:03.141 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws2 ... ok 2019-12-09T13:27:06.817 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws2 ... ok 2019-12-09T13:27:09.431 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws2 ... ok 2019-12-09T13:27:09.777 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws2 ... ok 2019-12-09T13:27:09.862 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws2 ... ok 2019-12-09T13:27:09.862 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws4 ... SKIP 2019-12-09T13:27:09.862 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws4 ... SKIP 2019-12-09T13:27:09.862 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws4 ... SKIP 2019-12-09T13:27:09.862 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws4 ... SKIP 2019-12-09T13:27:09.862 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_empty_aws4 ... SKIP 2019-12-09T13:27:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_none_aws4 ... SKIP 2019-12-09T13:27:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_date_invalid_aws4 ... SKIP 2019-12-09T13:27:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_invalid_aws4 ... SKIP 2019-12-09T13:27:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_date_empty_aws4 ... SKIP 2019-12-09T13:27:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_empty_aws4 ... SKIP 2019-12-09T13:27:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws4 ... SKIP 2019-12-09T13:27:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_none_aws4 ... SKIP 2019-12-09T13:27:09.867 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_today_aws4 ... SKIP 2019-12-09T13:27:09.867 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_today_aws4 ... SKIP 2019-12-09T13:27:09.867 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_today_aws4 ... SKIP 2019-12-09T13:27:09.867 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_today_aws4 ... SKIP 2019-12-09T13:27:09.867 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_epoch_aws4 ... SKIP 2019-12-09T13:27:09.867 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-12-09T13:27:09.867 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_end_aws4 ... SKIP 2019-12-09T13:27:09.867 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_end_aws4 ... SKIP 2019-12-09T13:27:09.868 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_custom_header_aws4 ... SKIP 2019-12-09T13:27:09.868 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_header_aws4 ... SKIP 2019-12-09T13:27:09.868 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws4 ... SKIP 2019-12-09T13:27:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_empty_aws4 ... SKIP 2019-12-09T13:27:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_none_aws4 ... SKIP 2019-12-09T13:27:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_invalid_aws4 ... SKIP 2019-12-09T13:27:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_invalid_aws4 ... SKIP 2019-12-09T13:27:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_empty_aws4 ... SKIP 2019-12-09T13:27:09.871 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_empty_aws4 ... SKIP 2019-12-09T13:27:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws4 ... SKIP 2019-12-09T13:27:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_none_aws4 ... SKIP 2019-12-09T13:27:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_today_aws4 ... SKIP 2019-12-09T13:27:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_today_aws4 ... SKIP 2019-12-09T13:27:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_after_today_aws4 ... SKIP 2019-12-09T13:27:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_after_today_aws4 ... SKIP 2019-12-09T13:27:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws4 ... SKIP 2019-12-09T13:27:09.872 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-12-09T13:27:18.261 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_versioning_obj_read_not_exist_null ... ok 2019-12-09T13:27:18.261 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_lifecycle_transition ... SKIP 2019-12-09T13:27:18.261 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_lifecycle_transition_single_rule_multi_trans ... SKIP 2019-12-09T13:27:18.261 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_lifecycle_set_noncurrent_transition ... SKIP 2019-12-09T13:27:18.261 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_object_storage_class ... SKIP 2019-12-09T13:27:18.262 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_object_storage_class_multipart ... SKIP 2019-12-09T13:27:18.262 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_object_modify_storage_class ... SKIP 2019-12-09T13:27:18.262 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_object_modify_storage_class_multipart ... SKIP 2019-12-09T13:27:18.262 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_object_storage_class_copy ... SKIP 2019-12-09T13:27:18.262 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_object_storage_class_copy_multipart ... SKIP 2019-12-09T13:27:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_atomic_dual_conditional_write_1mb ... ok 2019-12-09T13:27:39.603 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_atomic_write_bucket_gone ... ok 2019-12-09T13:28:53.644 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:23:14.698 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:53.664 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:23:14.716 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:53.669 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:23:14.722 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:53.703 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:23:14.756 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:53.727 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:23:14.766 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:53.731 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:23:14.770 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:53.799 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:23:14.852 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:53.801 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:23:14.854 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:53.855 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:23:14.894 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:29:20.123 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_1 ... ok 2019-12-09T13:31:35.565 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:25:56.614 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:31:35.581 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:25:56.621 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:31:35.581 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:25:56.633 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:31:35.583 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:25:56.636 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:31:35.584 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:25:56.622 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:31:35.601 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:25:56.640 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:31:35.694 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:25:56.747 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:31:35.704 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:25:56.758 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:31:35.768 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:25:56.806 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:32:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_2 ... ok 2019-12-09T13:32:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_bucket_policy_set_condition_operator_end_with_IfExists ... ok 2019-12-09T13:32:31.785 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_enc ... ok 2019-12-09T13:32:35.216 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_request_obj_tag ... ok 2019-12-09T13:32:39.469 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.check_can_test_website ... SKIP 2019-12-09T13:32:39.469 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_nonexistant_bucket_rgw ... SKIP 2019-12-09T13:32:39.470 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_public_index ... SKIP 2019-12-09T13:32:39.470 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_public_index ... SKIP 2019-12-09T13:32:39.470 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty ... SKIP 2019-12-09T13:32:39.470 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty ... SKIP 2019-12-09T13:32:39.470 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index ... SKIP 2019-12-09T13:32:39.471 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index ... SKIP 2019-12-09T13:32:39.471 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_missingerrordoc ... SKIP 2019-12-09T13:32:39.471 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_missingerrordoc ... SKIP 2019-12-09T13:32:39.471 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_missingerrordoc ... SKIP 2019-12-09T13:32:39.471 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_missingerrordoc ... SKIP 2019-12-09T13:32:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_blockederrordoc ... SKIP 2019-12-09T13:32:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_blockederrordoc ... SKIP 2019-12-09T13:32:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_blockederrordoc ... SKIP 2019-12-09T13:32:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_blockederrordoc ... SKIP 2019-12-09T13:32:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_gooderrordoc ... SKIP 2019-12-09T13:32:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_gooderrordoc ... SKIP 2019-12-09T13:32:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_gooderrordoc ... SKIP 2019-12-09T13:32:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_gooderrordoc ... SKIP 2019-12-09T13:32:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_base ... SKIP 2019-12-09T13:32:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path ... SKIP 2019-12-09T13:32:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path_upgrade ... SKIP 2019-12-09T13:32:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_xredirect_nonwebsite ... SKIP 2019-12-09T13:32:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_relative ... SKIP 2019-12-09T13:32:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_abs ... SKIP 2019-12-09T13:32:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_relative ... SKIP 2019-12-09T13:32:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_abs ... SKIP 2019-12-09T13:32:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:SKIP 2019-12-09T13:32:39.476 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.functional.test_utils.test_generate ... ok 2019-12-09T13:33:45.344 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-12-09T13:33:45.345 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-12-09T13:33:45.345 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-12-09T13:33:45.346 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-12-09T13:33:45.346 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-12-09T13:33:45.346 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-12-09T13:33:45.346 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-12-09T13:33:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-12-09T13:33:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-12-09T13:33:46.191 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-12-09T13:33:46.215 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-12-09T13:33:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-12-09T13:33:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-12-09T13:33:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-12-09T13:33:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-12-09T13:33:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-12-09T13:33:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-12-09T13:33:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-12-09T13:33:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-12-09T13:33:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-12-09T13:33:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-12-09T13:33:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-12-09T13:33:46.240 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-12-09T13:33:46.240 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-12-09T13:33:46.240 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-12-09T13:33:46.240 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_null_child ... ok 2019-12-09T13:33:46.245 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-12-09T13:33:46.245 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-12-09T13:33:46.245 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-12-09T13:33:46.245 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-12-09T13:33:46.268 INFO:teuthology.orchestra.run.smithi146.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-12-09T13:33:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-12-09T13:33:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-12-09T13:33:46.437 INFO:teuthology.orchestra.run.smithi146.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-12-09T13:33:47.211 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:47.211 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:33:47.684 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:47.684 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:33:48.651 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:48.651 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:33:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_short ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:49.526 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:33:51.871 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:51.871 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:33:52.293 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:33:52.564 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_bad ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:52.564 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:33:55.326 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:55.326 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:09.306 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:34:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:09.543 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:11.907 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:12.134 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:34:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:12.681 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:16.725 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:16.725 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:18.253 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:18.253 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:34:20.694 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_mismatch ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:20.695 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:22.338 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:22.338 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:23.754 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:23.796 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:27.206 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:34:27.675 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:27.675 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:30.821 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:30.822 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:31.842 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:31.843 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:34:34.084 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:34.084 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:36.799 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:36.799 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:37.781 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:37.781 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:39.400 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:34:39.632 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contentlength_negative ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:39.632 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:43.031 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:43.046 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:43.443 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:34:43.717 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_invalid ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:43.717 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:47.615 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:47.615 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:49.054 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:49.055 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:50.946 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:34:51.647 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:51.648 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:53.627 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:53.630 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:54.590 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:34:54.849 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:54.850 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:56.909 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:34:57.948 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:34:58.201 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_bucket_put_bad_canned_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:58.201 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:00.892 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:00.894 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:00.998 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:01.506 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_mismatch ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:01.507 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:03.839 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:04.140 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:04.140 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:06.784 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_contentlength_negative ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:07.184 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:07.248 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:07.623 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:07.623 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:09.899 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:09.900 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:10.124 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:10.527 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:13.803 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:13.804 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:17.524 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_none_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:17.524 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:20.688 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:20.688 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_invalid_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:24.228 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:25.875 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:25.876 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:25.942 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:26.344 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:26.345 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:28.931 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:28.931 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:29.413 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_today_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:29.413 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:32.058 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:32.161 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:32.916 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_epoch_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:32.916 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:35.756 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:35.973 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:36.415 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_after_end_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:36.415 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:39.371 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:39.372 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:39.793 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:39.793 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:41.725 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:42.215 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_none_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:42.215 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:44.364 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:44.640 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_invalid_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:44.641 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:44.730 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:45.046 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:45.046 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:45.565 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:45.911 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_today_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:45.911 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:45.993 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:46.912 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_after_today_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:46.912 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:47.144 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:47.580 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:47.580 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:47.657 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:48.161 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:48.161 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:51.375 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:51.668 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_distinct ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:51.668 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:54.125 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:54.126 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:35:58.691 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:35:58.910 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_many ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:58.910 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:05.672 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:05.672 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:07.553 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:36:07.824 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_many ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:07.825 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:14.833 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:14.833 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:15.460 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:36:15.717 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_basic_key_count ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:15.718 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:36:26.926 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:26.926 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:33.837 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:33.837 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:34.274 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:36:34.525 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:34.525 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:43.702 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:43.702 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:36:45.162 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:45.162 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:49.497 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:31:10.551 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:36:49.502 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:31:10.556 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:36:49.514 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:31:10.568 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:36:49.523 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:31:10.577 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:36:49.525 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:31:10.564 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:36:49.534 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:31:10.573 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:36:49.715 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:31:10.769 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:36:49.737 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:31:10.790 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:36:49.794 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:31:10.832 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:36:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:52.950 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:54.011 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:54.719 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:54.720 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:55.700 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:55.700 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:56.999 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:57.000 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:57.863 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:58.698 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:58.699 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:59.564 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:59.564 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:36:59.942 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:37:00.222 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:00.223 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:10.074 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:11.160 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:12.059 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:13.284 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:13.284 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:13.813 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:13.813 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:14.647 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:15.505 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:15.505 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:16.442 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:16.442 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:16.980 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:37:17.333 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_ends_with_delimiter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:17.333 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:20.157 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:31:41.211 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:37:20.200 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:31:41.253 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:37:20.218 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:31:41.257 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:37:20.220 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:31:41.259 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:37:20.223 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:31:41.277 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:37:20.237 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:31:41.291 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:37:20.240 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:31:41.293 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:37:20.257 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:31:41.296 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:37:20.266 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:31:41.320 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:37:20.416 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:20.429 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:20.741 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:37:21.077 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_ends_with_delimiter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:21.077 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:24.623 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:24.623 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:25.159 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:37:25.440 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:25.440 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:33.971 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:33.971 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:37:34.741 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:34.741 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:43.229 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:43.230 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:37:43.787 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_underscore ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:43.788 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:50.881 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:50.882 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:51.604 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:51.604 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:52.165 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:52.165 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:52.823 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:52.823 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:53.813 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:54.695 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:55.217 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:55.217 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:56.288 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:37:56.621 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:37:56.841 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_underscore ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:56.841 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:05.041 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:05.041 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:05.749 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:05.750 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:06.595 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:06.595 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:07.344 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:07.344 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:08.136 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:08.137 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:09.040 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:09.577 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:09.577 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:10.464 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:10.465 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:10.776 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:38:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_percentage ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:11.059 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:19.140 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:19.650 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:38:19.870 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_percentage ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:19.870 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:26.698 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:38:27.794 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_whitespace ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:27.795 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:35.059 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:35.060 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:35.544 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:38:35.848 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_whitespace ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:35.849 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:41.971 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:41.971 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:42.701 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:38:42.943 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_dot ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:42.944 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:49.962 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:49.962 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:50.642 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:38:50.974 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_dot ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:50.974 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:57.847 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:57.848 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:38:58.561 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:38:58.862 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:38:58.863 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:05.391 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:05.392 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:39:06.012 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:06.012 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:12.114 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:12.114 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:12.510 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:39:12.761 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:12.762 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:20.419 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:20.649 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:39:21.034 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:21.035 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:27.916 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:39:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:28.691 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:37.020 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:37.020 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:37.611 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:39:38.032 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:38.032 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:46.521 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:47.335 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:39:47.649 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_notempty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:47.651 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:55.957 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:55.958 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:39:57.023 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:39:57.280 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_defaultempty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:57.280 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:40:03.815 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:40:03.815 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:40:04.170 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:40:04.474 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:40:04.475 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:40:11.116 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:40:11.116 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:40:11.739 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:40:12.070 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:40:12.070 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:40:19.464 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:40:19.465 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:40:20.340 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:40:20.566 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:40:20.566 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:40:28.888 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:40:28.888 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:40:29.242 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T13:40:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_skip_special ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:40:29.538 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T13:42:00.513 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:36:21.566 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:00.518 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:36:21.572 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:00.527 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:36:21.580 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:00.532 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:36:21.586 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:00.533 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:36:21.573 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:00.541 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:36:21.580 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:00.700 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:36:21.753 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:00.723 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:36:21.762 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:00.729 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:36:21.782 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:45:41.765 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:40:02.818 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:45:41.779 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:40:02.821 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:45:41.851 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:40:02.890 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:45:41.856 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:40:02.895 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:45:41.860 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:40:02.913 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:45:41.873 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:40:02.926 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:45:41.883 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:40:02.936 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:45:41.990 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:40:03.043 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:45:41.998 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:40:03.037 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:47:11.934 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:41:32.987 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:47:11.942 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:41:32.995 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:47:11.952 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:41:33.006 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:47:11.956 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:41:32.995 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:47:11.958 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:41:33.012 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:47:11.970 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:41:33.009 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:47:12.017 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:41:33.069 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:47:12.051 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:41:33.091 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:47:12.054 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:41:33.107 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:52:24.282 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:46:45.335 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:52:24.289 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:46:45.342 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:52:24.297 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:46:45.350 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:52:24.303 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:46:45.356 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:52:24.305 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:46:45.344 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:52:24.319 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:46:45.359 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:52:24.469 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:46:45.521 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:52:24.527 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:46:45.580 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:52:24.544 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:46:45.583 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:03.456 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:48:24.508 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:03.487 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:48:24.540 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:03.515 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:48:24.567 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:03.518 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:48:24.571 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:03.542 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:48:24.595 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:03.545 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:48:24.585 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:03.554 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:48:24.593 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:03.575 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:48:24.628 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:03.687 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:48:24.727 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:57:34.097 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:51:55.149 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:57:34.118 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:51:55.148 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:57:34.118 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:51:55.151 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:57:34.118 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:51:55.155 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:57:34.119 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:51:55.160 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:57:34.119 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:51:55.165 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T13:57:34.248 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:51:55.288 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T13:57:34.264 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:51:55.316 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T13:57:34.294 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:51:55.346 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:00:07.129 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:07.129 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:08.923 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:00:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:09.158 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:16.129 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:16.129 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:16.434 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:00:16.732 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:16.732 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:22.848 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:22.848 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:00:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:23.571 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:29.602 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:29.892 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:00:30.147 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:30.147 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:37.324 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:37.325 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:37.926 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:00:38.217 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:38.217 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:43.905 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:43.906 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:44.404 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:00:44.764 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:44.765 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:50.402 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:50.402 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:51.538 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:00:51.955 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:51.955 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:59.168 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:00:59.531 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:00:59.775 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:59.776 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:06.034 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:06.034 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:06.255 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:01:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:06.500 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:12.613 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:12.614 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:13.116 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:01:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:13.490 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:19.871 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:19.871 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:20.375 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:01:20.675 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:20.675 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:27.660 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:01:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:29.132 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:34.434 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:01:35.227 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:35.227 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:44.348 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:44.348 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:01:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:45.821 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:53.485 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:01:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:01:54.431 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:54.432 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:01.975 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:02.416 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:02:02.674 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:02.674 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:09.680 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:10.463 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:02:10.746 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:10.746 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:18.506 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:18.506 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:19.320 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:02:19.610 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:19.610 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:24.888 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:56:45.941 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:24.905 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:56:45.959 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:24.942 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:56:45.994 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:24.943 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:56:45.996 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:24.953 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:56:45.992 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:24.966 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:56:46.005 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:25.055 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:56:46.108 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:25.077 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:56:46.130 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:25.136 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:56:46.175 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:26.528 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:26.528 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:02:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:28.104 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:35.863 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:35.863 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:36.379 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:02:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:37.173 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:42.709 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:43.413 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:02:43.725 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:43.725 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:44.413 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:57:05.466 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:44.418 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:57:05.472 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:44.425 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:57:05.478 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:44.428 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:57:05.482 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:44.438 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:57:05.477 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:44.449 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:57:05.489 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:44.457 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:02:57:05.510 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:44.468 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:02:57:05.521 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:44.499 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:02:57:05.539 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:02:50.804 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:50.805 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:51.439 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:02:51.774 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:51.774 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:58.615 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:58.616 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:02:59.398 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:02:59.727 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_one ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:59.727 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:03:08.135 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:08.135 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:03:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:03:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_one ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:09.941 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:03:17.804 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:17.804 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:03:19.474 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:03:19.934 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_zero ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:19.934 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:03:29.484 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:29.484 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:03:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:03:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_zero ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:30.411 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:03:39.612 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:39.613 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:03:40.145 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:03:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:40.409 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:03:48.221 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:48.221 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:03:48.840 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:03:49.542 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:49.542 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:03:58.079 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:58.079 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:03:58.348 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:03:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_unordered ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:58.635 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:04:37.135 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:04:37.135 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:04:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:04:40.161 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_unordered ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:04:40.161 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:05:14.433 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:14.433 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:05:17.340 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:05:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_invalid ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:17.605 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:05:25.438 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:25.438 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:05:26.217 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:05:26.603 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:26.603 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:05:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:34.737 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:05:34.993 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:05:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:35.343 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:05:42.469 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:42.469 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:05:43.390 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:05:43.670 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_continuationtoken_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:43.670 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:05:50.199 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:50.199 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:05:50.363 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:05:50.782 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:50.782 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:05:59.657 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:59.657 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:00.516 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:06:00.824 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:00.824 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:07.517 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:08.005 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:06:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_not_in_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:08.345 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:15.511 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:06:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_not_in_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:16.689 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:23.691 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:24.117 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:06:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_after_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:24.460 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:33.036 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:33.036 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:33.909 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:06:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_after_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:34.366 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:40.459 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:40.459 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:41.019 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:06:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:41.404 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:50.238 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:06:54.094 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data_versioning ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:54.094 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:55.836 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:55.836 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:06:56.977 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:56.978 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:11.120 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:11.120 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:15.850 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:07:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:16.337 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:19.147 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:20.736 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:21.105 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:01:42.158 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:21.144 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:01:42.197 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:21.172 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:01:42.226 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:21.174 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:01:42.227 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:21.229 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:01:42.268 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:21.234 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:01:42.273 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:21.302 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:01:42.356 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:21.321 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:07:21.438 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:01:42.477 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:21.458 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:01:42.512 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:21.580 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:21.580 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:23.619 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:23.619 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:25.712 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:25.712 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:25.985 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:07:26.248 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous_fail ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:26.249 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:29.139 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:29.139 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:07:30.006 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous_fail ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:30.006 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:32.445 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:32.445 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:32.970 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:07:33.255 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:33.256 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:34.211 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:07:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:34.494 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:34.722 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:07:35.416 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:35.416 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:36.036 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:07:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_nonempty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:36.382 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:40.165 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:40.165 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:41.211 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:07:41.429 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_concurrent_set_canned_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:41.429 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:42.696 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:42.696 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:43.023 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:43.023 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:43.193 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:43.193 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:43.441 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:43.441 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:43.821 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:43.821 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:44.489 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:44.703 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:45.470 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:45.657 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:45.836 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:45.836 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:46.367 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:46.368 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:46.390 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:46.390 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:46.992 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:46.992 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:47.232 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:47.232 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:47.986 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:47.986 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:48.578 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:49.115 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:49.115 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:49.620 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:49.620 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:49.931 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:49.932 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:50.448 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:50.448 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:50.739 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:50.740 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:50.958 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:50.958 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:51.240 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:51.240 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:51.918 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:51.918 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:52.106 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:52.106 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:52.463 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:52.463 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:53.179 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:53.179 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:53.464 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:53.464 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:53.738 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:53.738 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:54.413 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:54.519 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:02:15.573 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:54.528 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:02:15.581 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:54.534 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:02:15.588 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:54.536 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:02:15.576 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:54.538 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:02:15.591 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:54.540 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:02:15.579 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:54.583 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:02:15.620 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:54.583 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:02:15.629 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:54.583 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:02:15.631 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:54.862 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:54.862 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:55.416 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:55.417 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:55.895 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:55.895 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:56.384 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:56.384 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:56.723 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:56.723 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:56.969 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:56.969 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:57.353 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:57.353 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:57.862 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:58.391 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:58.391 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:59.190 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:59.190 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:59.583 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:07:59.803 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:59.803 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:00.106 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:00.106 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:00.406 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:00.406 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:01.607 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:01.607 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:01.866 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:01.866 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:02.292 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:02.673 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:02.673 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:03.129 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:03.326 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:03.326 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:07.105 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:08:07.698 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_write_to_nonexist_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:07.698 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:08.578 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:08:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:08.873 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:11.315 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:11.315 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:14.986 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:08:15.199 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_read_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:15.200 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:17.877 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:17.877 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:18.470 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:08:18.746 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_requestid_matches_header_on_error ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:18.746 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:21.254 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:21.254 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:08:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multi_object_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:22.423 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:28.175 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:28.175 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:32.842 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:08:33.207 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multi_objectv2_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:33.207 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:39.566 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:39.566 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:08:46.449 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_head_zero_bytes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:46.449 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:49.537 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:49.537 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:51.067 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:08:51.478 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_write_check_etag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:51.478 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:53.469 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:53.469 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:54.381 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:08:54.620 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_write_cache_control ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:54.620 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:57.587 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:57.587 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:08:59.033 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:08:59.298 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_write_expires ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:59.298 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:01.304 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:01.304 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:09:02.646 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_write_read_update_read_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:02.646 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:04.706 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:04.706 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:09:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:10.799 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:12.595 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:12.596 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:13.594 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:09:13.902 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:13.902 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:15.117 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:16.429 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:09:16.698 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_overwrite_to_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:16.698 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:19.180 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:19.181 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:21.798 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:25.090 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:09:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_unicode_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:25.450 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:28.485 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:28.485 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:31.558 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:09:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_metadata_replaced_on_put ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:31.822 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:34.137 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:37.579 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:09:37.878 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_write_file ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:37.878 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:40.647 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:40.648 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:42.412 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:09:42.687 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_anonymous_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:42.688 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:45.620 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:45.620 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:47.992 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:09:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:48.283 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:50.255 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:51.889 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:51.889 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:52.520 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:09:52.804 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_no_content_type ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:52.805 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:56.172 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:56.173 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:09:58.262 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:09:58.645 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request_bad_access_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:58.645 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:00.963 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:01.488 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:10:01.784 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_success_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:01.785 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:04.829 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:04.829 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:06.019 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:10:06.285 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_invalid_success_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:06.286 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:09.119 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:10:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_larger_than_chunk ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:10.827 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:12.643 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:12.643 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:20.435 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:24.126 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:10:24.696 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_key_from_filename ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:24.696 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:27.866 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:27.866 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:30.796 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:30.797 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:31.730 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:10:32.163 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_ignored_header ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:32.163 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:35.270 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:36.717 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:10:36.918 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_case_insensitive_condition_fields ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:36.918 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:39.118 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:39.118 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:10:40.170 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_escaped_field_values ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:40.171 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:42.349 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:44.381 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:44.381 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:45.396 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:10:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_success_redirect_action ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:45.740 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:46.751 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:05:07.805 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:46.788 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:05:07.842 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:46.804 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:05:07.858 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:46.805 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:05:07.859 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:46.841 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:05:07.873 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:46.842 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:05:07.878 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:46.870 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:05:07.924 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:46.886 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:05:07.940 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:46.932 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:05:07.969 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:47.303 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:47.304 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:49.518 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:10:49.836 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_signature ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:49.836 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:53.125 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:53.125 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:53.702 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:10:54.110 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_access_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:54.111 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:56.507 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:56.507 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:10:57.409 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:10:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_date_format ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:57.877 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:00.555 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:00.556 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:01.740 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:02.165 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_no_key_specified ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:02.165 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:04.726 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:04.727 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:05.646 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_signature ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:05.646 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:09.573 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:09.573 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:09.955 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_policy_condition ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:10.195 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:12.755 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:12.755 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:13.380 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:13.882 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_user_specified_header ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:13.882 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:16.771 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:16.771 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:18.676 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:18.949 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:19.504 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_request_missing_policy_specified_field ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:19.504 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:22.167 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:23.246 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_condition_is_case_sensitive ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:23.246 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:25.861 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:25.861 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:26.326 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:26.664 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_expires_is_case_sensitive ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:26.664 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:29.367 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:29.368 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:29.899 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:30.507 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_expired_policy ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:30.507 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:33.311 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:33.312 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:34.761 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_request_field_value ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:34.761 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:37.297 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:37.297 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:37.850 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:38.094 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_expires_condition ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:38.095 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:41.927 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:42.161 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:42.722 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_conditions_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:42.722 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:45.297 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:45.761 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_limit_exceeded ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:46.203 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:48.943 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_content_length_argument ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:50.019 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:52.776 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:52.776 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:53.368 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_content_length_argument ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:53.369 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:56.659 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:56.659 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:11:57.323 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:11:58.036 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_below_minimum ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:58.037 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:00.740 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:00.740 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:01.237 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:12:01.471 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_empty_conditions ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:01.472 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:04.051 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:04.719 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:12:04.937 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:04.937 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:07.710 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:07.711 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:12:09.813 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:09.814 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:14.094 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:14.888 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:12:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:15.165 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:17.397 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:17.397 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:19.514 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:12:19.909 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:19.910 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:23.745 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:23.745 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:24.786 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:12:25.014 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:25.014 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:27.267 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:27.267 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:29.287 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:12:29.561 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:29.561 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:31.815 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:31.815 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:35.619 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:35.620 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:36.022 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:12:36.416 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:36.416 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:39.931 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:39.931 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:12:42.505 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:42.505 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:45.304 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:45.304 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:46.505 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:12:46.999 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:46.999 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:49.398 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:49.399 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:53.578 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:12:54.155 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:54.156 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:12:57.342 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:57.342 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:01.426 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:13:01.740 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_overwrite_existed_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:01.740 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:04.548 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:04.548 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:06.871 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:07:27.925 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:13:06.876 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:07:27.930 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:13:06.883 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:07:27.937 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:13:06.888 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:07:27.941 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:13:06.891 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:07:27.930 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:13:06.895 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:07:27.934 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:13:06.968 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:07:28.022 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:13:07.016 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:07:28.055 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:13:07.033 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:07:28.084 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:13:08.081 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_nonexisted_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:08.081 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:11.491 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:11.502 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:12.901 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:13:13.251 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:13.251 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:14.982 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:14.982 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:20.134 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:13:20.409 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:20.409 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:23.787 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:23.787 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:13:27.255 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_nonexisted_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:27.255 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:29.895 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:29.895 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:32.868 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:13:33.324 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_overwrite_existed_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:33.324 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:35.078 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:35.078 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:38.208 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:13:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:38.818 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:43.070 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:43.070 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:43.559 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:13:43.821 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:43.822 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:47.849 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:47.849 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:53.374 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:53.374 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:53.681 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:13:54.123 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_delete_key_bucket_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:54.123 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:13:58.573 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:58.573 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:06.592 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:06.592 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:07.175 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:14:07.402 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:07.402 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:10.724 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:10.725 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:13.008 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:13.008 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:13.900 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:14:14.291 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:14.292 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:16.832 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:16.832 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:17.826 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:14:18.097 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_head_extended ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:18.097 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:21.200 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:21.200 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:22.260 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:28.869 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:14:29.299 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:29.300 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:32.963 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:32.963 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:33.694 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:14:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:34.104 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:38.502 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:38.503 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:38.901 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:14:39.242 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:39.242 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:42.648 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:42.648 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:14:43.405 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_response_headers ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:43.405 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:48.977 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:49.820 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:14:50.082 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:50.082 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:54.551 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:54.552 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:14:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:55.102 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:58.014 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:58.014 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:14:58.538 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:14:58.977 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:58.977 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:04.877 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:04.877 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:10.371 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:14.908 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:17.494 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_not_expired ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:17.810 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:22.869 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:22.869 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:23.538 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:23.811 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_range_zero ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:23.811 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:26.890 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:26.891 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:26.966 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:27.403 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_max_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:27.403 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:30.803 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:30.804 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:31.185 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:31.385 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_positive_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:31.385 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:36.449 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:36.449 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:36.971 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:36.972 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:39.583 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:39.583 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:41.093 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:41.093 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:41.434 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put_write_access ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:41.709 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:43.425 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:44.724 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:44.724 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:47.936 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_put_authenticated ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:47.937 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:49.695 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:49.695 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:50.674 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:50.954 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_raw_put_authenticated_expired ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:50.954 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:53.937 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:53.938 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:55.351 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:55.351 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:55.435 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_one ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:55.832 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:56.364 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:56.633 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_two ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:56.633 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:57.346 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:57.642 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_ip ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:57.643 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:58.152 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:15:58.367 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_dns_underscore ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:58.367 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:15:59.884 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:00.162 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:00.162 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:05.527 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_get_location ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:05.528 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:07.944 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:08.197 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists_nonowner ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:08.197 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:11.146 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:11.147 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:13.287 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:13.712 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_default ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:13.712 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:16.301 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:16.301 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:16.499 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:16.728 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_during_create ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:16.728 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:19.826 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:20.099 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:20.100 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:24.737 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:25.578 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:25.578 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:28.273 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_authenticatedread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:28.273 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:31.062 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:31.339 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_default ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:31.340 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:33.495 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:33.495 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:35.152 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_during_create ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:35.153 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:38.085 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:38.086 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:39.678 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:39.985 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:39.986 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:42.944 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:42.945 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:46.735 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:47.028 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:47.028 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:49.363 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:49.364 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:51.848 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_authenticatedread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:51.849 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:56.677 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:56.678 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:16:59.000 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:16:59.548 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:59.549 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:01.946 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:01.946 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:04.635 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:17:04.945 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerfullcontrol ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:04.945 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:08.012 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:17:11.294 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_owner ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:11.294 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:17.222 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:17.223 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:18.535 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:17:19.121 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_attributes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:19.122 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:24.239 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:24.240 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:24.978 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:27.622 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:17:28.226 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_private_to_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:28.226 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:31.185 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:31.185 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:32.773 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:17:33.074 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:33.074 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:35.227 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:35.227 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:17:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_write ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:39.646 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:44.387 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:17:47.863 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_writeacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:47.863 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:50.361 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:50.361 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:52.768 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:17:53.041 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_read ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:53.041 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:55.119 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:17:57.767 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:17:58.179 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_acl_readacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:58.179 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:01.165 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:01.165 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:04.354 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:18:04.609 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_fullcontrol ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:04.609 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:07.097 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:07.098 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:07.454 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:08.611 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:08.611 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:09.266 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:09.266 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:09.827 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:09.827 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:11.048 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:13.490 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:13.865 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:18:14.130 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_read ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:14.131 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:17.959 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:18.109 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:12:39.163 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:18:18.116 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:12:39.169 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:18:18.125 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:12:39.179 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:18:18.128 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:12:39.182 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:18:18.138 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:12:39.176 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:18:18.150 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:12:39.189 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:18:18.301 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:12:39.355 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:18:18.330 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:12:39.384 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:18:18.381 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:18.381 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:18.415 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:12:39.453 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:18:19.285 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:19.285 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:19.662 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:19.662 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:20.124 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:20.124 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:20.479 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:20.667 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:18:20.919 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_readacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:20.920 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:23.319 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:23.320 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:23.726 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:23.727 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:24.677 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:24.677 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:25.048 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:25.048 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:25.468 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:26.006 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:26.450 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:18:26.655 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_write ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:26.656 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:29.275 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:29.275 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:29.820 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:31.116 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:31.116 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:31.555 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:31.555 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:32.005 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:32.006 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:33.905 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:34.018 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:18:34.259 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_writeacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:34.259 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:36.667 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:36.667 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:37.126 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:38.735 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:38.735 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:39.341 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:39.341 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:39.837 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:40.304 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:40.305 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:40.683 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:18:40.919 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_nonexist_user ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:40.919 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:43.273 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:43.273 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:43.741 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:43.742 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:44.247 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:18:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_no_grants ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:44.486 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:48.544 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:48.545 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:51.838 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:51.839 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:52.229 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:52.229 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:18:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_header_acl_grants ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:54.421 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:56.247 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:56.247 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:57.162 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:18:57.399 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_header_acl_grants ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:57.400 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:18:59.963 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:18:59.963 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:02.975 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:19:03.243 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:03.243 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:06.007 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:06.008 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:06.449 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:08.291 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:13:29.345 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:19:08.314 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:13:29.369 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:19:08.336 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:13:29.390 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:19:08.338 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:13:29.392 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:19:08.361 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:13:29.400 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:19:08.366 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:13:29.420 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:19:08.386 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:13:29.431 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:19:08.386 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:13:29.409 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:19:08.424 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:13:29.463 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:19:08.610 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:19:08.928 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:08.928 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:10.364 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:10.385 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:10.755 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:19:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_revoke_all ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:11.330 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:13.534 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:18.052 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:19:18.380 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:18.381 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:21.628 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:21.629 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:26.316 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:27.793 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:27.795 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:28.216 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:28.217 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:28.326 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:19:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:28.731 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:31.346 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:31.347 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:37.275 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:37.275 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:39.562 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:39.563 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:40.069 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:40.069 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:19:40.822 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:40.822 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:42.817 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:42.817 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:49.692 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:49.693 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:51.806 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:51.806 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:53.229 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:53.229 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:19:53.869 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:53.869 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:19:56.989 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:19:56.989 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:02.061 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:02.062 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:03.218 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:03.219 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:04.809 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:04.809 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:05.031 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:20:05.838 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:05.838 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:08.782 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:08.783 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:13.997 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:13.997 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:14.759 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:15.936 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:15.936 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:16.343 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:20:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:16.791 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:19.353 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:19.353 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:24.857 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:24.857 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:26.477 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:26.478 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:27.143 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:27.144 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:27.581 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:20:27.856 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:27.857 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:30.407 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:30.407 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:34.112 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:34.112 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:34.714 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:34.714 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:35.575 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:35.575 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:20:37.086 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:37.087 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:39.833 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:39.833 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:45.136 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:45.137 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:46.191 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:46.191 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:47.288 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:47.289 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:47.883 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:20:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:48.393 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:50.737 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:50.738 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:56.136 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:56.136 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:56.986 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:56.986 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:58.058 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:58.058 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:20:58.811 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:20:59.655 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:20:59.655 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:21:02.005 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:21:02.005 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:21:06.265 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:21:06.266 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:21:13.672 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:21:13.892 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:21:13.892 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:21:17.273 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:21:17.273 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:21:21.364 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:21:21.364 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:21:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:21:29.323 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:21:29.324 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:21:31.933 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:21:31.933 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:21:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:21:37.017 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:21:44.937 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:21:45.178 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_buckets_create_then_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:21:45.178 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:21:59.937 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:21:59.938 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:22:01.259 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_anonymous ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:01.259 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:02.696 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:22:03.216 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_invalid_auth ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:03.216 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:03.750 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:22:04.147 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_bad_auth ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:04.148 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:04.331 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:22:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_alpha ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:04.703 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:06.253 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:06.253 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:07.724 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:07.724 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:14.346 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:22:14.742 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_digit ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:14.742 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:16.665 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:19.833 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:19.834 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:22:26.043 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_period ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:26.043 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:29.138 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:22:29.475 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_hyphen ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:29.475 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:32.559 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:22:32.822 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_recreate_not_overriding ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:32.822 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:38.486 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:38.486 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:38.963 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:43.340 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:43.340 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:22:44.599 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:22:45.029 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_special_key_names ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:45.030 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:23:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:04.151 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:23:05.136 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:05.136 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:23:26.309 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:23:26.553 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_special_prefix ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:26.554 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:23:29.154 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:17:50.209 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:23:29.163 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:17:50.218 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:23:29.170 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:17:50.225 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:23:29.172 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:17:50.211 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:23:29.175 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:17:50.229 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:23:29.185 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:17:50.222 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:23:29.330 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:17:50.384 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:23:29.336 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:17:50.390 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:23:29.339 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:17:50.378 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:23:33.942 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:33.943 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:23:35.162 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:35.162 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:23:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:23:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_zero_size ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:36.156 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:23:40.452 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:40.452 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:23:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:23:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_same_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:44.777 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:23:47.713 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:47.713 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:23:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:23:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_verify_contenttype ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:54.167 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:23:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:57.561 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:01.254 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:24:01.505 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:01.505 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:03.769 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:03.769 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:07.281 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:24:07.788 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself_with_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:07.788 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:10.462 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:10.463 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:13.988 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:24:14.279 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_diff_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:14.279 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:16.384 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:19.446 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:19.447 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:24:25.484 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:25.484 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:28.445 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:31.074 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:24:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_object_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:31.447 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:35.511 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:35.513 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:38.976 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:38.976 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:40.726 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:40.726 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:42.601 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:42.601 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:24:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_canned_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:45.697 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:48.135 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:48.135 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:51.222 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:51.222 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:54.632 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:24:55.602 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_retaining_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:55.602 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:24:58.709 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:58.710 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:02.200 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:02.200 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:04.433 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:04.433 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:10.555 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:25:10.655 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:25:10.631+0000 115822700 -1 handle_data failed with exit code -32 2019-12-09T14:25:10.961 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_replacing_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:10.961 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:14.647 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:18.524 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:20.361 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:26.015 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:25:26.490 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_bucket_not_found ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:26.491 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:26.576 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:25:26.486+0000 10f816700 -1 handle_data failed with exit code -32 2019-12-09T14:25:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:29.114 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:29.378 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:25:29.580 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_key_not_found ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:29.580 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:32.217 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:32.218 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:32.798 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:25:33.074 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:33.074 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:35.543 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:35.544 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:37.491 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:37.492 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:42.347 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:52.055 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:25:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:53.622 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:26:02.216 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:26:02.216 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:26:14.336 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:26:14.746 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_url_encoding ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:26:14.747 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:26:17.995 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:26:17.995 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:26:28.636 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:26:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioning_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:26:28.907 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:26:32.209 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:26:32.209 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:26:34.034 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:26:34.034 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:27:29.707 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:21:50.762 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:27:29.714 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:21:50.768 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:27:29.777 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:21:50.831 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:27:29.780 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:21:50.835 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:27:29.795 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:21:50.833 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:27:29.797 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:21:50.836 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:27:29.862 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:21:50.916 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:27:29.908 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:21:50.963 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:27:29.935 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:21:50.973 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:27:39.998 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:27:39.998 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:27:45.443 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:27:45.443 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:28:39.974 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:23:01.028 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:28:39.976 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:23:01.031 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:28:40.002 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:23:01.057 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:28:40.009 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:23:01.047 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:28:40.011 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:23:01.050 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:28:40.026 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:23:01.081 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:28:40.043 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:23:01.098 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:28:40.078 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:23:01.132 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:28:40.087 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:23:01.126 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:28:58.676 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:28:58.677 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:29:00.765 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:29:00.765 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:29:43.265 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:29:43.265 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:02.480 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:31:02.751 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:02.752 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:05.681 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:05.681 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:07.348 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:07.349 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:07.494 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:31:07.759 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_small ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:07.760 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:10.834 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:14.530 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:14.530 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:19.196 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:31:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_small ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:19.528 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:22.420 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:22.421 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:35.125 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:38.189 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:38.189 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:43.130 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:46.324 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:46.324 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:47.310 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:47.310 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:48.397 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:31:48.353+0000 da7ac700 -1 handle_data failed with exit code -104 2019-12-09T14:31:49.465 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:31:49.700 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_invalid_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:49.700 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:52.235 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:52.235 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:54.097 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:54.097 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:31:57.488 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:31:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_without_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:31:58.259 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:01.131 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:01.131 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:02.778 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:05.583 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:05.583 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:13.585 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:14.388 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:14.388 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:15.481 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:32:15.718 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_special_names ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:15.718 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:17.724 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:20.890 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:20.890 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:34.318 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:34.318 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:39.371 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:39.372 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:45.734 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:45.734 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:46.794 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:32:47.550 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:32:47.470+0000 4a276700 -1 handle_data failed with exit code -104 2019-12-09T14:32:48.959 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:32:48.959 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:33:04.254 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:33:04.254 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:33:08.926 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:33:08.926 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:33:14.593 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:33:14.593 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:33:16.031 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:33:16.031 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:33:16.824 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:33:16.721+0000 4ca7b700 -1 handle_data failed with exit code -104 2019-12-09T14:33:17.898 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:33:17.898 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:33:30.293 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:33:30.294 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:33:34.542 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:33:34.542 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:33:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:33:39.950 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:33:41.401 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:33:41.401 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:33:44.534 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:33:44.534 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:33:51.768 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:28:12.822 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:33:51.770 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:28:12.825 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:33:51.816 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:28:12.871 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:33:51.817 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:28:12.872 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:33:51.827 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:28:12.866 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:33:51.830 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:28:12.869 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:33:51.998 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:28:13.052 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:33:51.999 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:28:13.053 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:33:52.073 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:28:13.111 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:33:54.434 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:33:54.435 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:33:59.702 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:33:59.703 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:34:05.760 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:34:05.760 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:34:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:34:06.734 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:34:07.359 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:34:07.273+0000 a1f3b700 -1 handle_data failed with exit code -104 2019-12-09T14:34:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:34:07.871 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:34:07.871 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:34:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:34:22.697 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:35:21.018 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:35:21.018 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:35:51.118 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:30:12.173 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:35:51.143 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:30:12.197 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:35:51.168 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:30:12.223 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:35:51.171 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:30:12.225 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:35:51.191 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:30:12.229 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:35:51.201 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:30:12.239 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:35:51.204 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:30:12.259 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:35:51.230 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:30:12.284 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:35:51.320 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:30:12.358 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:35:56.473 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:35:56.473 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:35:57.764 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:35:57.764 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:35:58.544 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:35:58.487+0000 a373e700 -1 handle_data failed with exit code -104 2019-12-09T14:37:00.554 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:37:00.554 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:37:01.805 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:37:01.805 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:37:02.477 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:37:02.463+0000 108808700 -1 handle_data failed with exit code -104 2019-12-09T14:37:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:37:36.392 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_versioned ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:37:36.392 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:37:39.086 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:37:39.087 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:37:41.716 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:37:41.716 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:37:42.121 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:37:42.122 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:37:43.638 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:37:43.638 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:38:03.947 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:38:03.947 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:38:24.279 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:38:24.279 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:38:51.094 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:38:51.095 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:38:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:38:52.056 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:39:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:39:08.560 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:39:09.659 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:39:09.660 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:39:11.088 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:39:11.015+0000 f27dc700 -1 handle_data failed with exit code -104 2019-12-09T14:39:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:39:44.828 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:40:03.927 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:40:03.930 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:40:07.797 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:40:07.749+0000 666c4700 -1 handle_data failed with exit code -104 2019-12-09T14:40:10.260 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:40:10.260 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:40:11.273 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:40:11.273 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:40:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:40:45.863 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:40:58.685 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:40:58.686 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:41:03.357 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:41:03.357 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:41:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:41:04.003 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:41:05.017 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:41:04.987+0000 fd7f2700 -1 handle_data failed with exit code -104 2019-12-09T14:41:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T14:41:39.087 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_resend_part ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:41:39.087 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:41:39.112 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:41:38.894+0000 11e834700 -1 handle_data failed with exit code -104 2019-12-09T14:41:42.948 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:41:42.949 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:42:55.581 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:42:55.582 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:43:30.277 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:43:30.277 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:43:31.907 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:43:31.908 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:43:33.297 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:43:33.242+0000 1007f8700 -1 handle_data failed with exit code -104 2019-12-09T14:44:12.690 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:38:33.745 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:12.710 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:38:33.765 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:12.721 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:38:33.776 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:12.727 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:38:33.765 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:12.741 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:38:33.796 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:12.789 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:38:33.827 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:12.921 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:38:33.976 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:12.951 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:38:34.006 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:13.008 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:38:34.047 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:15.913 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:38:36.968 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:15.917 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:38:36.972 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:15.928 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:38:36.983 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:15.935 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:38:36.990 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:15.940 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:38:36.995 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:15.943 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:38:36.982 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:15.951 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:38:36.989 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:15.956 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:38:37.011 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:16.010 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:38:37.049 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:44:43.269 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:44:43.269 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:44:44.277 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:44:44.277 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:44:45.139 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:44:44.946+0000 5a6ac700 -1 handle_data failed with exit code -104 2019-12-09T14:45:20.119 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:45:20.119 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:46:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:46:27.332 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:47:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:07.918 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:47:08.649 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:08.649 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:47:09.989 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:47:09.773+0000 10c00f700 -1 handle_data failed with exit code -104 2019-12-09T14:48:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:09.801 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:48:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:11.222 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:48:11.808 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:48:11.765+0000 f27dc700 -1 handle_data failed with exit code -104 2019-12-09T14:48:43.511 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:43.512 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:49:28.089 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:43:49.144 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:28.098 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:43:49.153 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:28.101 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:43:49.157 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:28.105 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:43:49.160 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:28.114 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:43:49.152 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:28.136 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:43:49.174 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:28.295 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:43:49.350 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:28.299 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:43:49.354 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:28.371 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:43:49.409 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:48.355 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:50:24.896 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:24.896 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:50:25.975 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:25.975 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:50:27.237 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:50:27.192+0000 11a82c700 -1 handle_data failed with exit code -104 2019-12-09T14:51:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:34.696 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:51:36.569 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:36.570 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:51:37.297 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:51:37.217+0000 5feb7700 -1 handle_data failed with exit code -104 2019-12-09T14:52:14.753 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:52:14.753 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:52:34.575 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:46:55.630 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:52:34.577 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:46:55.633 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:52:34.616 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:46:55.671 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:52:34.618 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:46:55.673 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:52:34.663 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:46:55.702 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:52:34.666 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:46:55.705 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:52:34.700 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:46:55.755 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:52:34.724 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:46:55.779 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:52:34.820 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:46:55.859 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:53:36.132 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:53:36.132 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:54:15.106 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:54:15.106 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:54:16.620 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:54:16.621 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:54:17.359 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:54:17.297+0000 b275c700 -1 handle_data failed with exit code -104 2019-12-09T14:54:39.513 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:49:00.568 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:54:39.519 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:49:00.574 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:54:39.532 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:49:00.587 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:54:39.535 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:49:00.573 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:54:39.535 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:49:00.591 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:54:39.542 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:49:00.580 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:54:39.613 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:49:00.665 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:54:39.628 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:49:00.683 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:54:39.644 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:49:00.683 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:55:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:55:31.194 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:55:32.290 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:55:32.290 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:55:32.929 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T14:55:32.850+0000 d9fab700 -1 handle_data failed with exit code -104 2019-12-09T14:56:10.419 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:56:10.420 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:58:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:58:19.231 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:58:51.885 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:58:51.885 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:58:54.215 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:58:54.216 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:59:50.805 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:54:11.860 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:59:50.812 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:54:11.867 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:59:50.822 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:54:11.877 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:59:50.826 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:54:11.882 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:59:50.829 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:54:11.868 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:59:50.836 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:54:11.874 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:59:51.021 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:54:12.076 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T14:59:51.027 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:54:12.082 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T14:59:51.084 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:54:12.122 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T14:59:57.199 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:59:57.199 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T14:59:59.333 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:59:59.333 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:00:35.746 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:00:36.102 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_multiple_sizes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:00:36.102 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:00:39.100 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:00:39.100 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:00:49.389 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:00:49.389 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:00:51.959 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:00:51.959 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:01:01.011 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:55:22.066 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:01:01.017 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:55:22.072 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:01:01.059 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:55:22.097 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:01:01.060 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:55:22.114 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:01:01.067 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:55:22.105 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:01:01.072 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:55:22.127 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:01:01.082 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:55:22.137 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:01:01.126 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:55:22.181 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:01:01.144 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:55:22.182 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:01:13.304 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:01:13.305 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:01:33.207 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:01:33.207 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:02:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:02:00.476 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:02:30.076 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:02:30.077 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:02:53.245 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:02:53.499 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_multiple_sizes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:02:53.499 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:02:56.063 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:02:56.067 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:03:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:14.999 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:03:17.690 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:17.691 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:03:24.658 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:24.658 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:03:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:27.451 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:03:29.090 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:29.091 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:03:43.626 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:43.626 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:03:56.515 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:56.516 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:03:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:58.582 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:04:11.773 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:11.773 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:04:28.105 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:28.106 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:04:29.539 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:29.539 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:04:45.675 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:45.675 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:05:01.786 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:59:22.841 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:05:01.795 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:59:22.850 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:05:01.798 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:59:22.853 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:05:01.803 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:59:22.858 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:05:01.811 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:59:22.849 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:05:01.825 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:59:22.863 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:05:01.944 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:03:59:22.999 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:05:01.947 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:03:59:23.001 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:05:02.007 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:03:59:23.046 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:05:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:02.213 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:05:03.609 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:03.609 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:05:26.561 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:26.561 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:05:46.345 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:46.345 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:05:48.529 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:48.529 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:06:15.767 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:15.768 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:06:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:30.713 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:06:32.510 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:32.510 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:06:57.109 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:06:57.440 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_size_too_small ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:57.441 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:06:59.709 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:59.709 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:07:24.768 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:24.768 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:07:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:07:28.033 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_contents ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:28.033 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:07:30.685 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:30.685 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:08:17.897 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:08:18.217 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_overwrite_existing_object ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:18.217 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:08:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:22.055 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:09:02.382 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:09:02.638 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:02.638 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:09:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:04.077 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:09:26.026 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:26.026 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:09:27.558 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:03:48.608 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:09:27.585 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:03:48.640 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:09:27.605 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:03:48.660 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:09:27.622 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:03:48.677 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:09:27.663 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:03:48.702 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:09:27.667 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:03:48.706 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:09:27.691 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:03:48.746 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:09:27.735 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:03:48.790 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:09:27.916 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:03:48.954 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:09:31.393 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload_not_found ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:31.394 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:09:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:36.751 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:09:37.899 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:09:38.141 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_list_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:38.141 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:09:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:41.641 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:09:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:53.769 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:10.788 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:04:31.844 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:10:10.795 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:04:31.850 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:10:10.801 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:04:31.857 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:10:10.809 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:04:31.865 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:10:10.815 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:04:31.853 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:10:10.823 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:04:31.862 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:10:10.859 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:04:31.914 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:10:10.867 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:04:31.923 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:10:10.885 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:04:31.923 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:10:10.927 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:10.927 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:21.141 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:25.713 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:10:26.047 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_missing_part ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:26.047 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:28.841 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:28.842 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:34.226 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:10:34.487 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_incorrect_etag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:34.487 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:37.416 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:37.417 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:40.838 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:10:41.249 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_100_continue ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:41.249 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:45.291 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:10:45.728 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_set_cors ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:45.728 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:48.494 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:48.494 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:10:51.447 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_response ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:51.447 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:53.682 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:53.682 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:58.190 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:58.190 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:10:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:59.528 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:00.525 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:00.525 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:01.857 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:01.858 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:03.052 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:03.751 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:05.013 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:06.649 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:06.649 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:07.955 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:09.058 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:10.205 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:10.206 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:11.393 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:12.089 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:12.089 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:12.875 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:12.876 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:13.495 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:14.245 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:14.245 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:14.985 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:14.985 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:15.605 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:17.946 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:17.946 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:18.558 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:18.559 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:19.247 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:20.127 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:20.128 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:21.071 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:21.072 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:21.748 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:21.749 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:22.913 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:22.913 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:23.380 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:23.381 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:24.070 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:24.746 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:24.746 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:25.241 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:25.241 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:26.779 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:26.779 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:27.503 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:27.503 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:28.026 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:29.388 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:29.389 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:11:29.778 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_wildcard ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:29.778 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:31.898 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:31.898 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:37.321 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:37.321 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:38.449 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:38.449 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:11:40.203 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_cors_header_option ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:40.203 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:42.923 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:46.932 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:46.933 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:48.589 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:11:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:48.900 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:52.627 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:52.628 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:55.025 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:11:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:12:01.274 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:12:01.588 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_4mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:12:01.588 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:12:04.141 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:12:04.141 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:12:14.991 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:12:14.991 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:12:26.012 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:12:26.013 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:12:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:12:31.489 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_8mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:12:31.489 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:12:33.204 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:12:33.204 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:12:48.322 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:12:48.322 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:13:02.181 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:02.183 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:13:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:13:11.065 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:11.065 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:13:14.221 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:14.221 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:13:19.580 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:19.580 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:13:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:21.452 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:13:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:26.184 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:13:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:13:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_4mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:29.018 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:13:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:32.469 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:13:40.444 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:40.444 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:13:47.857 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:47.857 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:13:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:55.500 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:14:06.109 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:06.110 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:14:13.395 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:14:14.335 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_8mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:14.335 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:14:16.902 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:16.902 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:14:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:28.962 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:14:39.426 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:39.426 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:14:58.375 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:58.376 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:15:10.421 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:10.421 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:15:20.605 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:15:20.950 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:20.951 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:15:23.520 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:09:44.575 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:15:23.525 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:09:44.581 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:15:23.541 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:09:44.596 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:15:23.545 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:09:44.601 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:15:23.548 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:09:44.587 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:15:23.559 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:09:44.597 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:15:23.726 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:09:44.781 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:15:23.734 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:09:44.789 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:15:23.805 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:09:44.843 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:15:24.812 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:24.812 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:15:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:28.830 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:15:33.293 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:33.294 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:15:34.272 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:15:34.616 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_4mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:34.616 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:15:37.273 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:37.273 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:15:47.409 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:47.409 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:15:59.338 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:59.338 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:16:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:16:03.762 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_8mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:16:03.762 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:16:06.352 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:16:06.352 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:16:30.401 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:16:30.401 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:16:48.155 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:16:48.155 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:16:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:16:57.476 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_atomic_conditional_write_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:16:57.476 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:00.895 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:00.895 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:03.591 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:05.762 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:05.762 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:10.845 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:10.845 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:12.925 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:17:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_atomic_multipart_upload_write ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:13.183 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:16.676 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:16.677 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:22.221 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:17:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_multipart_resend_first_finishes_last ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:22.471 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:24.900 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:24.901 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:34.211 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:34.211 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:41.248 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:41.248 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:42.989 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:17:43.344 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:43.344 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:45.834 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:45.834 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:47.161 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:17:47.436 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_ranged_big_request_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:47.436 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:50.522 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:50.522 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:17:53.857 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:12:14.913 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:53.872 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:12:14.927 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:53.878 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:12:14.934 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:53.881 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:12:14.937 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:53.945 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:12:14.983 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:53.948 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:12:14.986 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:53.981 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:12:15.036 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:53.989 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:12:15.045 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:54.073 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:12:15.112 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:18:05.420 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:18:05.689 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_skip_leading_bytes_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:05.689 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:08.044 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:08.044 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:09.281 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:18:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_return_trailing_bytes_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:09.713 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:12.406 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:12.407 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:13.642 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:18:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_invalid_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:13.961 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:16.590 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:16.590 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:18.743 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:18:18.995 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_empty_object ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:18.995 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:21.259 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:21.259 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:22.992 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:18:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_create_suspend ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:23.233 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:25.214 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:25.215 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:25.732 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:25.733 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:26.766 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:26.766 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:28.153 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:28.153 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:29.897 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:29.897 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:31.036 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:18:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:31.302 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:18:34.043 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:34.043 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:20:35.473 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:14:56.528 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:20:35.478 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:14:56.534 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:20:35.491 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:14:56.546 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:20:35.494 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:14:56.549 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:20:35.500 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:14:56.539 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:20:35.508 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:14:56.546 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:20:35.610 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:14:56.665 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:20:35.624 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:14:56.677 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:20:35.644 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:14:56.683 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:23:12.839 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:23:13.079 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:23:13.079 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:23:15.338 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:23:15.338 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:07.042 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:24:07.723 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_removal ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:07.724 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:10.938 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:10.938 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:11.342 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:13.298 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:13.299 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:19.205 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:24:19.464 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:19.465 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:22.318 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:23.235 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:23.235 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:24.661 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:24.661 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:38.145 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:24:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite_suspended ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:38.397 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:43.093 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:43.093 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:43.577 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:45.149 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:46.645 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:46.645 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:54.538 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:24:54.849 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_suspend_versions ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:54.850 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:24:58.481 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:24:58.481 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:25:00.324 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:25:00.325 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:25:19.876 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:25:19.876 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:25:45.158 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:25:45.163 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:25:47.237 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:20:08.292 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:25:47.244 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:20:08.299 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:25:47.255 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:20:08.311 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:25:47.259 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:20:08.315 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:25:47.266 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:20:08.304 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:25:47.295 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:20:08.334 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:25:47.525 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:20:08.581 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:25:47.532 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:20:08.588 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:25:47.636 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:20:08.675 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:26:15.314 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:20:36.370 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:26:15.362 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:20:36.418 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:26:15.371 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:20:36.426 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:26:15.373 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:20:36.428 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:26:15.389 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:20:36.428 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:26:15.400 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:20:36.435 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:26:15.400 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:20:36.451 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:26:15.405 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:20:36.461 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:26:15.442 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:20:36.480 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:26:51.597 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:26:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_all ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:26:51.810 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:26:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:26:55.914 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:26:57.570 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:26:57.571 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:28:43.065 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:28:43.375 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_special_names ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:28:43.376 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:28:44.798 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:28:44.799 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:28:46.364 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:28:46.364 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:29:11.040 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:23:32.096 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:29:11.066 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:23:32.120 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:29:11.073 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:23:32.128 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:29:11.100 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:23:32.138 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:29:11.101 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:23:32.157 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:29:11.173 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:23:32.208 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:29:11.244 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:23:32.299 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:29:11.264 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:23:32.319 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:29:11.446 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:23:32.484 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:30:57.438 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:25:18.493 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:30:57.448 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:25:18.501 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:30:57.454 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:25:18.510 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:30:57.459 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:25:18.497 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:30:57.459 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:25:18.514 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:30:57.463 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:25:18.501 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:30:57.524 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:25:18.580 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:30:57.546 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:25:18.601 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:30:57.551 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:25:18.590 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:34:37.068 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:28:58.123 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:34:37.120 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:28:58.176 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:34:37.140 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:28:58.178 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:34:37.141 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:28:58.180 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:34:37.190 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:28:58.245 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:34:37.192 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:28:58.248 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:34:37.239 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:28:58.277 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:34:37.315 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:28:58.371 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:34:37.316 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:28:58.372 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:36:00.534 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:36:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_overwrite_multipart ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:36:00.786 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:36:02.873 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:36:02.874 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:36:04.390 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:36:04.390 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:36:09.549 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:30:30.604 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:36:09.556 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:30:30.611 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:36:09.562 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:30:30.618 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:36:09.567 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:30:30.623 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:36:09.573 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:30:30.611 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:36:09.607 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:30:30.645 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:36:09.628 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:30:30.683 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:36:09.633 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:30:30.689 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:36:09.701 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:30:30.739 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:37:06.208 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:37:06.209 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:38:08.475 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:38:08.475 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:39:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:39:06.407 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:41:21.687 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:35:42.742 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:41:21.692 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:35:42.748 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:41:21.708 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:35:42.763 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:41:21.709 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:35:42.747 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:41:21.712 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:35:42.768 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:41:21.729 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:35:42.767 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:41:21.884 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:35:42.940 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:41:21.936 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:35:42.991 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:41:21.987 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:35:43.025 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:42:25.462 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:42:25.803 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_list_marker ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:42:25.803 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:42:29.297 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:42:29.297 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:42:30.342 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:42:30.342 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:42:58.483 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:37:19.536 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:42:58.521 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:37:19.576 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:42:58.556 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:37:19.594 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:42:58.560 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:37:19.599 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:42:58.566 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:37:19.621 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:42:58.568 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:37:19.623 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:42:58.599 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:37:19.655 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:42:58.627 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:37:19.682 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:42:58.637 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:37:19.675 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:43:08.573 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:43:08.843 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_copy_obj_version ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:43:08.843 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:43:11.442 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:43:11.442 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:43:12.566 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:43:12.566 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:43:39.904 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:43:39.904 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:43:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:43:52.655 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:43:52.655 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:43:55.583 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:43:55.583 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:43:57.317 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:43:57.317 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:44:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:44:18.239 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:44:18.239 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:44:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:44:21.876 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:44:23.742 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:44:23.743 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:44:48.675 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:44:48.914 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker_create ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:44:48.914 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:44:50.838 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:44:50.839 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:44:52.413 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:44:52.413 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:44:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:44:56.312 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:44:56.312 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:00.851 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:00.851 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:04.099 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:04.099 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:45:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl_no_version_specified ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:22.172 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:25.431 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:25.432 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:26.586 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:40.358 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:40.359 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:42.883 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:45:43.403 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_concurrent_remove ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:43.403 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:45.911 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:45.912 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:48.035 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:48.036 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:48.309 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:48.310 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:48.631 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:48.631 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:48.785 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:45:49.434 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:45:52.107 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-52: 2019-12-09T15:45:52.108 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:45:52.108 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:45:52.108 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:45:52.108 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:45:52.108 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:45:52.108 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:45:52.108 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:45:52.109 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:45:52.109 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:45:52.109 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:45:52.109 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:45:52.109 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:45:52.109 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:45:52.292 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-54: 2019-12-09T15:45:52.293 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:45:52.293 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:45:52.293 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:45:52.293 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:45:52.293 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:45:52.293 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:45:52.294 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:45:52.294 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:45:52.294 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:45:52.294 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:45:52.294 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:45:52.294 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:45:52.294 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:45:52.297 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-53: 2019-12-09T15:45:52.297 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:45:52.297 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:45:52.297 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:45:52.297 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:45:52.297 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:45:52.298 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:45:52.298 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:45:52.298 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:45:52.298 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:45:52.298 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:45:52.298 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:45:52.298 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:45:52.299 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:45:52.354 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-51: 2019-12-09T15:45:52.354 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:45:52.354 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:45:52.355 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:45:52.355 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:45:52.355 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:45:52.355 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:45:52.355 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:45:52.356 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:45:52.356 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:45:52.356 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:45:52.356 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:45:52.356 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:45:52.357 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:02.192 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-63: 2019-12-09T15:46:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:02.193 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:02.193 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:02.193 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:02.193 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:02.193 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:02.194 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:02.194 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:02.194 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:02.194 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:02.194 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:02.195 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:02.195 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:02.515 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-61: 2019-12-09T15:46:02.515 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:02.515 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:02.515 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:02.516 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:02.516 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:02.516 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:02.516 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:02.516 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:02.516 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:02.517 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:02.517 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:02.517 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:02.517 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:02.937 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-62: 2019-12-09T15:46:02.937 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:02.937 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:02.937 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:02.937 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:02.937 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:02.938 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:02.938 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:02.938 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:02.938 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:02.938 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:02.938 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:02.938 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:02.939 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:14.133 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-75: 2019-12-09T15:46:14.133 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:14.133 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:14.133 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:14.133 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:14.133 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:14.134 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:14.134 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:14.134 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:14.134 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:14.134 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:14.134 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:14.134 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:14.135 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:14.233 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-71: 2019-12-09T15:46:14.234 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:14.234 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:14.234 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:14.234 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:14.234 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:14.234 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:14.234 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:14.235 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:14.235 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:14.235 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:14.235 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:14.235 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:14.235 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-73: 2019-12-09T15:46:15.435 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:15.435 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:15.435 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:15.435 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:15.435 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:15.435 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:15.436 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:15.436 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:15.436 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:15.436 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:15.436 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:15.436 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:15.437 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:15.483 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-74: 2019-12-09T15:46:15.484 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:15.484 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:15.484 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:15.485 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:15.485 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:15.485 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:15.485 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:15.485 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:15.486 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:15.486 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:15.486 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:15.486 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:15.487 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-83: 2019-12-09T15:46:25.349 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:25.349 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:25.349 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:25.350 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:25.350 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:25.350 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:25.350 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:25.350 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:25.350 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:25.350 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:25.351 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:25.351 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:25.644 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-85: 2019-12-09T15:46:25.644 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:25.645 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:25.645 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:25.645 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:25.645 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:25.646 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:25.646 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:25.646 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:25.646 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:25.647 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:25.647 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:25.647 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:25.647 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:25.697 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-84: 2019-12-09T15:46:25.698 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:25.698 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:25.698 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:25.698 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:25.699 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:25.699 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:25.699 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:25.699 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:25.699 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:25.700 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:25.700 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:25.700 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:25.701 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:25.720 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-81: 2019-12-09T15:46:25.720 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:25.721 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:25.721 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:25.721 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:25.721 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:25.721 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:25.721 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:25.722 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:25.722 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:25.722 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:25.722 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:25.722 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:25.722 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:33.944 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:40:54.999 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:46:33.955 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:40:55.010 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:46:33.958 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:40:54.997 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:46:33.961 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:40:55.000 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:46:33.968 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:40:55.023 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:46:33.972 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:40:55.027 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:46:34.097 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:40:55.135 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:46:34.143 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:40:55.198 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:46:34.153 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:40:55.208 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:46:34.724 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-92: 2019-12-09T15:46:34.724 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:34.725 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:34.725 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:34.725 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:34.725 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:34.725 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:34.726 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:34.726 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:34.726 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:34.726 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:34.726 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:34.727 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:34.727 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:34.897 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-95: 2019-12-09T15:46:34.897 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:34.897 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:34.898 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:34.898 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:34.898 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:34.898 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:34.898 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:34.898 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:34.898 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:34.899 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:34.899 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:34.899 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:34.899 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:35.341 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-94: 2019-12-09T15:46:35.341 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:35.341 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:35.342 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:35.342 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:35.342 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:35.342 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:35.342 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:35.342 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:35.343 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:35.343 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:35.343 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:35.343 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:35.343 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:35.361 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-93: 2019-12-09T15:46:35.361 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:35.362 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:35.362 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:35.362 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:35.362 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:35.362 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:35.362 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:35.362 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:35.363 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:35.363 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:35.363 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:35.363 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:35.363 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:42.624 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:46:43.119 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_and_remove ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:46:43.119 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:46:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:46:46.040 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:46:47.443 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:46:47.443 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:46:47.991 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:46:47.991 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:46:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:46:48.011 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:46:48.391 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:46:48.391 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:46:49.221 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:46:49.222 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:46:49.564 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:46:49.564 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:46:49.935 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:46:49.935 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:46:50.662 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:46:50.662 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:46:50.838 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:46:50.838 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:46:51.093 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:46:51.093 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:46:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-102: 2019-12-09T15:46:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:52.246 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:52.246 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:52.246 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:52.246 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:52.246 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:52.246 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:52.246 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:52.247 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:52.247 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:52.247 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:52.247 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:52.247 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:52.421 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-104: 2019-12-09T15:46:52.421 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:52.421 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:52.422 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:52.422 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:52.422 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:52.422 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:52.422 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:52.422 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:52.422 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:52.423 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:52.423 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:52.423 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:52.423 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:53.332 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-105: 2019-12-09T15:46:53.332 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:53.333 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:53.333 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:53.333 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:53.334 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:53.334 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:53.334 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:53.335 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:53.335 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:53.335 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:53.336 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:53.336 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:53.336 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:53.399 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-101: 2019-12-09T15:46:53.399 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:53.399 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:53.399 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:53.399 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:53.399 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:53.400 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:53.400 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:53.400 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:53.400 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:53.400 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:53.400 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:53.400 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:53.401 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:46:53.892 INFO:teuthology.orchestra.run.smithi146.stderr:Exception in thread Thread-106: 2019-12-09T15:46:53.892 INFO:teuthology.orchestra.run.smithi146.stderr:Traceback (most recent call last): 2019-12-09T15:46:53.892 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T15:46:53.892 INFO:teuthology.orchestra.run.smithi146.stderr: self.run() 2019-12-09T15:46:53.893 INFO:teuthology.orchestra.run.smithi146.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T15:46:53.893 INFO:teuthology.orchestra.run.smithi146.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T15:46:53.893 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T15:46:53.893 INFO:teuthology.orchestra.run.smithi146.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T15:46:53.893 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T15:46:53.893 INFO:teuthology.orchestra.run.smithi146.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T15:46:53.894 INFO:teuthology.orchestra.run.smithi146.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T15:46:53.894 INFO:teuthology.orchestra.run.smithi146.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T15:46:53.894 INFO:teuthology.orchestra.run.smithi146.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T15:46:53.894 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T15:47:09.479 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:47:09.920 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:09.921 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:12.299 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:12.300 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:13.763 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:47:14.016 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:14.016 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:17.717 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:47:20.951 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get_no_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:20.951 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:23.460 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:23.460 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:25.706 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:47:25.956 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_id_too_long ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:25.956 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:28.455 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:28.455 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:28.592 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:47:28.937 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_same_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:28.937 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:31.214 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:31.215 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:31.412 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:47:31.814 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_invalid_status ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:31.814 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:35.997 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:35.997 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:36.949 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:47:37.432 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_date ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:37.432 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:40.217 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:42.048 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:47:42.374 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_invalid_date ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:42.374 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:45.075 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:45.248 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:47:45.484 INFO:teuthology.orchestra.run.smithi146.stderr:Check for valid x-amz-expiration header after PUT ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:45.484 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:47.597 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:50.608 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:47:50.841 INFO:teuthology.orchestra.run.smithi146.stderr:Check for valid x-amz-expiration header on HEAD request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:50.841 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:53.279 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:56.278 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:56.279 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:56.691 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:47:56.942 INFO:teuthology.orchestra.run.smithi146.stderr:Check for valid x-amz-expiration header on GET request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:56.943 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:47:59.688 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:47:59.688 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:01.671 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:01.671 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:01.874 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:48:02.119 INFO:teuthology.orchestra.run.smithi146.stderr:Check x-amz-expiration-header object tags interaction ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:02.119 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:04.578 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:04.578 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:12.819 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:48:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_noncurrent ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:13.183 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:18.054 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:18.054 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:19.661 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:48:19.928 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_deletemarker ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:19.928 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:23.446 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:23.446 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:48:25.114 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_filter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:25.115 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:28.109 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:29.749 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:48:30.023 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_empty_filter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:30.023 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:32.420 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:32.421 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:33.776 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:48:34.048 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_multipart ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:34.048 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:36.056 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:36.056 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:42.682 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:48:43.066 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:43.067 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:45.923 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:45.924 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:48:47.692 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1kb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:47.692 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:49.829 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:49.830 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:51.725 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:48:51.995 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1MB ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:51.996 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:54.182 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:54.182 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:48:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:48:58.281 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_13b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:48:58.281 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:01.147 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:01.148 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:03.001 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:49:03.325 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_method_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:03.325 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:05.713 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:49:08.463 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_present ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:08.464 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:11.060 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:49:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_other_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:14.051 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:16.316 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:16.317 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:17.901 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:49:18.191 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_invalid_md5 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:18.191 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:20.677 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:20.677 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:20.968 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:49:21.313 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_md5 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:21.313 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:22.913 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:22.913 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:23.117 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:49:23.383 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:23.387 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:26.122 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:26.246 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:49:26.781 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encryption_key_no_sse_c ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:26.782 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:29.892 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:29.892 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:30.044 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:49:30.547 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:30.547 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:49:33.475 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:49:33.475 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:51:20.256 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:45:41.311 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:20.303 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:45:41.357 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:20.330 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:45:41.385 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:20.332 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:45:41.387 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:20.350 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:45:41.388 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:20.352 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:45:41.391 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:20.470 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:45:41.525 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:20.493 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:45:41.548 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:20.522 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:45:41.560 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:51:26.504 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:51:45.394 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:46:06.449 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:45.399 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:46:06.454 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:45.408 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:46:06.463 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:45.411 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:46:06.466 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:45.411 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:46:06.450 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:45.416 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:46:06.454 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:45.436 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:46:06.491 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:45.443 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:46:06.498 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:51:45.454 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:46:06.492 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:52:44.349 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:52:44.349 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:53:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:53:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_bad_download ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:53:22.141 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:53:25.861 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:53:25.861 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:54:40.793 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:54:40.794 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:54:41.107 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:54:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_post_object_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:54:41.446 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:54:44.105 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:54:44.106 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:54:46.248 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:54:46.248 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:54:47.107 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:54:47.692 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_method_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:54:47.692 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:54:50.985 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:54:50.985 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:54:52.966 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:54:53.362 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_present ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:54:53.362 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:54:56.115 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:54:56.115 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:54:57.432 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:54:57.713 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_no_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:54:57.714 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:55:00.151 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:55:00.152 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:55:00.363 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:55:00.987 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_not_declared ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:55:00.987 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:55:03.627 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:55:03.627 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:55:03.903 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:55:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:55:04.216 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:55:07.170 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:55:07.170 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:56:53.973 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:56:54.000 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:56:56.324 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:56:56.324 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:56:58.395 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:51:19.450 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:58.406 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:51:19.460 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:58.415 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:51:19.470 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:58.420 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:51:19.475 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:58.428 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:51:19.466 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:58.444 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:51:19.482 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:58.607 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:51:19.661 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:58.612 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:51:19.667 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:58.764 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:51:19.802 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:57:57.034 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:57:57.034 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:57:58.700 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:57:58.700 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:58:30.521 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:58:31.002 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_1 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:58:31.003 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:58:32.802 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:58:32.802 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:59:28.400 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T15:59:28.663 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:59:28.663 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:59:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:59:30.639 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T15:59:41.763 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:54:02.817 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:41.775 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:54:02.813 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:41.783 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:54:02.837 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:41.796 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:54:02.834 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:41.810 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:54:02.865 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:41.818 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:54:02.872 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:41.865 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:54:02.920 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:41.900 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:54:02.955 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:41.905 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:54:02.943 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:00:37.514 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:00:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_post_object_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:00:38.117 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:00:40.473 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:00:40.473 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:00:42.978 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:00:42.979 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:00:43.615 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:00:44.292 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:00:44.292 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:00:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:00:46.772 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:00:48.633 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:00:48.845 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1kb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:00:48.845 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:00:50.905 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:00:50.905 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:00:53.062 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:00:53.397 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1MB ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:00:53.398 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:00:56.132 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:00:56.132 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:00.434 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:01:00.772 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_13b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:00.772 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:03.423 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:03.423 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:04.688 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:01:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_read_declare ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:04.903 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:07.010 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:07.010 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:01:08.460 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:08.460 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:11.826 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:11.827 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:14.727 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:14.727 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:01:17.619 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:17.619 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:20.190 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:20.191 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:22.450 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:22.450 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:23.284 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:01:23.622 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:23.622 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:26.513 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:26.513 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:31.235 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:31.235 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:35.062 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:01:35.480 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:35.480 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:37.357 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:41.720 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:41.720 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:44.463 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:01:44.860 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_another_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:44.860 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:48.654 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:48.654 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:52.043 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:52.043 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:56.712 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:56.712 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:57.652 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:57.652 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:01:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:01:58.706 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_another_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:01:58.707 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:01.642 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:01.642 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:04.594 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:04.594 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:08.522 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:56:29.576 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:02:08.529 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:56:29.584 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:02:08.541 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:56:29.595 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:02:08.546 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:56:29.584 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:02:08.547 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:56:29.603 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:02:08.557 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:56:29.594 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:02:08.663 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:04:56:29.717 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:02:08.663 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:04:56:29.699 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:02:08.697 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:04:56:29.752 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:02:09.344 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:09.344 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:10.039 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:02:10.940 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_get_obj_tagging ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:10.940 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:13.469 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:13.469 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:26.419 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:27.892 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:02:28.306 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_get_obj_head_tagging ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:28.306 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:30.829 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:30.829 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:41.468 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:41.468 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:42.940 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:02:43.221 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_max_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:43.221 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:47.545 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:47.545 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:02:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:02:59.550 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:03:00.894 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:03:01.185 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_excess_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:03:01.185 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:03:04.075 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:03:04.075 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:03:15.507 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:03:15.507 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:03:16.556 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:03:16.918 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_max_kvsize_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:03:16.918 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:03:19.789 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:03:19.789 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:03:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:03:31.157 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:03:33.270 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:03:33.673 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_excess_key_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:03:33.673 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:03:37.263 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:03:37.263 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:03:49.772 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:03:49.773 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:03:50.720 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:03:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_excess_val_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:03:51.071 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:03:54.748 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:03:54.748 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:06.858 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:06.859 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:07.882 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:04:08.167 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_modify_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:08.167 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:11.134 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:11.134 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:22.913 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:22.913 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:27.255 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:04:27.496 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_delete_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:27.496 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:30.756 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:30.756 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:40.763 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:40.763 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:45.080 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:04:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_anonymous_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:45.417 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:48.476 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:49.744 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:04:49.943 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:49.943 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:52.729 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:52.729 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:54.607 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:54.607 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:55.455 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:04:55.791 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_obj_with_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:55.792 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:04:58.159 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:04:58.160 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:00.951 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:05:01.368 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_get_tags_acl_public ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:01.368 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:04.061 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:04.061 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:15.977 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:15.978 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:18.882 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:19.412 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:05:19.890 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_put_tags_acl_public ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:19.890 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:22.228 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:22.229 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:36.562 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:36.563 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:37.856 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:37.856 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:38.633 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:05:38.886 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_delete_tags_obj_public ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:38.886 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:41.627 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:41.627 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:53.633 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:53.633 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:56.016 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:56.016 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:05:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:05:58.695 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_atomic_upload_return_version_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:05:58.696 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:06:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:06:00.901 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:06:03.188 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:06:03.188 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:06:09.050 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:06:09.050 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:06:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:06:12.230 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:06:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:06:14.795 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:06:17.361 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:06:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_multipart_upload_return_version_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:06:17.632 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:06:20.746 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:06:20.746 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:06:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:06:22.426 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:07:20.161 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:01:41.216 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:07:20.170 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:01:41.225 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:07:20.180 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:01:41.235 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:07:20.183 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:01:41.238 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:07:20.191 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:01:41.227 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:07:20.207 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:01:41.245 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:07:20.351 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:01:41.406 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:07:20.376 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:01:41.431 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:07:20.439 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:01:41.476 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:07:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:07:26.921 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:08:03.125 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:02:24.179 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:03.147 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:02:24.202 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:03.149 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:02:24.187 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:03.179 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:02:24.234 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:03.186 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:02:24.224 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:03.188 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:02:24.243 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:03.202 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:02:24.257 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:03.221 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:02:24.258 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:03.257 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:02:24.312 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:23.410 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:08:23.410 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:08:25.812 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:08:25.812 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:09:25.706 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:09:25.960 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:09:25.960 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:09:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:09:34.056 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:09:38.221 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:09:38.221 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:09:39.136 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:09:39.136 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:09:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:09:40.557 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_tagging_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:09:40.557 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:09:48.915 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:09:48.915 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:09:54.148 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:09:54.148 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:09:55.983 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:09:56.271 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_tagging_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:09:56.271 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:03.463 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:03.463 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:06.941 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:06.941 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:10:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:09.381 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:15.407 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:15.408 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:16.688 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:21.162 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:21.163 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:26.415 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:10:26.788 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source_meta ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:26.788 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:33.221 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:33.221 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:33.789 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:04:54.838 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:10:33.801 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:04:54.847 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:10:33.831 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:04:54.884 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:10:33.883 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:04:54.937 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:10:33.913 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:04:54.945 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:10:33.914 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:04:54.948 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:10:33.920 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:04:54.975 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:10:34.020 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:04:55.058 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:10:34.034 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:04:55.088 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:10:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:34.287 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:38.200 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:40.734 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:10:41.050 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:41.050 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:43.362 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:43.362 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:44.498 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:44.498 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:45.945 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:10:46.260 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_grant ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:46.261 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:50.071 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:50.072 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:53.034 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:53.034 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:55.117 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:10:58.604 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:10:58.857 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_acl_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:10:58.858 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:04.153 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:04.153 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:09.974 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:09.974 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:12.536 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:11:12.793 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:12.793 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:11:17.902 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:17.902 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:21.320 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:11:21.564 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_with_days_and_years ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:21.565 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:25.701 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:11:26.043 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_days ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:26.043 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:28.718 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:11:28.942 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_years ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:28.943 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:11:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_status ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:31.685 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:34.704 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:11:34.926 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_suspend_versioning ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:34.926 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:11:38.885 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:38.885 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:42.016 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:11:42.373 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:42.373 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:44.303 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:11:44.630 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:44.630 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:11:56.014 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:11:56.015 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:11:59.786 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:12:00.088 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_mode ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:12:00.089 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:12:07.566 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:12:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:12:07.905 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:12:20.199 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:12:20.593 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:12:20.593 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:12:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:12:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_versionid ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:12:27.092 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:12:29.195 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:06:50.250 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:12:29.201 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:06:50.256 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:12:29.208 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:06:50.263 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:12:29.211 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:06:50.266 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:12:29.227 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:06:50.262 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:12:29.230 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:06:50.268 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:12:29.294 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:06:50.348 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:12:29.294 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:06:50.349 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:12:29.342 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:06:50.379 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:12:39.672 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:12:39.950 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_override_default_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:12:39.950 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:12:52.430 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:12:52.670 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_increase_period ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:12:52.670 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:13:06.128 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:13:06.442 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:13:06.442 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:13:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:13:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period_bypass ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:13:21.178 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:13:36.763 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:13:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:13:51.344 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:13:51.582 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:13:51.582 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:13:59.497 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:13:59.777 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:13:59.778 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:14:03.360 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:14:04.241 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_status ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:14:04.242 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:14:10.008 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:14:10.442 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:14:10.442 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:14:21.570 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:14:21.780 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:14:21.781 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:14:24.971 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:14:25.265 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_on ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:14:25.265 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:14:34.680 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:14:34.913 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_off ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:14:34.914 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:14:48.569 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:14:48.841 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:14:48.841 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:15:02.755 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:15:03.026 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_s3.test_object_lock_uploading_obj ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:15:03.026 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:15:15.543 INFO:teuthology.orchestra.run.smithi146.stderr:ok 2019-12-09T16:15:15.561 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.functional.test_utils.test_generate ... ok 2019-12-09T16:15:15.824 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T16:15:15.825 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T16:16:29.783 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:10:50.838 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:16:29.843 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:10:50.898 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:16:29.877 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:10:50.915 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:16:29.885 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:10:50.923 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:16:29.897 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:10:50.952 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:16:29.898 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:10:50.953 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:16:29.965 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:10:51.020 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:16:29.993 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:10:51.048 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:16:30.036 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:10:51.074 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:17:40.142 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:12:01.197 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:17:40.153 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:12:01.204 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:17:40.161 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:12:01.214 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:17:40.163 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:12:01.217 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:17:40.166 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:12:01.203 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:17:40.171 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:12:01.208 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:17:40.210 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:12:01.265 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:17:40.221 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:12:01.276 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:17:40.294 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:12:01.331 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:22:53.194 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:17:14.249 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:22:53.207 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:17:14.256 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:22:53.213 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:17:14.266 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:22:53.213 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:17:14.245 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:22:53.214 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:17:14.251 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:22:53.219 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:17:14.273 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:22:53.379 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:17:14.433 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:22:53.399 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:17:14.454 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:22:53.421 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:17:14.459 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:24:51.292 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:19:12.347 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:24:51.296 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:19:12.351 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:24:51.311 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:19:12.366 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:24:51.312 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:19:12.368 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:24:51.348 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:19:12.385 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:24:51.350 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:19:12.387 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:24:51.385 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:19:12.440 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:24:51.410 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:19:12.447 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:24:51.423 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:19:12.477 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:28:05.266 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:22:26.321 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:28:05.269 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:22:26.324 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:28:05.276 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:22:26.330 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:28:05.279 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:22:26.334 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:28:05.291 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:22:26.328 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:28:05.297 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:22:26.334 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:28:05.407 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:22:26.462 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:28:05.454 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:22:26.509 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:28:05.457 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:22:26.494 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:12.838 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:27:33.893 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:12.849 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:27:33.904 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:12.908 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:27:33.945 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:12.909 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:27:33.964 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:12.914 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:27:33.969 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:12.915 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:27:33.952 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:13.066 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:27:34.121 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:13.095 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:27:34.150 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:13.160 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:27:34.197 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:15.589 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:27:36.644 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:15.596 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:27:36.650 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:15.611 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:27:36.666 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:15.617 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:27:36.654 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:15.617 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:27:36.672 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:15.623 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:27:36.678 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:15.628 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:27:36.665 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:15.641 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:27:36.696 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:33:15.683 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:27:36.719 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:27.674 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:32:48.729 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:27.689 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:32:48.736 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:27.700 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:32:48.737 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:27.705 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:32:48.760 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:27.705 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:32:48.742 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:27.710 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:32:48.765 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:27.861 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:32:48.916 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:27.891 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:32:48.946 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:27.950 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:32:48.987 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:43:39.805 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:38:00.859 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:43:39.813 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:38:00.868 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:43:39.819 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:38:00.874 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:43:39.826 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:38:00.881 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:43:39.833 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:38:00.864 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:43:39.835 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:38:00.872 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:43:39.969 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:38:01.023 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:43:39.983 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:38:01.038 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:43:40.054 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:38:01.090 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:48:50.663 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:43:11.718 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:48:50.677 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:43:11.732 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:48:50.680 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:43:11.735 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:48:50.682 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:43:11.719 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:48:50.683 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:43:11.738 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:48:50.687 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:43:11.723 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:48:50.854 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:43:11.909 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:48:50.873 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:43:11.928 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:48:50.919 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:43:11.956 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:50:00.835 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:44:21.891 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:50:00.853 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:44:21.908 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:50:00.886 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:44:21.923 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:50:00.887 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:44:21.941 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:50:00.888 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:44:21.943 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:50:00.917 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:44:21.972 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:50:00.921 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:44:21.958 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:50:00.949 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:44:22.004 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:50:00.998 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:44:22.034 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:11.336 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:45:32.391 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:11.387 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:45:32.435 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:11.439 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:45:32.494 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:11.443 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:45:32.480 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:11.448 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:45:32.503 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:11.452 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:45:32.488 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:11.459 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:45:32.515 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:11.514 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:45:32.551 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:11.515 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:45:32.569 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:53:59.757 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:48:20.812 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:53:59.764 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:48:20.819 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:53:59.777 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:48:20.832 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:53:59.782 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:48:20.837 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:53:59.789 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:48:20.826 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:53:59.797 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:48:20.834 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:53:59.882 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:48:20.937 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:53:59.898 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:48:20.953 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:53:59.973 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:48:21.009 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:58:22.667 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:52:43.722 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:58:22.683 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:52:43.739 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:58:22.694 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:52:43.749 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:58:22.723 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:52:43.778 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:58:22.744 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:52:43.781 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:58:22.748 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:52:43.785 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:58:22.827 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:52:43.883 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:58:22.829 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:52:43.885 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:58:22.862 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:52:43.898 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:59:12.345 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:53:33.400 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:59:12.350 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:53:33.406 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:59:12.366 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:53:33.421 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:59:12.370 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:53:33.426 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:59:12.372 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:53:33.409 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:59:12.378 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:53:33.414 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T16:59:12.420 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:53:33.476 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T16:59:12.424 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:53:33.480 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T16:59:12.463 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:53:33.499 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:04:19.895 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:58:40.950 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:04:19.907 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:58:40.956 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:04:19.907 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:58:40.962 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:04:19.911 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:58:40.967 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:04:19.916 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:58:40.953 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:04:19.922 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:58:40.958 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:04:20.124 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:05:58:41.180 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:04:20.132 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:05:58:41.168 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:04:20.133 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:05:58:41.189 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:44.280 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:01:05.336 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:44.295 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:01:05.352 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:44.296 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:01:05.332 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:44.297 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:01:05.334 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:44.305 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:01:05.361 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:44.312 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:01:05.368 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:44.369 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:01:05.405 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:44.382 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:01:05.439 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:44.480 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:01:05.536 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:09:29.996 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:03:51.052 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:09:30.002 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:03:51.058 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:09:30.010 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:03:51.066 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:09:30.014 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:03:51.070 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:09:30.024 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:03:51.060 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:09:30.033 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:03:51.070 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:09:30.125 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:03:51.181 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:09:30.141 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:03:51.197 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:09:30.221 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:03:51.257 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:14:40.982 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:09:02.038 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:14:40.992 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:09:02.045 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:14:40.995 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:09:02.051 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:14:40.999 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:09:02.056 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:14:41.013 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:09:02.049 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:14:41.031 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:09:02.067 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:14:41.165 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:09:02.221 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:14:41.178 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:09:02.234 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:14:41.275 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:09:02.312 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:15:05.995 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:09:27.052 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:15:05.999 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:09:27.056 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:15:06.079 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:09:27.135 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:15:06.090 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:09:27.146 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:15:06.100 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:09:27.136 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:15:06.103 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:09:27.139 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:15:06.107 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:09:27.164 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:15:06.137 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:09:27.194 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:15:06.142 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:09:27.179 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:53.112 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:14:14.169 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:53.130 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:14:14.166 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:53.131 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:14:14.178 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:53.133 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:14:14.190 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:53.136 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:14:14.173 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:53.138 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:14:14.195 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:53.292 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:14:14.348 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:53.310 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:14:14.367 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:53.394 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:14:14.431 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:23:27.429 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:17:48.486 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:23:27.450 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:17:48.507 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:23:27.450 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:17:48.507 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:23:27.475 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:17:48.511 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:23:27.476 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:17:48.513 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:23:27.494 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:17:48.549 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:23:27.552 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:17:48.608 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:23:27.570 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:17:48.606 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:23:27.586 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:17:48.643 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:25:03.781 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:19:24.831 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:25:03.784 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:19:24.836 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:25:03.789 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:19:24.846 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:25:03.794 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:19:24.851 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:25:03.800 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:19:24.836 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:25:03.808 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:19:24.844 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:25:03.871 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:19:24.928 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:25:03.889 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:19:24.946 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:25:03.953 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:19:24.989 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:17.536 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:24:38.593 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:17.549 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:24:38.602 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:17.555 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:24:38.612 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:17.561 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:24:38.618 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:17.563 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:24:38.599 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:17.575 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:24:38.612 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:17.751 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:24:38.808 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:17.785 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:24:38.842 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:17.818 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:24:38.854 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:49.172 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:26:10.229 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:49.215 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:26:10.270 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:49.272 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:26:10.329 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:49.277 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:26:10.334 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:49.282 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:26:10.339 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:49.302 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:26:10.338 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:49.309 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:26:10.345 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:49.342 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:26:10.399 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:49.425 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:26:10.461 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:50.600 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:26:11.657 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:50.601 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:26:11.658 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:50.612 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:26:11.670 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:50.626 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:26:11.663 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:50.628 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:26:11.664 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:50.644 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:26:11.681 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:50.859 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:26:11.916 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:50.860 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:26:11.917 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:50.872 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:26:11.929 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:35:27.763 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:29:48.820 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:35:27.778 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:29:48.829 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:35:27.781 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:29:48.838 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:35:27.789 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:29:48.846 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:35:27.791 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:29:48.827 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:35:27.807 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:29:48.843 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:35:27.925 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:29:48.980 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:35:27.929 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:29:48.984 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:35:27.976 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:29:49.012 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:10.768 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:34:31.825 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:10.799 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:34:31.857 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:10.803 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:34:31.839 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:10.848 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:34:31.905 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:10.851 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:34:31.908 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:10.868 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:34:31.903 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:10.942 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:34:32.000 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:10.983 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:34:32.040 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:11.032 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:34:32.068 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:37.879 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:34:58.936 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:37.884 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:34:58.941 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:37.898 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:34:58.934 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:37.905 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:34:58.941 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:37.920 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:34:58.977 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:37.924 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:34:58.981 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:37.924 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:34:58.982 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:37.945 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:34:58.981 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:40:37.961 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:34:59.018 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:50.824 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:40:11.880 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:50.831 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:40:11.886 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:50.837 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:40:11.894 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:50.844 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:40:11.900 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:50.849 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:40:11.885 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:50.859 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:40:11.894 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:51.017 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:40:12.071 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:51.036 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:40:12.093 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:51.044 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:40:12.079 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:48:32.323 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:42:53.379 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:48:32.350 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:42:53.406 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:48:32.356 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:42:53.413 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:48:32.372 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:42:53.407 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:48:32.373 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:42:53.428 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:48:32.378 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:42:53.411 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:48:32.425 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:42:53.482 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:48:32.462 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:42:53.497 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:48:32.476 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:42:53.532 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:02.380 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:45:23.436 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:02.395 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:45:23.446 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:02.397 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:45:23.431 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:02.397 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:45:23.454 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:02.400 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:45:23.435 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:02.401 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:45:23.458 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:02.479 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:45:23.535 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:02.497 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:45:23.553 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:02.504 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:45:23.537 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:54:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T17:54:10.741 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T17:54:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi146.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T17:54:23.062 INFO:teuthology.orchestra.run.smithi146.stderr: SubjectAltNameWarning, 2019-12-09T17:54:25.653 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-12-09T17:54:25.660 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-12-09T17:54:25.660 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-12-09T17:54:25.660 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-12-09T17:54:25.660 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-12-09T17:54:25.661 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-12-09T17:54:25.661 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-12-09T17:54:26.026 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-12-09T17:54:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-12-09T17:54:26.615 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-12-09T17:54:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-12-09T17:54:26.661 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-12-09T17:54:26.662 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-12-09T17:54:26.662 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-12-09T17:54:26.662 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-12-09T17:54:26.662 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-12-09T17:54:26.662 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-12-09T17:54:26.662 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-12-09T17:54:26.663 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-12-09T17:54:26.663 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-12-09T17:54:26.663 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-12-09T17:54:26.664 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-12-09T17:54:26.667 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-12-09T17:54:26.667 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-12-09T17:54:26.668 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-12-09T17:54:26.668 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_child ... ok 2019-12-09T17:54:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-12-09T17:54:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-12-09T17:54:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-12-09T17:54:26.674 INFO:teuthology.orchestra.run.smithi146.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-12-09T17:54:26.695 INFO:teuthology.orchestra.run.smithi146.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-12-09T17:54:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-12-09T17:54:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-12-09T17:54:26.863 INFO:teuthology.orchestra.run.smithi146.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-12-09T17:54:26.864 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T17:54:26.864 INFO:teuthology.orchestra.run.smithi146.stderr:---------------------------------------------------------------------- 2019-12-09T17:54:26.864 INFO:teuthology.orchestra.run.smithi146.stderr:Ran 611 tests in 16079.339s 2019-12-09T17:54:26.864 INFO:teuthology.orchestra.run.smithi146.stderr: 2019-12-09T17:54:26.864 INFO:teuthology.orchestra.run.smithi146.stderr:OK (SKIP=75) 2019-12-09T17:54:26.911 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2019-12-09T17:54:26.911 INFO:teuthology.orchestra.run.smithi146:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2019-12-09T17:54:27.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-09T17:54:27.036 INFO:tasks.s3tests:Cleaning up boto... 2019-12-09T17:54:27.036 INFO:teuthology.orchestra.run.smithi146:> rm /home/ubuntu/cephtest/boto.cfg 2019-12-09T17:54:27.082 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid bar.client.0 --purge-data --cluster ceph 2019-12-09T17:54:27.194 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.190+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.216 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.212+0000 7efdc1e74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:27.216 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.212+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.220+0000 7efdc1e74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.220+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.228 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.224+0000 7efdc1e74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.224+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.235+0000 7efdc1e74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:27.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.426+0000 7efdc1e74ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T17:54:27.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.426+0000 7efdc1e74ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T17:54:27.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.426+0000 7efdc1e74ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T17:54:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.426+0000 7efdc1e74ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T17:54:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.426+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.434+0000 7efdc1e74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.434+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.444+0000 7efdc1e74ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:54:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.444+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.455 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.451+0000 7efdc1e74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:27.455 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.451+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.468+0000 7efdc1e74ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:54:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.468+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.473+0000 7efdc1e74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:27.477 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.473+0000 7efdc1e74ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T17:54:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.473+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.479+0000 7efdc1e74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:27.483 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.479+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.487+0000 7efdc1e74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.487+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.504+0000 7efdc1e74ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:54:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.504+0000 7efdc1e74ec0 20 zonegroup default 2019-12-09T17:54:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.504+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.508+0000 7efdc1e74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:27.513 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.508+0000 7efdc1e74ec0 10 Cannot find current period zone using local zone 2019-12-09T17:54:27.513 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.508+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.517 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.513+0000 7efdc1e74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:27.518 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.513+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.524 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.520+0000 7efdc1e74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:27.524 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.520+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.528+0000 7efdc1e74ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:54:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.528+0000 7efdc1e74ec0 20 zone default found 2019-12-09T17:54:27.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.528+0000 7efdc1e74ec0 20 started sync module instance, tier type = 2019-12-09T17:54:27.533 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.528+0000 7efdc1e74ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T17:54:27.916 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.900+0000 7efdc1e74ec0 20 add_watcher() i=0 2019-12-09T17:54:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.900+0000 7efdc1e74ec0 20 add_watcher() i=1 2019-12-09T17:54:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.900+0000 7efdc1e74ec0 20 add_watcher() i=2 2019-12-09T17:54:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.900+0000 7efdc1e74ec0 20 add_watcher() i=3 2019-12-09T17:54:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.900+0000 7efdc1e74ec0 20 add_watcher() i=4 2019-12-09T17:54:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.900+0000 7efdc1e74ec0 20 add_watcher() i=5 2019-12-09T17:54:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.900+0000 7efdc1e74ec0 20 add_watcher() i=6 2019-12-09T17:54:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.939+0000 7efdc1e74ec0 20 add_watcher() i=7 2019-12-09T17:54:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.939+0000 7efdc1e74ec0 2 all 8 watchers are set, enabling cache 2019-12-09T17:54:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.940+0000 7efd7ffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T17:54:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:27.945+0000 7efdaf09e700 0 -- 172.21.15.146:0/954615083 >> v2:172.21.15.146:3300/0 conn(0x55a0a99d6b70 msgr2=0x55a0a99dd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T17:54:28.152 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:28.148+0000 7efdaf09e700 0 --2- 172.21.15.146:0/954615083 >> v2:172.21.15.146:3300/0 conn(0x55a0a99d6b70 0x55a0a99dd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-09T17:54:28.195 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:28.191+0000 7efdaf89f700 0 -- 172.21.15.146:0/1731731181 >> [v2:172.21.15.146:6800/9590,v1:172.21.15.146:6801/9590] conn(0x7efcf0022470 msgr2=0x7efcf0024960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T17:54:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.722+0000 7efcee7fc700 20 reqs_thread_entry: start 2019-12-09T17:54:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.722+0000 7efce7fff700 20 reqs_thread_entry: start 2019-12-09T17:54:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.722+0000 7efdc1e74ec0 20 init_complete bucket index max shards: 0 2019-12-09T17:54:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.722+0000 7efce67fc700 20 reqs_thread_entry: start 2019-12-09T17:54:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.723+0000 7efdc1e74ec0 20 get_system_obj_state: rctx=0x7ffd4bd8c308 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55a0a9a5a500 s->prefetch_data=0 2019-12-09T17:54:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.723+0000 7efdc1e74ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-09T17:54:29.739 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.734+0000 7efdc1e74ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-12-09T17:54:29.739 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.734+0000 7efdc1e74ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:54:29.739 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.734+0000 7efdc1e74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T17:54:29.739 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.734+0000 7efdc1e74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T17:54:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.734+0000 7efdc1e74ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T17:54:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.734+0000 7efdc1e74ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:29.769 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.764+0000 7efdc1e74ec0 20 rados_obj.operate() r=0 bl.length=446 2019-12-09T17:54:29.769 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.764+0000 7efdc1e74ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-12-09T17:54:29.769 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.764+0000 7efdc1e74ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:54:29.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.784+0000 7efdc1e74ec0 10 removing key index: CSBXPENAPLMBCWZOZYGA 2019-12-09T17:54:29.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.784+0000 7efdc1e74ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=170 2019-12-09T17:54:29.799 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:29.795+0000 7efd94ff9700 10 RGWWatcher::handle_notify() notify_id 605590389155 cookie 94148528721408 notifier 4703 bl.length()=170 2019-12-09T17:54:30.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.428+0000 7efdc1e74ec0 10 removing email index: bar.client.0+test@test.test 2019-12-09T17:54:30.432 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.428+0000 7efdc1e74ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=178 2019-12-09T17:54:30.446 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.442+0000 7efd94ff9700 10 RGWWatcher::handle_notify() notify_id 605590388786 cookie 94148528697776 notifier 4703 bl.length()=178 2019-12-09T17:54:30.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.627+0000 7efdc1e74ec0 10 removing user buckets index 2019-12-09T17:54:30.631 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.627+0000 7efdc1e74ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=169 2019-12-09T17:54:30.641 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.637+0000 7efd94ff9700 10 RGWWatcher::handle_notify() notify_id 605590389156 cookie 94148528696672 notifier 4703 bl.length()=169 2019-12-09T17:54:30.781 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.773+0000 7efdc1e74ec0 10 removing user index: bar.client.0 2019-12-09T17:54:30.781 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.773+0000 7efdc1e74ec0 10 removing default.rgw.meta+users.uid+bar.client.0 from cache 2019-12-09T17:54:30.781 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.773+0000 7efdc1e74ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=161 2019-12-09T17:54:30.787 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.784+0000 7efd94ff9700 10 RGWWatcher::handle_notify() notify_id 605590388787 cookie 94148528697776 notifier 4703 bl.length()=161 2019-12-09T17:54:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.906+0000 7efdc1e74ec0 20 remove_watcher() i=0 2019-12-09T17:54:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.906+0000 7efdc1e74ec0 2 removed watcher, disabling cache 2019-12-09T17:54:30.969 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:30.965+0000 7efdc1e74ec0 20 remove_watcher() i=1 2019-12-09T17:54:31.026 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.022+0000 7efdc1e74ec0 20 remove_watcher() i=2 2019-12-09T17:54:31.101 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.097+0000 7efdc1e74ec0 20 remove_watcher() i=3 2019-12-09T17:54:31.169 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.164+0000 7efdc1e74ec0 20 remove_watcher() i=4 2019-12-09T17:54:31.225 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.221+0000 7efdc1e74ec0 20 remove_watcher() i=5 2019-12-09T17:54:31.276 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.272+0000 7efdc1e74ec0 20 remove_watcher() i=6 2019-12-09T17:54:31.316 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.312+0000 7efdc1e74ec0 20 remove_watcher() i=7 2019-12-09T17:54:31.325 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2019-12-09T17:54:31.454 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.449+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.480 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.476+0000 7f9a4801eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:31.480 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.476+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.488 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.484+0000 7f9a4801eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:31.488 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.484+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.494 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.490+0000 7f9a4801eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:31.494 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.490+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.526 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.501+0000 7f9a4801eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.683+0000 7f9a4801eec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T17:54:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.683+0000 7f9a4801eec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T17:54:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.683+0000 7f9a4801eec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T17:54:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.683+0000 7f9a4801eec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T17:54:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.683+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.695+0000 7f9a4801eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.695+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.711 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.707+0000 7f9a4801eec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:54:31.711 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.707+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.722 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.718+0000 7f9a4801eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:31.722 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.718+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.742 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.737+0000 7f9a4801eec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:54:31.742 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.738+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.747 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.743+0000 7f9a4801eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:31.748 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.743+0000 7f9a4801eec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T17:54:31.748 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.743+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.754 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.749+0000 7f9a4801eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:31.754 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.749+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.757+0000 7f9a4801eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:31.761 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.757+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.777+0000 7f9a4801eec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:54:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.777+0000 7f9a4801eec0 20 zonegroup default 2019-12-09T17:54:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.777+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.788 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.784+0000 7f9a4801eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:31.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.784+0000 7f9a4801eec0 10 Cannot find current period zone using local zone 2019-12-09T17:54:31.789 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.784+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.794 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.790+0000 7f9a4801eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.790+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.802+0000 7f9a4801eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.802+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.814+0000 7f9a4801eec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:54:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.814+0000 7f9a4801eec0 20 zone default found 2019-12-09T17:54:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.814+0000 7f9a4801eec0 20 started sync module instance, tier type = 2019-12-09T17:54:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:31.814+0000 7f9a4801eec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T17:54:32.414 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:32.409+0000 7f9a4801eec0 20 add_watcher() i=0 2019-12-09T17:54:32.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:32.409+0000 7f9a4801eec0 20 add_watcher() i=1 2019-12-09T17:54:32.497 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:32.409+0000 7f9a4801eec0 20 add_watcher() i=2 2019-12-09T17:54:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:32.409+0000 7f9a4801eec0 20 add_watcher() i=3 2019-12-09T17:54:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:32.409+0000 7f9a4801eec0 20 add_watcher() i=4 2019-12-09T17:54:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:32.409+0000 7f9a4801eec0 20 add_watcher() i=5 2019-12-09T17:54:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:32.409+0000 7f9a4801eec0 20 add_watcher() i=6 2019-12-09T17:54:32.499 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:32.446+0000 7f9a4801eec0 20 add_watcher() i=7 2019-12-09T17:54:32.499 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:32.446+0000 7f9a4801eec0 2 all 8 watchers are set, enabling cache 2019-12-09T17:54:32.499 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:32.446+0000 7f9a05fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T17:54:32.499 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:32.449+0000 7f9a34a47700 0 -- 172.21.15.146:0/4250869411 >> v2:172.21.15.194:3300/0 conn(0x55589fe08c60 msgr2=0x55589fe0b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T17:54:32.499 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:32.477+0000 7f9a34a47700 0 -- 172.21.15.146:0/4000383113 >> v2:172.21.15.194:3300/0 conn(0x55589fe0ca00 msgr2=0x55589fe0ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T17:54:34.001 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:33.997+0000 7f9977fff700 20 reqs_thread_entry: start 2019-12-09T17:54:34.002 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:33.997+0000 7f9975ffb700 20 reqs_thread_entry: start 2019-12-09T17:54:34.002 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:33.997+0000 7f9a4801eec0 20 init_complete bucket index max shards: 0 2019-12-09T17:54:34.002 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:33.998+0000 7f9963fff700 20 reqs_thread_entry: start 2019-12-09T17:54:34.003 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:33.998+0000 7f9a4801eec0 20 get_system_obj_state: rctx=0x7fff2058e7f8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x55589fe84530 s->prefetch_data=0 2019-12-09T17:54:34.003 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:33.998+0000 7f9a4801eec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-09T17:54:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.018+0000 7f9a4801eec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-12-09T17:54:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.018+0000 7f9a4801eec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:54:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.018+0000 7f9a4801eec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T17:54:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.018+0000 7f9a4801eec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T17:54:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.018+0000 7f9a4801eec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T17:54:34.023 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.018+0000 7f9a4801eec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:34.042 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.038+0000 7f9a4801eec0 20 rados_obj.operate() r=0 bl.length=446 2019-12-09T17:54:34.043 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.038+0000 7f9a4801eec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-12-09T17:54:34.043 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.038+0000 7f9a4801eec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:54:34.087 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.082+0000 7f9a4801eec0 10 removing key index: MEMTKIBLATUWGMORCWSW 2019-12-09T17:54:34.087 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.082+0000 7f9a4801eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=170 2019-12-09T17:54:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.097+0000 7f9a167fc700 10 RGWWatcher::handle_notify() notify_id 605590388788 cookie 93839127650848 notifier 4712 bl.length()=170 2019-12-09T17:54:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.415+0000 7f9a4801eec0 10 removing email index: foo.client.0+test@test.test 2019-12-09T17:54:34.419 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.415+0000 7f9a4801eec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=178 2019-12-09T17:54:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:34.429+0000 7f9a167fc700 10 RGWWatcher::handle_notify() notify_id 605590388899 cookie 93839127672608 notifier 4712 bl.length()=178 2019-12-09T17:54:35.020 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:35.016+0000 7f9a4801eec0 10 removing user buckets index 2019-12-09T17:54:35.020 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:35.016+0000 7f9a4801eec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=169 2019-12-09T17:54:35.034 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:35.030+0000 7f9a167fc700 10 RGWWatcher::handle_notify() notify_id 605590388789 cookie 93839127650848 notifier 4712 bl.length()=169 2019-12-09T17:54:35.379 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:35.375+0000 7f9a4801eec0 10 removing user index: foo.client.0 2019-12-09T17:54:35.379 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:35.375+0000 7f9a4801eec0 10 removing default.rgw.meta+users.uid+foo.client.0 from cache 2019-12-09T17:54:35.379 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:35.375+0000 7f9a4801eec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=161 2019-12-09T17:54:35.398 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:35.394+0000 7f9a167fc700 10 RGWWatcher::handle_notify() notify_id 605590389277 cookie 93839127648768 notifier 4712 bl.length()=161 2019-12-09T17:54:36.003 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:35.999+0000 7f9a4801eec0 20 remove_watcher() i=0 2019-12-09T17:54:36.003 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:35.999+0000 7f9a4801eec0 2 removed watcher, disabling cache 2019-12-09T17:54:36.046 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.042+0000 7f9a4801eec0 20 remove_watcher() i=1 2019-12-09T17:54:36.078 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.074+0000 7f9a4801eec0 20 remove_watcher() i=2 2019-12-09T17:54:36.137 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.133+0000 7f9a4801eec0 20 remove_watcher() i=3 2019-12-09T17:54:36.202 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.197+0000 7f9a4801eec0 20 remove_watcher() i=4 2019-12-09T17:54:36.256 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.252+0000 7f9a4801eec0 20 remove_watcher() i=5 2019-12-09T17:54:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.305+0000 7f9a4801eec0 20 remove_watcher() i=6 2019-12-09T17:54:36.365 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.361+0000 7f9a4801eec0 20 remove_watcher() i=7 2019-12-09T17:54:36.373 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid 'testx$tenanteduser.client.0' --purge-data --cluster ceph 2019-12-09T17:54:36.485 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.481+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.506 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.502+0000 7f22bbf60ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:36.506 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.502+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.514 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.511+0000 7f22bbf60ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:36.515 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.511+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.515+0000 7f22bbf60ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.515+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.528 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.523+0000 7f22bbf60ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.703+0000 7f22bbf60ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T17:54:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.703+0000 7f22bbf60ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T17:54:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.703+0000 7f22bbf60ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T17:54:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.703+0000 7f22bbf60ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T17:54:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.703+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.718 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.714+0000 7f22bbf60ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:36.718 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.714+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.729 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.725+0000 7f22bbf60ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:54:36.729 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.725+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.739 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.735+0000 7f22bbf60ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:36.778 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.735+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.779 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.754+0000 7f22bbf60ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:54:36.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.754+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.758+0000 7f22bbf60ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:36.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.758+0000 7f22bbf60ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T17:54:36.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.758+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.763+0000 7f22bbf60ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:36.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.763+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.781 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.772+0000 7f22bbf60ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:36.781 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.772+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.788+0000 7f22bbf60ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:54:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.788+0000 7f22bbf60ec0 20 zonegroup default 2019-12-09T17:54:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.788+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.800 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.796+0000 7f22bbf60ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:36.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.796+0000 7f22bbf60ec0 10 Cannot find current period zone using local zone 2019-12-09T17:54:36.801 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.796+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.805 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.801+0000 7f22bbf60ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:36.806 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.801+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.809+0000 7f22bbf60ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:36.813 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.809+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.820+0000 7f22bbf60ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:54:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.820+0000 7f22bbf60ec0 20 zone default found 2019-12-09T17:54:36.828 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.820+0000 7f22bbf60ec0 20 started sync module instance, tier type = 2019-12-09T17:54:36.828 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:36.820+0000 7f22bbf60ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T17:54:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:37.215+0000 7f22bbf60ec0 20 add_watcher() i=0 2019-12-09T17:54:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:37.215+0000 7f22bbf60ec0 20 add_watcher() i=1 2019-12-09T17:54:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:37.215+0000 7f22bbf60ec0 20 add_watcher() i=2 2019-12-09T17:54:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:37.215+0000 7f22bbf60ec0 20 add_watcher() i=3 2019-12-09T17:54:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:37.215+0000 7f22bbf60ec0 20 add_watcher() i=4 2019-12-09T17:54:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:37.215+0000 7f22bbf60ec0 20 add_watcher() i=5 2019-12-09T17:54:37.245 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:37.241+0000 7f22bbf60ec0 20 add_watcher() i=6 2019-12-09T17:54:37.254 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:37.249+0000 7f22bbf60ec0 20 add_watcher() i=7 2019-12-09T17:54:37.254 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:37.249+0000 7f22bbf60ec0 2 all 8 watchers are set, enabling cache 2019-12-09T17:54:37.254 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:37.250+0000 7f2279fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T17:54:37.257 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:37.253+0000 7f22a998b700 0 -- 172.21.15.146:0/3057865217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x560be481c580 msgr2=0x560be481c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T17:54:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:37.314+0000 7f22a3fff700 0 -- 172.21.15.146:0/4169974487 >> [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] conn(0x560be4835db0 msgr2=0x560be48381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T17:54:38.886 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.881+0000 7f21ebfff700 20 reqs_thread_entry: start 2019-12-09T17:54:38.886 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.881+0000 7f21e9ffb700 20 reqs_thread_entry: start 2019-12-09T17:54:38.887 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.881+0000 7f22bbf60ec0 20 init_complete bucket index max shards: 0 2019-12-09T17:54:38.887 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.882+0000 7f21d7fff700 20 reqs_thread_entry: start 2019-12-09T17:54:38.887 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.882+0000 7f22bbf60ec0 20 get_system_obj_state: rctx=0x7ffe5c47a808 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x560be48a28c0 s->prefetch_data=0 2019-12-09T17:54:38.887 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.882+0000 7f22bbf60ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-12-09T17:54:38.897 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.893+0000 7f22bbf60ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-12-09T17:54:38.898 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.893+0000 7f22bbf60ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T17:54:38.898 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.893+0000 7f22bbf60ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T17:54:38.898 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.893+0000 7f22bbf60ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T17:54:38.898 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.893+0000 7f22bbf60ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T17:54:38.898 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.893+0000 7f22bbf60ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:38.915 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.911+0000 7f22bbf60ec0 20 rados_obj.operate() r=0 bl.length=505 2019-12-09T17:54:38.915 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.911+0000 7f22bbf60ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-12-09T17:54:38.915 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.911+0000 7f22bbf60ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T17:54:38.927 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.923+0000 7f22bbf60ec0 10 removing key index: LIMOZFEXHGALFWUJAXEK 2019-12-09T17:54:38.928 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.923+0000 7f22bbf60ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=170 2019-12-09T17:54:38.947 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:38.943+0000 7f228a7fc700 10 RGWWatcher::handle_notify() notify_id 605590389278 cookie 94609078245920 notifier 4718 bl.length()=170 2019-12-09T17:54:39.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:39.424+0000 7f22bbf60ec0 10 removing email index: testx$tenanteduser.client.0+test@test.test 2019-12-09T17:54:39.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:39.424+0000 7f22bbf60ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=193 2019-12-09T17:54:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:39.442+0000 7f228a7fc700 10 RGWWatcher::handle_notify() notify_id 605590388900 cookie 94609078287984 notifier 4718 bl.length()=193 2019-12-09T17:54:40.226 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:40.222+0000 7f22bbf60ec0 10 removing user buckets index 2019-12-09T17:54:40.227 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:40.222+0000 7f22bbf60ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=184 2019-12-09T17:54:40.249 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:40.245+0000 7f228a7fc700 10 RGWWatcher::handle_notify() notify_id 605590388901 cookie 94609078287248 notifier 4718 bl.length()=184 2019-12-09T17:54:40.516 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:40.512+0000 7f22bbf60ec0 10 removing user index: testx$tenanteduser.client.0 2019-12-09T17:54:40.516 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:40.512+0000 7f22bbf60ec0 10 removing default.rgw.meta+users.uid+testx$tenanteduser.client.0 from cache 2019-12-09T17:54:40.516 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:40.512+0000 7f22bbf60ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=176 2019-12-09T17:54:40.527 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:40.522+0000 7f228a7fc700 10 RGWWatcher::handle_notify() notify_id 605590389157 cookie 94609078271648 notifier 4718 bl.length()=176 2019-12-09T17:54:41.003 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:40.999+0000 7f22bbf60ec0 20 remove_watcher() i=0 2019-12-09T17:54:41.003 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:40.999+0000 7f22bbf60ec0 2 removed watcher, disabling cache 2019-12-09T17:54:41.044 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:41.040+0000 7f22bbf60ec0 20 remove_watcher() i=1 2019-12-09T17:54:41.086 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:41.082+0000 7f22bbf60ec0 20 remove_watcher() i=2 2019-12-09T17:54:41.161 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:41.156+0000 7f22bbf60ec0 20 remove_watcher() i=3 2019-12-09T17:54:41.215 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:41.211+0000 7f22bbf60ec0 20 remove_watcher() i=4 2019-12-09T17:54:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:41.258+0000 7f22bbf60ec0 20 remove_watcher() i=5 2019-12-09T17:54:41.311 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:41.307+0000 7f22bbf60ec0 20 remove_watcher() i=6 2019-12-09T17:54:41.365 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:41.360+0000 7f22bbf60ec0 20 remove_watcher() i=7 2019-12-09T17:54:41.373 INFO:tasks.s3tests:Removing s3-tests... 2019-12-09T17:54:41.373 INFO:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/s3-tests 2019-12-09T17:54:41.495 INFO:teuthology.run_tasks:Running task swift... 2019-12-09T17:54:41.509 INFO:tasks.swift:clients=['client.0'] 2019-12-09T17:54:41.509 INFO:tasks.swift:Downloading swift... 2019-12-09T17:54:41.509 INFO:teuthology.orchestra.run.smithi146:> git clone -b ceph-master git://git.ceph.com/git/swift.git /home/ubuntu/cephtest/swift 2019-12-09T17:54:41.635 INFO:teuthology.orchestra.run.smithi146.stdout:Cloning into '/home/ubuntu/cephtest/swift'... 2019-12-09T17:54:42.003 INFO:tasks.swift:Creating rgw users... 2019-12-09T17:54:42.004 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser foo.client.0:foo --display-name 'Mr. foo.client.0 foo' --secret x+g4VygG6I2p2H+EGyQkzss441Bqid9wroQhrHBe9tuMr9akPR41Xg== --email foo.client.0+test@test.test --key-type swift --access full 2019-12-09T17:54:42.133 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.129+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.157 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.153+0000 7fe5c8f86ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:42.158 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.153+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.166 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.163+0000 7fe5c8f86ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:42.167 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.163+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.174 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.170+0000 7fe5c8f86ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:42.174 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.170+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.189 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.178+0000 7fe5c8f86ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.352+0000 7fe5c8f86ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T17:54:42.357 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.352+0000 7fe5c8f86ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T17:54:42.357 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.352+0000 7fe5c8f86ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T17:54:42.357 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.352+0000 7fe5c8f86ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T17:54:42.357 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.352+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.364 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.360+0000 7fe5c8f86ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:42.364 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.360+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.374 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.370+0000 7fe5c8f86ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:54:42.375 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.370+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.382 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.378+0000 7fe5c8f86ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:42.383 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.378+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.393 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.388+0000 7fe5c8f86ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:54:42.393 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.388+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.398 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.394+0000 7fe5c8f86ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:42.398 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.394+0000 7fe5c8f86ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T17:54:42.398 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.394+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.403 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.399+0000 7fe5c8f86ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:42.403 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.399+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.413 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.409+0000 7fe5c8f86ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:42.414 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.409+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.429 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.425+0000 7fe5c8f86ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:54:42.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.425+0000 7fe5c8f86ec0 20 zonegroup default 2019-12-09T17:54:42.430 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.425+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.434 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.430+0000 7fe5c8f86ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:42.434 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.430+0000 7fe5c8f86ec0 10 Cannot find current period zone using local zone 2019-12-09T17:54:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.430+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.450 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.434+0000 7fe5c8f86ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:42.450 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.434+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.450 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.443+0000 7fe5c8f86ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:42.450 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.443+0000 7fe5c8f86ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:42.459 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.454+0000 7fe5c8f86ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:54:42.460 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.455+0000 7fe5c8f86ec0 20 zone default found 2019-12-09T17:54:42.460 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.455+0000 7fe5c8f86ec0 20 started sync module instance, tier type = 2019-12-09T17:54:42.460 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.455+0000 7fe5c8f86ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T17:54:42.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.841+0000 7fe5c8f86ec0 20 add_watcher() i=0 2019-12-09T17:54:42.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.841+0000 7fe5c8f86ec0 20 add_watcher() i=1 2019-12-09T17:54:42.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.841+0000 7fe5c8f86ec0 20 add_watcher() i=2 2019-12-09T17:54:42.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.841+0000 7fe5c8f86ec0 20 add_watcher() i=3 2019-12-09T17:54:42.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.841+0000 7fe5c8f86ec0 20 add_watcher() i=4 2019-12-09T17:54:42.846 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.841+0000 7fe5c8f86ec0 20 add_watcher() i=5 2019-12-09T17:54:42.873 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.869+0000 7fe5c8f86ec0 20 add_watcher() i=6 2019-12-09T17:54:42.880 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.876+0000 7fe5c8f86ec0 20 add_watcher() i=7 2019-12-09T17:54:42.880 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.876+0000 7fe5c8f86ec0 2 all 8 watchers are set, enabling cache 2019-12-09T17:54:42.880 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.876+0000 7fe586fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T17:54:42.893 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.889+0000 7fe5b61b0700 0 -- 172.21.15.146:0/2937129059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d684160a0 msgr2=0x555d684184c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T17:54:42.914 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:42.910+0000 7fe5b61b0700 0 -- 172.21.15.146:0/1492341404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d68419b80 msgr2=0x555d6841e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T17:54:44.190 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.186+0000 7fe4f57fa700 20 reqs_thread_entry: start 2019-12-09T17:54:44.190 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.186+0000 7fe4eeffd700 20 reqs_thread_entry: start 2019-12-09T17:54:44.190 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.186+0000 7fe5c8f86ec0 20 init_complete bucket index max shards: 0 2019-12-09T17:54:44.191 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.186+0000 7fe4ed7fa700 20 reqs_thread_entry: start 2019-12-09T17:54:44.191 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.186+0000 7fe5c8f86ec0 20 get_system_obj_state: rctx=0x7ffc78610cc8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x555d68497be0 s->prefetch_data=0 2019-12-09T17:54:44.191 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.187+0000 7fe5c8f86ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-09T17:54:44.198 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.194+0000 7fe5c8f86ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-12-09T17:54:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.194+0000 7fe5c8f86ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:54:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.194+0000 7fe5c8f86ec0 20 get_system_obj_state: rctx=0x7ffc78610cd8 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x555d68499970 s->prefetch_data=0 2019-12-09T17:54:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.194+0000 7fe5c8f86ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-12-09T17:54:44.204 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.199+0000 7fe5c8f86ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-12-09T17:54:44.204 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.199+0000 7fe5c8f86ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-09T17:54:44.204 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.199+0000 7fe5c8f86ec0 20 get_system_obj_state: rctx=0x7ffc786108e8 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x555d68499970 s->prefetch_data=0 2019-12-09T17:54:44.205 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.199+0000 7fe5c8f86ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : miss 2019-12-09T17:54:44.216 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.211+0000 7fe5c8f86ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-12-09T17:54:44.217 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.211+0000 7fe5c8f86ec0 10 adding default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-09T17:54:44.217 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.211+0000 7fe5c8f86ec0 20 get_system_obj_state: rctx=0x7ffc78610a68 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x555d68499c20 s->prefetch_data=0 2019-12-09T17:54:44.217 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.211+0000 7fe5c8f86ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : type miss (requested=0x6, cached=0x0) 2019-12-09T17:54:44.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.219+0000 7fe5c8f86ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-12-09T17:54:44.223 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.219+0000 7fe5c8f86ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-09T17:54:44.262 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.257+0000 7fe5c8f86ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T17:54:44.262 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.257+0000 7fe5c8f86ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:54:44.262 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.257+0000 7fe5c8f86ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=612 2019-12-09T17:54:44.269 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.265+0000 7fe5977fe700 10 RGWWatcher::handle_notify() notify_id 605590389279 cookie 93859669327648 notifier 4727 bl.length()=612 2019-12-09T17:54:44.269 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.265+0000 7fe5977fe700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T17:54:44.269 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.265+0000 7fe5977fe700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:54:44.535 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.530+0000 7fe5c8f86ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-09T17:54:44.535 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.530+0000 7fe5c8f86ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-09T17:54:44.535 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.530+0000 7fe5c8f86ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-12-09T17:54:44.550 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.546+0000 7fe5977fe700 10 RGWWatcher::handle_notify() notify_id 605590388902 cookie 93859669355680 notifier 4727 bl.length()=194 2019-12-09T17:54:44.550 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.546+0000 7fe5977fe700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-09T17:54:44.551 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:44.546+0000 7fe5977fe700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-09T17:54:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.110+0000 7fe5c8f86ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-12-09T17:54:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.110+0000 7fe5c8f86ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-09T17:54:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.110+0000 7fe5c8f86ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=183 2019-12-09T17:54:45.134 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.129+0000 7fe5977fe700 10 RGWWatcher::handle_notify() notify_id 605590388790 cookie 93859669331024 notifier 4727 bl.length()=183 2019-12-09T17:54:45.135 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.129+0000 7fe5977fe700 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-12-09T17:54:45.135 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.129+0000 7fe5977fe700 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-09T17:54:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.369+0000 7fe5c8f86ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T17:54:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.369+0000 7fe5c8f86ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:54:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.369+0000 7fe5c8f86ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=636 2019-12-09T17:54:45.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.390+0000 7fe5977fe700 10 RGWWatcher::handle_notify() notify_id 605590389280 cookie 93859669327648 notifier 4727 bl.length()=636 2019-12-09T17:54:45.400 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.390+0000 7fe5977fe700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T17:54:45.401 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.390+0000 7fe5977fe700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:54:45.478 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2019-12-09T17:54:45.478 INFO:teuthology.orchestra.run.smithi146.stdout: "user_id": "foo.client.0", 2019-12-09T17:54:45.478 INFO:teuthology.orchestra.run.smithi146.stdout: "display_name": "Mr. foo.client.0 foo", 2019-12-09T17:54:45.479 INFO:teuthology.orchestra.run.smithi146.stdout: "email": "foo.client.0+test@test.test", 2019-12-09T17:54:45.479 INFO:teuthology.orchestra.run.smithi146.stdout: "suspended": 0, 2019-12-09T17:54:45.479 INFO:teuthology.orchestra.run.smithi146.stdout: "max_buckets": 1000, 2019-12-09T17:54:45.479 INFO:teuthology.orchestra.run.smithi146.stdout: "subusers": [ 2019-12-09T17:54:45.479 INFO:teuthology.orchestra.run.smithi146.stdout: { 2019-12-09T17:54:45.479 INFO:teuthology.orchestra.run.smithi146.stdout: "id": "foo.client.0:foo", 2019-12-09T17:54:45.479 INFO:teuthology.orchestra.run.smithi146.stdout: "permissions": "full-control" 2019-12-09T17:54:45.480 INFO:teuthology.orchestra.run.smithi146.stdout: } 2019-12-09T17:54:45.480 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2019-12-09T17:54:45.480 INFO:teuthology.orchestra.run.smithi146.stdout: "keys": [], 2019-12-09T17:54:45.480 INFO:teuthology.orchestra.run.smithi146.stdout: "swift_keys": [ 2019-12-09T17:54:45.480 INFO:teuthology.orchestra.run.smithi146.stdout: { 2019-12-09T17:54:45.480 INFO:teuthology.orchestra.run.smithi146.stdout: "user": "foo.client.0:foo", 2019-12-09T17:54:45.480 INFO:teuthology.orchestra.run.smithi146.stdout: "secret_key": "x+g4VygG6I2p2H+EGyQkzss441Bqid9wroQhrHBe9tuMr9akPR41Xg==" 2019-12-09T17:54:45.481 INFO:teuthology.orchestra.run.smithi146.stdout: } 2019-12-09T17:54:45.481 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2019-12-09T17:54:45.481 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": [], 2019-12-09T17:54:45.481 INFO:teuthology.orchestra.run.smithi146.stdout: "op_mask": "read, write, delete", 2019-12-09T17:54:45.481 INFO:teuthology.orchestra.run.smithi146.stdout: "default_placement": "", 2019-12-09T17:54:45.481 INFO:teuthology.orchestra.run.smithi146.stdout: "default_storage_class": "", 2019-12-09T17:54:45.481 INFO:teuthology.orchestra.run.smithi146.stdout: "placement_tags": [], 2019-12-09T17:54:45.481 INFO:teuthology.orchestra.run.smithi146.stdout: "bucket_quota": { 2019-12-09T17:54:45.482 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T17:54:45.482 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T17:54:45.482 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T17:54:45.482 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T17:54:45.482 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T17:54:45.482 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T17:54:45.482 INFO:teuthology.orchestra.run.smithi146.stdout: "user_quota": { 2019-12-09T17:54:45.482 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T17:54:45.483 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T17:54:45.484 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T17:54:45.485 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T17:54:45.485 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T17:54:45.485 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T17:54:45.485 INFO:teuthology.orchestra.run.smithi146.stdout: "temp_url_keys": [], 2019-12-09T17:54:45.485 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "rgw", 2019-12-09T17:54:45.485 INFO:teuthology.orchestra.run.smithi146.stdout: "mfa_ids": [] 2019-12-09T17:54:45.485 INFO:teuthology.orchestra.run.smithi146.stdout:} 2019-12-09T17:54:45.486 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T17:54:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.508+0000 7fe5c8f86ec0 20 remove_watcher() i=0 2019-12-09T17:54:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.508+0000 7fe5c8f86ec0 2 removed watcher, disabling cache 2019-12-09T17:54:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.550+0000 7fe5c8f86ec0 20 remove_watcher() i=1 2019-12-09T17:54:45.596 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.592+0000 7fe5c8f86ec0 20 remove_watcher() i=2 2019-12-09T17:54:45.661 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.657+0000 7fe5c8f86ec0 20 remove_watcher() i=3 2019-12-09T17:54:45.720 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.716+0000 7fe5c8f86ec0 20 remove_watcher() i=4 2019-12-09T17:54:45.774 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.770+0000 7fe5c8f86ec0 20 remove_watcher() i=5 2019-12-09T17:54:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.850+0000 7fe5c8f86ec0 20 remove_watcher() i=6 2019-12-09T17:54:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:45.896+0000 7fe5c8f86ec0 20 remove_watcher() i=7 2019-12-09T17:54:45.908 INFO:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser bar.client.0:bar --display-name 'Mr. bar.client.0 bar' --secret MrFiiUKgRBWcuPpwfmMgrciNoc5zYlNk0QamslHH6SNliei7EGs3kg== --email bar.client.0+test@test.test --key-type swift --access full 2019-12-09T17:54:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.032+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.056+0000 7ff034426ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.056+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.065+0000 7ff034426ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.065+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.070+0000 7ff034426ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:46.074 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.070+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.083 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.078+0000 7ff034426ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.287+0000 7ff034426ec0 20 RGWRados::pool_iterate: got zonegroup_info.8c3bafdb-3944-481a-a1d2-b691c5c4a866 2019-12-09T17:54:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.287+0000 7ff034426ec0 20 RGWRados::pool_iterate: got zone_info.eaaaea16-3e32-4d4e-94b4-60e1a08a3965 2019-12-09T17:54:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.287+0000 7ff034426ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T17:54:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.287+0000 7ff034426ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T17:54:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.287+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.303 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.299+0000 7ff034426ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:46.303 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.299+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.312 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.308+0000 7ff034426ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:54:46.312 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.308+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.324 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.319+0000 7ff034426ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:46.324 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.319+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.344 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.340+0000 7ff034426ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:54:46.345 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.340+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.346+0000 7ff034426ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.346+0000 7ff034426ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T17:54:46.350 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.346+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.355 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.351+0000 7ff034426ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:46.355 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.351+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.368 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.364+0000 7ff034426ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:46.368 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.364+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.380+0000 7ff034426ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:54:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.380+0000 7ff034426ec0 20 zonegroup default 2019-12-09T17:54:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.380+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.392 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.388+0000 7ff034426ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:46.392 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.388+0000 7ff034426ec0 10 Cannot find current period zone using local zone 2019-12-09T17:54:46.392 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.388+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.399 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.394+0000 7ff034426ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:54:46.399 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.394+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.411 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.407+0000 7ff034426ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:54:46.411 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.407+0000 7ff034426ec0 20 rados->read ofs=0 len=0 2019-12-09T17:54:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.414+0000 7ff034426ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:54:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.414+0000 7ff034426ec0 20 zone default found 2019-12-09T17:54:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.414+0000 7ff034426ec0 20 started sync module instance, tier type = 2019-12-09T17:54:46.419 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.414+0000 7ff034426ec0 20 started zone id=eaaaea16-3e32-4d4e-94b4-60e1a08a3965 (name=default) with tier type = 2019-12-09T17:54:46.822 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.817+0000 7ff021650700 0 -- 172.21.15.146:0/2389545783 >> [v2:172.21.15.194:6824/10135,v1:172.21.15.194:6825/10135] conn(0x557b6bde9bd0 msgr2=0x557b6bdebff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T17:54:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.863+0000 7ff034426ec0 20 add_watcher() i=0 2019-12-09T17:54:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.863+0000 7ff034426ec0 20 add_watcher() i=1 2019-12-09T17:54:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.863+0000 7ff034426ec0 20 add_watcher() i=2 2019-12-09T17:54:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.863+0000 7ff034426ec0 20 add_watcher() i=3 2019-12-09T17:54:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.863+0000 7ff034426ec0 20 add_watcher() i=4 2019-12-09T17:54:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.863+0000 7ff034426ec0 20 add_watcher() i=5 2019-12-09T17:54:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.863+0000 7ff034426ec0 20 add_watcher() i=6 2019-12-09T17:54:46.918 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.913+0000 7ff034426ec0 20 add_watcher() i=7 2019-12-09T17:54:46.918 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.913+0000 7ff034426ec0 2 all 8 watchers are set, enabling cache 2019-12-09T17:54:46.918 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.914+0000 7feff1fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T17:54:46.947 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:46.940+0000 7ff020e4f700 0 -- 172.21.15.146:0/1732343369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557b6be0aa90 msgr2=0x557b6be0ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T17:54:48.522 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.518+0000 7fef63fff700 20 reqs_thread_entry: start 2019-12-09T17:54:48.523 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.518+0000 7fef61ffb700 20 reqs_thread_entry: start 2019-12-09T17:54:48.523 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.518+0000 7ff034426ec0 20 init_complete bucket index max shards: 0 2019-12-09T17:54:48.523 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.519+0000 7fef4ffff700 20 reqs_thread_entry: start 2019-12-09T17:54:48.524 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.519+0000 7ff034426ec0 20 get_system_obj_state: rctx=0x7ffc090c7988 obj=default.rgw.meta:users.uid:bar.client.0 state=0x557b6be824d0 s->prefetch_data=0 2019-12-09T17:54:48.524 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.519+0000 7ff034426ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-09T17:54:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.530+0000 7ff034426ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-12-09T17:54:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.530+0000 7ff034426ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:54:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.530+0000 7ff034426ec0 20 get_system_obj_state: rctx=0x7ffc090c7998 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x557b6be84260 s->prefetch_data=0 2019-12-09T17:54:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.530+0000 7ff034426ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-12-09T17:54:48.555 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.551+0000 7ff034426ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-12-09T17:54:48.556 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.551+0000 7ff034426ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-09T17:54:48.556 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.551+0000 7ff034426ec0 20 get_system_obj_state: rctx=0x7ffc090c75a8 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x557b6be84260 s->prefetch_data=0 2019-12-09T17:54:48.556 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.551+0000 7ff034426ec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : miss 2019-12-09T17:54:48.562 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.558+0000 7ff034426ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-12-09T17:54:48.563 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.558+0000 7ff034426ec0 10 adding default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-09T17:54:48.563 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.558+0000 7ff034426ec0 20 get_system_obj_state: rctx=0x7ffc090c7728 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x557b6be84510 s->prefetch_data=0 2019-12-09T17:54:48.563 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.558+0000 7ff034426ec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : type miss (requested=0x6, cached=0x0) 2019-12-09T17:54:48.567 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.563+0000 7ff034426ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-12-09T17:54:48.568 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.563+0000 7ff034426ec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-09T17:54:48.634 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.629+0000 7ff034426ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T17:54:48.659 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.629+0000 7ff034426ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:54:48.659 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.629+0000 7ff034426ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=612 2019-12-09T17:54:48.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.638+0000 7ff0027fc700 10 RGWWatcher::handle_notify() notify_id 605590388791 cookie 93988579060576 notifier 4739 bl.length()=612 2019-12-09T17:54:48.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.638+0000 7ff0027fc700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T17:54:48.660 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:48.638+0000 7ff0027fc700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:54:49.367 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:49.363+0000 7ff034426ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-09T17:54:49.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:49.363+0000 7ff034426ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-09T17:54:49.394 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:49.363+0000 7ff034426ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-12-09T17:54:49.395 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:49.376+0000 7ff0027fc700 10 RGWWatcher::handle_notify() notify_id 605590388792 cookie 93988579060576 notifier 4739 bl.length()=194 2019-12-09T17:54:49.395 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:49.376+0000 7ff0027fc700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-09T17:54:49.395 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:49.376+0000 7ff0027fc700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-09T17:54:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:49.763+0000 7ff034426ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-12-09T17:54:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:49.763+0000 7ff034426ec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-09T17:54:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:49.763+0000 7ff034426ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=183 2019-12-09T17:54:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:49.774+0000 7ff0027fc700 10 RGWWatcher::handle_notify() notify_id 605590389158 cookie 93988579066656 notifier 4739 bl.length()=183 2019-12-09T17:54:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:49.774+0000 7ff0027fc700 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-12-09T17:54:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:49.774+0000 7ff0027fc700 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-09T17:54:50.544 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.539+0000 7ff034426ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T17:54:50.544 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.539+0000 7ff034426ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:54:50.545 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.539+0000 7ff034426ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=636 2019-12-09T17:54:50.551 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.548+0000 7ff0027fc700 10 RGWWatcher::handle_notify() notify_id 605590388793 cookie 93988579060576 notifier 4739 bl.length()=636 2019-12-09T17:54:50.552 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.548+0000 7ff0027fc700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T17:54:50.552 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.548+0000 7ff0027fc700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:54:50.681 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2019-12-09T17:54:50.683 INFO:teuthology.orchestra.run.smithi146.stdout: "user_id": "bar.client.0", 2019-12-09T17:54:50.683 INFO:teuthology.orchestra.run.smithi146.stdout: "display_name": "Mr. bar.client.0 bar", 2019-12-09T17:54:50.683 INFO:teuthology.orchestra.run.smithi146.stdout: "email": "bar.client.0+test@test.test", 2019-12-09T17:54:50.684 INFO:teuthology.orchestra.run.smithi146.stdout: "suspended": 0, 2019-12-09T17:54:50.684 INFO:teuthology.orchestra.run.smithi146.stdout: "max_buckets": 1000, 2019-12-09T17:54:50.684 INFO:teuthology.orchestra.run.smithi146.stdout: "subusers": [ 2019-12-09T17:54:50.684 INFO:teuthology.orchestra.run.smithi146.stdout: { 2019-12-09T17:54:50.684 INFO:teuthology.orchestra.run.smithi146.stdout: "id": "bar.client.0:bar", 2019-12-09T17:54:50.684 INFO:teuthology.orchestra.run.smithi146.stdout: "permissions": "full-control" 2019-12-09T17:54:50.684 INFO:teuthology.orchestra.run.smithi146.stdout: } 2019-12-09T17:54:50.685 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2019-12-09T17:54:50.685 INFO:teuthology.orchestra.run.smithi146.stdout: "keys": [], 2019-12-09T17:54:50.685 INFO:teuthology.orchestra.run.smithi146.stdout: "swift_keys": [ 2019-12-09T17:54:50.685 INFO:teuthology.orchestra.run.smithi146.stdout: { 2019-12-09T17:54:50.685 INFO:teuthology.orchestra.run.smithi146.stdout: "user": "bar.client.0:bar", 2019-12-09T17:54:50.685 INFO:teuthology.orchestra.run.smithi146.stdout: "secret_key": "MrFiiUKgRBWcuPpwfmMgrciNoc5zYlNk0QamslHH6SNliei7EGs3kg==" 2019-12-09T17:54:50.685 INFO:teuthology.orchestra.run.smithi146.stdout: } 2019-12-09T17:54:50.686 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2019-12-09T17:54:50.686 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": [], 2019-12-09T17:54:50.686 INFO:teuthology.orchestra.run.smithi146.stdout: "op_mask": "read, write, delete", 2019-12-09T17:54:50.686 INFO:teuthology.orchestra.run.smithi146.stdout: "default_placement": "", 2019-12-09T17:54:50.686 INFO:teuthology.orchestra.run.smithi146.stdout: "default_storage_class": "", 2019-12-09T17:54:50.686 INFO:teuthology.orchestra.run.smithi146.stdout: "placement_tags": [], 2019-12-09T17:54:50.686 INFO:teuthology.orchestra.run.smithi146.stdout: "bucket_quota": { 2019-12-09T17:54:50.686 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T17:54:50.687 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T17:54:50.687 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T17:54:50.687 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T17:54:50.687 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T17:54:50.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T17:54:50.688 INFO:teuthology.orchestra.run.smithi146.stdout: "user_quota": { 2019-12-09T17:54:50.688 INFO:teuthology.orchestra.run.smithi146.stdout: "enabled": false, 2019-12-09T17:54:50.688 INFO:teuthology.orchestra.run.smithi146.stdout: "check_on_raw": false, 2019-12-09T17:54:50.688 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size": -1, 2019-12-09T17:54:50.688 INFO:teuthology.orchestra.run.smithi146.stdout: "max_size_kb": 0, 2019-12-09T17:54:50.689 INFO:teuthology.orchestra.run.smithi146.stdout: "max_objects": -1 2019-12-09T17:54:50.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2019-12-09T17:54:50.689 INFO:teuthology.orchestra.run.smithi146.stdout: "temp_url_keys": [], 2019-12-09T17:54:50.689 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "rgw", 2019-12-09T17:54:50.689 INFO:teuthology.orchestra.run.smithi146.stdout: "mfa_ids": [] 2019-12-09T17:54:50.689 INFO:teuthology.orchestra.run.smithi146.stdout:} 2019-12-09T17:54:50.690 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T17:54:50.746 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.742+0000 7ff034426ec0 20 remove_watcher() i=0 2019-12-09T17:54:50.746 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.742+0000 7ff034426ec0 2 removed watcher, disabling cache 2019-12-09T17:54:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.774+0000 7ff034426ec0 20 remove_watcher() i=1 2019-12-09T17:54:50.808 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.804+0000 7ff034426ec0 20 remove_watcher() i=2 2019-12-09T17:54:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.855+0000 7ff034426ec0 20 remove_watcher() i=3 2019-12-09T17:54:50.924 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.920+0000 7ff034426ec0 20 remove_watcher() i=4 2019-12-09T17:54:50.989 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:50.981+0000 7ff034426ec0 20 remove_watcher() i=5 2019-12-09T17:54:51.043 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:51.039+0000 7ff034426ec0 20 remove_watcher() i=6 2019-12-09T17:54:51.095 INFO:teuthology.orchestra.run.smithi146.stderr:2019-12-09T17:54:51.091+0000 7ff034426ec0 20 remove_watcher() i=7 2019-12-09T17:54:51.105 INFO:tasks.swift:Configuring testswift... 2019-12-09T17:54:51.106 INFO:teuthology.orchestra.run.smithi146:> cd /home/ubuntu/cephtest/swift && ./bootstrap 2019-12-09T17:54:53.768 INFO:teuthology.orchestra.run.smithi146.stdout:New python executable in /home/ubuntu/cephtest/swift/virtualenv/bin/python 2019-12-09T17:54:55.154 INFO:teuthology.orchestra.run.smithi146.stdout:Installing setuptools, pip, wheel...done. 2019-12-09T17:54:55.483 INFO:teuthology.orchestra.run.smithi146.stderr:Cache entry deserialization failed, entry ignored 2019-12-09T17:54:55.608 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting pip 2019-12-09T17:54:55.687 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-12-09T17:54:55.752 INFO:teuthology.orchestra.run.smithi146.stdout:Installing collected packages: pip 2019-12-09T17:54:55.753 INFO:teuthology.orchestra.run.smithi146.stdout: Found existing installation: pip 9.0.1 2019-12-09T17:54:55.816 INFO:teuthology.orchestra.run.smithi146.stdout: Uninstalling pip-9.0.1: 2019-12-09T17:54:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: Successfully uninstalled pip-9.0.1 2019-12-09T17:54:56.457 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully installed pip-19.3.1 2019-12-09T17:54:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T17:54:57.268 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting setuptools==32.3.1 2019-12-09T17:54:57.271 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-12-09T17:54:57.310 INFO:teuthology.orchestra.run.smithi146.stdout:Installing collected packages: setuptools 2019-12-09T17:54:57.310 INFO:teuthology.orchestra.run.smithi146.stdout: Found existing installation: setuptools 28.8.0 2019-12-09T17:54:57.325 INFO:teuthology.orchestra.run.smithi146.stdout: Uninstalling setuptools-28.8.0: 2019-12-09T17:54:57.336 INFO:teuthology.orchestra.run.smithi146.stdout: Successfully uninstalled setuptools-28.8.0 2019-12-09T17:54:57.462 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully installed setuptools-32.3.1 2019-12-09T17:54:57.898 INFO:teuthology.orchestra.run.smithi146.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T17:54:58.091 INFO:teuthology.orchestra.run.smithi146.stdout:Processing /home/ubuntu/.cache/pip/wheels/54/b7/c7/2ada654ee54483c9329871665aaf4a6056c3ce36f29cf66e67/PyYAML-5.2-cp27-cp27mu-linux_x86_64.whl 2019-12-09T17:54:58.148 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting nose>=1.0.0 2019-12-09T17:54:58.150 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-12-09T17:54:58.260 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting boto>=2.0b4 2019-12-09T17:54:58.266 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-12-09T17:54:58.407 INFO:teuthology.orchestra.run.smithi146.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-12-09T17:54:58.697 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting gevent>=0.14 2019-12-09T17:54:58.710 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T17:54:58.954 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting isodate>=0.4.4 2019-12-09T17:54:58.955 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl 2019-12-09T17:54:59.020 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting eventlet>=0.9.14 2019-12-09T17:54:59.064 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/ef/01/83454d11bac9015f34e93cf11efcae169390ddf2df97cb73ca86de6465ed/eventlet-0.25.1-py2.py3-none-any.whl (222kB) 2019-12-09T17:54:59.214 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting netifaces>=0.5 2019-12-09T17:54:59.224 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/7e/02/ad1a92a72620cc17d448fe4dbdfbdf8fe1487ee7bfd82bb48308712c2f3c/netifaces-0.10.9-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T17:54:59.325 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting xattr<0.7.0,>=0.6 2019-12-09T17:54:59.343 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/c5/80/b25d549ae4bf4f3e9635a331b759ffca2de4dd8a78dc5106d1ca92f5d08d/xattr-0.6.4.tar.gz 2019-12-09T17:54:59.699 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting simplejson>=2.1.3 2019-12-09T17:54:59.713 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/98/87/a7b98aa9256c8843f92878966dc3d8d914c14aad97e2c5ce4798d5743e07/simplejson-3.17.0.tar.gz (83kB) 2019-12-09T17:55:00.033 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting WebOb==1.0 2019-12-09T17:55:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/bc/eb/91b8dd8f3a8d3c3943bf27a2d322501ad8b227bf29f59e792c2eae092bc9/WebOb-1.0.tar.gz (210kB) 2019-12-09T17:55:00.542 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-12-09T17:55:00.544 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T17:55:00.618 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting six 2019-12-09T17:55:00.619 INFO:teuthology.orchestra.run.smithi146.stdout: Using cached https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-12-09T17:55:00.671 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting monotonic>=1.4 2019-12-09T17:55:00.681 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl 2019-12-09T17:55:00.766 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting dnspython>=1.15.0 2019-12-09T17:55:00.778 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/ec/d3/3aa0e7213ef72b8585747aa0e271a9523e713813b9a20177ebe1e939deb0/dnspython-1.16.0-py2.py3-none-any.whl (188kB) 2019-12-09T17:55:00.890 INFO:teuthology.orchestra.run.smithi146.stdout:Collecting enum34; python_version < "3.4" 2019-12-09T17:55:00.899 INFO:teuthology.orchestra.run.smithi146.stdout: Downloading https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl 2019-12-09T17:55:00.931 INFO:teuthology.orchestra.run.smithi146.stdout:Building wheels for collected packages: xattr, simplejson, WebOb 2019-12-09T17:55:00.931 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for xattr (setup.py): started 2019-12-09T17:55:01.387 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for xattr (setup.py): finished with status 'done' 2019-12-09T17:55:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: Created wheel for xattr: filename=xattr-0.6.4-cp27-cp27mu-linux_x86_64.whl size=24122 sha256=aa9e2d9854db295219827a2a40f776945fecdd01062611b52c0029314aa2063f 2019-12-09T17:55:01.388 INFO:teuthology.orchestra.run.smithi146.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/cb/2c/40/ea48345a21b521cdacebf61db13e3bf0c42c77ec664e3fe9e5 2019-12-09T17:55:01.397 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for simplejson (setup.py): started 2019-12-09T17:55:02.406 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for simplejson (setup.py): finished with status 'done' 2019-12-09T17:55:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: Created wheel for simplejson: filename=simplejson-3.17.0-cp27-cp27mu-linux_x86_64.whl size=113129 sha256=b506f33c79edbda2c9dbc3ccc74f645e7f163fcdba7c638a30f13ff78cc862a8 2019-12-09T17:55:02.407 INFO:teuthology.orchestra.run.smithi146.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/86/c0/83/dcd0339abb2640544bb8e0938aab2d069cef55e5647ce6e097 2019-12-09T17:55:02.418 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for WebOb (setup.py): started 2019-12-09T17:55:02.670 INFO:teuthology.orchestra.run.smithi146.stdout: Building wheel for WebOb (setup.py): finished with status 'done' 2019-12-09T17:55:02.671 INFO:teuthology.orchestra.run.smithi146.stdout: Created wheel for WebOb: filename=WebOb-1.0-cp27-none-any.whl size=58478 sha256=d983afb1e721eca42d5f3472664a0be8ef212cedb99e22e34f8464d479992142 2019-12-09T17:55:02.672 INFO:teuthology.orchestra.run.smithi146.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/30/41/c0/8ff9e679d72e05f355e6e2ec87d026131538c953a3b12496eb 2019-12-09T17:55:02.678 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully built xattr simplejson WebOb 2019-12-09T17:55:02.720 INFO:teuthology.orchestra.run.smithi146.stdout:Installing collected packages: PyYAML, nose, boto, bunch, greenlet, gevent, six, isodate, monotonic, dnspython, enum34, eventlet, netifaces, xattr, simplejson, WebOb 2019-12-09T17:55:04.325 INFO:teuthology.orchestra.run.smithi146.stdout:Successfully installed PyYAML-5.2 WebOb-1.0 boto-2.49.0 bunch-1.0.1 dnspython-1.16.0 enum34-1.1.6 eventlet-0.25.1 gevent-1.4.0 greenlet-0.4.15 isodate-0.6.0 monotonic-1.5 netifaces-0.10.9 nose-1.3.7 simplejson-3.17.0 six-1.13.0 xattr-0.6.4 2019-12-09T17:55:04.582 INFO:teuthology.orchestra.run.smithi146.stdout:running develop 2019-12-09T17:55:04.629 INFO:teuthology.orchestra.run.smithi146.stdout:running egg_info 2019-12-09T17:55:04.629 INFO:teuthology.orchestra.run.smithi146.stdout:creating swift.egg-info 2019-12-09T17:55:04.629 INFO:teuthology.orchestra.run.smithi146.stdout:writing swift.egg-info/PKG-INFO 2019-12-09T17:55:04.630 INFO:teuthology.orchestra.run.smithi146.stdout:writing top-level names to swift.egg-info/top_level.txt 2019-12-09T17:55:04.630 INFO:teuthology.orchestra.run.smithi146.stdout:writing dependency_links to swift.egg-info/dependency_links.txt 2019-12-09T17:55:04.633 INFO:teuthology.orchestra.run.smithi146.stdout:writing entry points to swift.egg-info/entry_points.txt 2019-12-09T17:55:04.633 INFO:teuthology.orchestra.run.smithi146.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-12-09T17:55:04.637 INFO:teuthology.orchestra.run.smithi146.stdout:reading manifest file 'swift.egg-info/SOURCES.txt' 2019-12-09T17:55:04.637 INFO:teuthology.orchestra.run.smithi146.stdout:reading manifest template 'MANIFEST.in' 2019-12-09T17:55:04.638 INFO:teuthology.orchestra.run.smithi146.stderr:warning: no files found matching 'ChangeLog' 2019-12-09T17:55:04.642 INFO:teuthology.orchestra.run.smithi146.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-12-09T17:55:04.643 INFO:teuthology.orchestra.run.smithi146.stdout:running build_ext 2019-12-09T17:55:04.643 INFO:teuthology.orchestra.run.smithi146.stdout:Creating /home/ubuntu/cephtest/swift/virtualenv/lib/python2.7/site-packages/swift.egg-link (link to .) 2019-12-09T17:55:04.643 INFO:teuthology.orchestra.run.smithi146.stdout:Adding swift 1.4.4 to easy-install.pth file 2019-12-09T17:55:04.658 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.659 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-account-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.662 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-account-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.662 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-account-reaper script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.663 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-account-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.664 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-account-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.665 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-container-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.666 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-container-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.667 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-container-sync script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.669 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-container-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.669 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-container-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.670 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-drive-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.673 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-get-nodes script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.673 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-init script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.673 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-object-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.674 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-object-expirer script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.675 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-object-info script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.676 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-object-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.677 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-object-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.677 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-object-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.678 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-proxy-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.682 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-ring-builder script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.684 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-stats-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.690 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-stats-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.691 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-dispersion-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.693 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-dispersion-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.694 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-bench script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.697 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-recon script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.698 INFO:teuthology.orchestra.run.smithi146.stdout:Installing swift-recon-cron script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:55:04.698 INFO:teuthology.orchestra.run.smithi146.stdout: 2019-12-09T17:55:04.698 INFO:teuthology.orchestra.run.smithi146.stdout:Installed /home/ubuntu/cephtest/swift 2019-12-09T17:55:04.699 INFO:teuthology.orchestra.run.smithi146.stdout:Processing dependencies for swift==1.4.4 2019-12-09T17:55:04.699 INFO:teuthology.orchestra.run.smithi146.stdout:Finished processing dependencies for swift==1.4.4 2019-12-09T17:55:04.712 INFO:teuthology.orchestra.run.smithi146:> cat > /home/ubuntu/cephtest/archive/testswift.client.0.conf 2019-12-09T17:55:04.762 INFO:teuthology.orchestra.run.smithi146:> SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw' 2019-12-09T17:55:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:testAccountHead (test.functional.tests.TestAccount) ... ok 2019-12-09T17:55:50.885 INFO:teuthology.orchestra.run.smithi146.stderr:testContainerListing (test.functional.tests.TestAccount) ... ok 2019-12-09T17:56:13.712 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:50:34.768 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:13.721 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:50:34.777 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:13.729 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:50:34.784 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:13.730 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:50:34.787 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:13.737 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:50:34.772 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:13.751 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:50:34.786 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:13.964 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:50:35.020 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:13.992 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:50:35.048 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:13.998 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:50:35.032 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:53.777 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:51:14.834 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:53.821 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:51:14.877 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:53.838 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:51:14.894 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:53.857 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:51:14.913 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:53.866 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:51:14.923 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:53.886 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:51:14.918 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:53.894 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:51:14.950 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:53.894 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:51:14.928 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T17:56:53.937 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:51:14.972 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:12.258 INFO:teuthology.orchestra.run.smithi146.stderr:testContainerSerializedInfo (test.functional.tests.TestAccount) ... ok 2019-12-09T18:01:24.723 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:55:45.780 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:24.732 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:55:45.789 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:24.744 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:55:45.801 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:24.745 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:55:45.779 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:24.748 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:55:45.805 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:24.757 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:55:45.791 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:24.904 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:55:45.960 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:24.907 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:55:45.963 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:24.940 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:55:45.974 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:testContainersOrderedByName (test.functional.tests.TestAccount) ... ok 2019-12-09T18:01:29.141 INFO:teuthology.orchestra.run.smithi146.stderr:testInvalidAuthToken (test.functional.tests.TestAccount) ... ok 2019-12-09T18:01:44.685 INFO:teuthology.orchestra.run.smithi146.stderr:testLastContainerMarker (test.functional.tests.TestAccount) ... ok 2019-12-09T18:02:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:testListingLimit (test.functional.tests.TestAccount) ... ok 2019-12-09T18:02:46.758 INFO:teuthology.orchestra.run.smithi146.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccount) ... ok 2019-12-09T18:02:47.915 INFO:teuthology.orchestra.run.smithi146.stderr:testPUT (test.functional.tests.TestAccount) ... ok 2019-12-09T18:05:15.362 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:59:36.419 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:05:15.370 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:59:36.426 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:05:15.406 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:59:36.462 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:05:15.415 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:59:36.449 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:05:15.421 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:59:36.477 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:05:15.438 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:59:36.470 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:05:15.468 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:06:59:36.524 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:05:15.518 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:06:59:36.574 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:05:15.539 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:06:59:36.574 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:06:35.736 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:00:56.793 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:06:35.743 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:00:56.800 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:06:35.755 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:00:56.811 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:06:35.757 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:00:56.792 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:06:35.759 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:00:56.815 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:06:35.764 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:00:56.797 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:06:35.804 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:00:56.861 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:06:35.831 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:00:56.888 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:06:35.871 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:00:56.905 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:09:41.153 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:09:41.144+0000 1694f700 -1 osd.0 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:55.655376+0000 front 2019-12-09T18:08:55.881339+0000 (oldest deadline 2019-12-09T18:09:40.762325+0000) 2019-12-09T18:09:41.968 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:09:41.960+0000 1694f700 -1 osd.2 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:58.765218+0000 front 2019-12-09T18:08:58.779877+0000 (oldest deadline 2019-12-09T18:09:41.803365+0000) 2019-12-09T18:09:42.165 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:09:42.159+0000 1694f700 -1 osd.0 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:55.655376+0000 front 2019-12-09T18:08:55.881339+0000 (oldest deadline 2019-12-09T18:09:40.762325+0000) 2019-12-09T18:09:42.380 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:09:42.368+0000 1694f700 -1 osd.4 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:59.943725+0000 front 2019-12-09T18:08:59.774193+0000 (oldest deadline 2019-12-09T18:09:41.786449+0000) 2019-12-09T18:09:42.983 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:09:42.977+0000 1694f700 -1 osd.2 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:58.765218+0000 front 2019-12-09T18:08:58.779877+0000 (oldest deadline 2019-12-09T18:09:41.803365+0000) 2019-12-09T18:09:42.986 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:09:42.973+0000 1694f700 -1 osd.1 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:57.196267+0000 front 2019-12-09T18:08:57.090890+0000 (oldest deadline 2019-12-09T18:09:42.049079+0000) 2019-12-09T18:09:43.214 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:09:43.208+0000 1694f700 -1 osd.0 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:55.655376+0000 front 2019-12-09T18:08:55.881339+0000 (oldest deadline 2019-12-09T18:09:40.762325+0000) 2019-12-09T18:09:43.425 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:09:43.419+0000 1694f700 -1 osd.4 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:59.943725+0000 front 2019-12-09T18:08:59.774193+0000 (oldest deadline 2019-12-09T18:09:41.786449+0000) 2019-12-09T18:09:43.808 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:09:43.795+0000 1694f700 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:58.804377+0000 front 2019-12-09T18:08:59.009896+0000 (oldest deadline 2019-12-09T18:09:42.834119+0000) 2019-12-09T18:09:43.949 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:09:43.944+0000 1694f700 -1 osd.1 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:57.196267+0000 front 2019-12-09T18:08:57.090890+0000 (oldest deadline 2019-12-09T18:09:42.049079+0000) 2019-12-09T18:09:44.030 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:09:44.010+0000 1694f700 -1 osd.2 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:58.765218+0000 front 2019-12-09T18:08:58.779877+0000 (oldest deadline 2019-12-09T18:09:41.803365+0000) 2019-12-09T18:09:44.234 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:09:44.228+0000 1694f700 -1 osd.0 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:55.655376+0000 front 2019-12-09T18:08:55.881339+0000 (oldest deadline 2019-12-09T18:09:40.762325+0000) 2019-12-09T18:09:44.406 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:09:44.400+0000 1694f700 -1 osd.4 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:59.943725+0000 front 2019-12-09T18:08:59.774193+0000 (oldest deadline 2019-12-09T18:09:41.786449+0000) 2019-12-09T18:09:44.489 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:09:44.476+0000 1694f700 -1 osd.3 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:59.332061+0000 front 2019-12-09T18:08:59.720798+0000 (oldest deadline 2019-12-09T18:09:43.996362+0000) 2019-12-09T18:09:44.852 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:09:44.846+0000 1694f700 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:58.804377+0000 front 2019-12-09T18:08:59.009896+0000 (oldest deadline 2019-12-09T18:09:42.834119+0000) 2019-12-09T18:09:44.908 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:09:44.901+0000 1694f700 -1 osd.1 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:57.196267+0000 front 2019-12-09T18:08:57.090890+0000 (oldest deadline 2019-12-09T18:09:42.049079+0000) 2019-12-09T18:09:44.990 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:09:44.984+0000 1694f700 -1 osd.2 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:58.765218+0000 front 2019-12-09T18:08:58.779877+0000 (oldest deadline 2019-12-09T18:09:41.803365+0000) 2019-12-09T18:09:45.230 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:09:45.209+0000 1694f700 -1 osd.0 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:55.655376+0000 front 2019-12-09T18:08:55.881339+0000 (oldest deadline 2019-12-09T18:09:40.762325+0000) 2019-12-09T18:09:45.445 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:09:45.440+0000 1694f700 -1 osd.4 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:59.943725+0000 front 2019-12-09T18:08:59.774193+0000 (oldest deadline 2019-12-09T18:09:41.786449+0000) 2019-12-09T18:09:45.490 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:09:45.479+0000 1694f700 -1 osd.3 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:59.332061+0000 front 2019-12-09T18:08:59.720798+0000 (oldest deadline 2019-12-09T18:09:43.996362+0000) 2019-12-09T18:09:45.835 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:09:45.831+0000 1694f700 -1 osd.7 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:58.804377+0000 front 2019-12-09T18:08:59.009896+0000 (oldest deadline 2019-12-09T18:09:42.834119+0000) 2019-12-09T18:09:45.949 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:09:45.943+0000 1694f700 -1 osd.1 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:57.196267+0000 front 2019-12-09T18:08:57.090890+0000 (oldest deadline 2019-12-09T18:09:42.049079+0000) 2019-12-09T18:09:45.968 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:09:45.963+0000 1694f700 -1 osd.2 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:58.765218+0000 front 2019-12-09T18:08:58.779877+0000 (oldest deadline 2019-12-09T18:09:41.803365+0000) 2019-12-09T18:09:46.198 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:09:46.192+0000 1694f700 -1 osd.0 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:55.655376+0000 front 2019-12-09T18:08:55.881339+0000 (oldest deadline 2019-12-09T18:09:40.762325+0000) 2019-12-09T18:09:46.455 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:09:46.441+0000 1694f700 -1 osd.5 141 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:08:59.773400+0000 front 2019-12-09T18:08:59.920661+0000 (oldest deadline 2019-12-09T18:09:45.611814+0000) 2019-12-09T18:10:13.616 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:10:13.604+0000 31f87700 -1 osd.6 146 build_incremental_map_msg missing incremental map 146 2019-12-09T18:10:21.574 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:04:42.630 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:21.583 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:04:42.640 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:21.616 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:04:42.673 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:21.628 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:04:42.685 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:21.654 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:04:42.688 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:21.662 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:04:42.696 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:21.760 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:04:42.817 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:21.861 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:04:42.913 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:21.883 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:04:42.917 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:41.026 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:10:41.017+0000 1694f700 -1 osd.7 148 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:107480 2.2fs0 2:f52a3848:::eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.602_baba360a6d1c4364bbb340e8d91b41c5:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e144) 2019-12-09T18:10:42.076 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:10:42.071+0000 1694f700 -1 osd.7 148 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:107480 2.2fs0 2:f52a3848:::eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.602_baba360a6d1c4364bbb340e8d91b41c5:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e144) 2019-12-09T18:10:43.101 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:10:43.096+0000 1694f700 -1 osd.7 148 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:107480 2.2fs0 2:f52a3848:::eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.602_baba360a6d1c4364bbb340e8d91b41c5:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e144) 2019-12-09T18:10:44.119 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:10:44.115+0000 1694f700 -1 osd.7 148 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:107480 2.2fs0 2:f52a3848:::eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.602_baba360a6d1c4364bbb340e8d91b41c5:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e144) 2019-12-09T18:10:44.681 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:10:44.674+0000 1694f700 -1 osd.1 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:01.611553+0000 front 2019-12-09T18:10:01.582718+0000 (oldest deadline 2019-12-09T18:10:44.387787+0000) 2019-12-09T18:10:44.902 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:10:44.897+0000 1694f700 -1 osd.3 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:00.544669+0000 front 2019-12-09T18:10:00.266254+0000 (oldest deadline 2019-12-09T18:10:44.351900+0000) 2019-12-09T18:10:45.150 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:10:45.143+0000 1694f700 -1 osd.7 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:01.792121+0000 front 2019-12-09T18:10:01.493659+0000 (oldest deadline 2019-12-09T18:10:44.381641+0000) 2019-12-09T18:10:45.153 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:10:45.149+0000 1694f700 -1 osd.7 148 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:107480 2.2fs0 2:f52a3848:::eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.602_baba360a6d1c4364bbb340e8d91b41c5:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e144) 2019-12-09T18:10:45.185 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:10:45.179+0000 1694f700 -1 osd.2 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:03.249169+0000 front 2019-12-09T18:10:03.280036+0000 (oldest deadline 2019-12-09T18:10:44.328513+0000) 2019-12-09T18:10:45.716 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:10:45.706+0000 1694f700 -1 osd.1 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:01.611553+0000 front 2019-12-09T18:10:01.582718+0000 (oldest deadline 2019-12-09T18:10:44.387787+0000) 2019-12-09T18:10:45.896 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:10:45.889+0000 1694f700 -1 osd.3 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:00.544669+0000 front 2019-12-09T18:10:00.266254+0000 (oldest deadline 2019-12-09T18:10:44.351900+0000) 2019-12-09T18:10:45.936 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:10:45.929+0000 1694f700 -1 osd.5 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:00.115376+0000 front 2019-12-09T18:10:00.024594+0000 (oldest deadline 2019-12-09T18:10:45.863835+0000) 2019-12-09T18:10:46.187 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:10:46.180+0000 1694f700 -1 osd.7 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:01.792121+0000 front 2019-12-09T18:10:01.493659+0000 (oldest deadline 2019-12-09T18:10:44.381641+0000) 2019-12-09T18:10:46.187 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:10:46.183+0000 1694f700 -1 osd.7 148 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:107480 2.2fs0 2:f52a3848:::eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.602_baba360a6d1c4364bbb340e8d91b41c5:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e144) 2019-12-09T18:10:46.216 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:10:46.209+0000 1694f700 -1 osd.2 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:03.249169+0000 front 2019-12-09T18:10:03.280036+0000 (oldest deadline 2019-12-09T18:10:44.328513+0000) 2019-12-09T18:10:46.742 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:10:46.735+0000 1694f700 -1 osd.1 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:01.611553+0000 front 2019-12-09T18:10:01.582718+0000 (oldest deadline 2019-12-09T18:10:44.387787+0000) 2019-12-09T18:10:46.906 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:10:46.900+0000 1694f700 -1 osd.5 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:00.115376+0000 front 2019-12-09T18:10:00.024594+0000 (oldest deadline 2019-12-09T18:10:45.863835+0000) 2019-12-09T18:10:46.946 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:10:46.941+0000 1694f700 -1 osd.3 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:00.544669+0000 front 2019-12-09T18:10:00.266254+0000 (oldest deadline 2019-12-09T18:10:44.351900+0000) 2019-12-09T18:10:47.231 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:10:47.218+0000 1694f700 -1 osd.7 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:01.792121+0000 front 2019-12-09T18:10:01.493659+0000 (oldest deadline 2019-12-09T18:10:44.381641+0000) 2019-12-09T18:10:47.233 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:10:47.227+0000 1694f700 -1 osd.7 148 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:107480 2.2fs0 2:f52a3848:::eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.602_baba360a6d1c4364bbb340e8d91b41c5:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e144) 2019-12-09T18:10:47.255 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:10:47.248+0000 1694f700 -1 osd.2 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:03.249169+0000 front 2019-12-09T18:10:03.280036+0000 (oldest deadline 2019-12-09T18:10:44.328513+0000) 2019-12-09T18:10:47.710 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:10:47.704+0000 1694f700 -1 osd.1 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:01.611553+0000 front 2019-12-09T18:10:01.582718+0000 (oldest deadline 2019-12-09T18:10:44.387787+0000) 2019-12-09T18:10:47.907 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:10:47.901+0000 1694f700 -1 osd.3 148 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:10:00.544669+0000 front 2019-12-09T18:10:00.266254+0000 (oldest deadline 2019-12-09T18:10:44.351900+0000) 2019-12-09T18:10:48.219 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:10:48.187+0000 1694f700 -1 osd.6 149 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e147) 2019-12-09T18:10:48.346 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:10:48.243+0000 1694f700 -1 osd.7 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:107480 2.2fs0 2:f52a3848:::eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.602_baba360a6d1c4364bbb340e8d91b41c5:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e144) 2019-12-09T18:10:49.506 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:10:49.482+0000 1694f700 -1 osd.7 150 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:107480 2.2fs0 2:f52a3848:::eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.602_baba360a6d1c4364bbb340e8d91b41c5:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e144) 2019-12-09T18:11:10.000 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:05:31.056 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:10.007 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:05:31.064 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:10.013 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:05:31.069 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:10.016 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:05:31.073 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:10.024 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:05:31.058 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:10.039 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:05:31.073 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:10.078 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:05:31.135 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:10.100 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:05:31.157 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:10.151 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:05:31.185 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:13:02.626 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:13:02.621+0000 1694f700 -1 osd.7 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:19.014738+0000 front 2019-12-09T18:12:21.707443+0000 (oldest deadline 2019-12-09T18:13:02.096694+0000) 2019-12-09T18:13:02.809 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:13:02.791+0000 1694f700 -1 osd.4 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:17.124343+0000 front 2019-12-09T18:12:19.123451+0000 (oldest deadline 2019-12-09T18:13:02.276012+0000) 2019-12-09T18:13:02.928 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:13:02.922+0000 1694f700 -1 osd.3 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:20.969812+0000 front 2019-12-09T18:12:21.716877+0000 (oldest deadline 2019-12-09T18:13:02.408392+0000) 2019-12-09T18:13:03.431 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:13:03.425+0000 1694f700 -1 osd.2 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:20.463074+0000 front 2019-12-09T18:12:20.976757+0000 (oldest deadline 2019-12-09T18:13:03.331823+0000) 2019-12-09T18:13:03.627 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:13:03.622+0000 1694f700 -1 osd.7 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:19.014738+0000 front 2019-12-09T18:12:21.707443+0000 (oldest deadline 2019-12-09T18:13:02.096694+0000) 2019-12-09T18:13:03.818 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:13:03.814+0000 1694f700 -1 osd.4 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:17.124343+0000 front 2019-12-09T18:12:19.123451+0000 (oldest deadline 2019-12-09T18:13:02.276012+0000) 2019-12-09T18:13:03.929 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:13:03.923+0000 1694f700 -1 osd.3 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:20.969812+0000 front 2019-12-09T18:12:21.716877+0000 (oldest deadline 2019-12-09T18:13:02.408392+0000) 2019-12-09T18:13:04.475 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:13:04.468+0000 1694f700 -1 osd.2 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:20.463074+0000 front 2019-12-09T18:12:20.976757+0000 (oldest deadline 2019-12-09T18:13:03.331823+0000) 2019-12-09T18:13:04.601 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:13:04.593+0000 1694f700 -1 osd.0 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:21.764842+0000 front 2019-12-09T18:12:21.249483+0000 (oldest deadline 2019-12-09T18:13:04.219588+0000) 2019-12-09T18:13:04.675 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:13:04.670+0000 1694f700 -1 osd.7 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:19.014738+0000 front 2019-12-09T18:12:21.707443+0000 (oldest deadline 2019-12-09T18:13:02.096694+0000) 2019-12-09T18:13:04.782 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:13:04.775+0000 1694f700 -1 osd.4 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:17.124343+0000 front 2019-12-09T18:12:19.123451+0000 (oldest deadline 2019-12-09T18:13:02.276012+0000) 2019-12-09T18:13:04.910 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:13:04.904+0000 1694f700 -1 osd.3 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:20.969812+0000 front 2019-12-09T18:12:21.716877+0000 (oldest deadline 2019-12-09T18:13:02.408392+0000) 2019-12-09T18:13:05.451 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:13:05.445+0000 1694f700 -1 osd.2 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:20.463074+0000 front 2019-12-09T18:12:20.976757+0000 (oldest deadline 2019-12-09T18:13:03.331823+0000) 2019-12-09T18:13:05.570 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:13:05.564+0000 1694f700 -1 osd.1 153 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:12:23.102239+0000 front 2019-12-09T18:12:21.734198+0000 (oldest deadline 2019-12-09T18:13:05.448476+0000) 2019-12-09T18:13:37.233 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:07:58.289 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:13:37.273 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:07:58.330 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:13:37.311 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:07:58.368 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:13:37.336 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:07:58.393 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:13:37.354 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:07:58.388 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:13:37.356 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:07:58.390 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:13:37.411 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:07:58.467 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:13:37.457 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:07:58.513 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:13:37.547 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:07:58.581 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:14:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:testGetRequest (test.functional.tests.TestAccountNoContainers) ... ok 2019-12-09T18:14:03.409 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:14:03.404+0000 1694f700 -1 osd.2 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.103132+0000 front 2019-12-09T18:13:21.158528+0000 (oldest deadline 2019-12-09T18:14:03.377842+0000) 2019-12-09T18:14:04.419 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:14:04.414+0000 1694f700 -1 osd.2 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.103132+0000 front 2019-12-09T18:13:21.158528+0000 (oldest deadline 2019-12-09T18:14:03.377842+0000) 2019-12-09T18:14:05.430 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:14:05.422+0000 1694f700 -1 osd.2 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.103132+0000 front 2019-12-09T18:13:21.158528+0000 (oldest deadline 2019-12-09T18:14:03.377842+0000) 2019-12-09T18:14:05.816 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:14:05.810+0000 1694f700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.004703+0000 front 2019-12-09T18:13:20.991921+0000 (oldest deadline 2019-12-09T18:14:05.670465+0000) 2019-12-09T18:14:06.461 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:14:06.454+0000 1694f700 -1 osd.2 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.103132+0000 front 2019-12-09T18:13:21.158528+0000 (oldest deadline 2019-12-09T18:14:03.377842+0000) 2019-12-09T18:14:06.729 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:14:06.719+0000 1694f700 -1 osd.3 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:22.856564+0000 front 2019-12-09T18:13:22.612885+0000 (oldest deadline 2019-12-09T18:14:06.688220+0000) 2019-12-09T18:14:06.836 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:14:06.830+0000 1694f700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.004703+0000 front 2019-12-09T18:13:20.991921+0000 (oldest deadline 2019-12-09T18:14:05.670465+0000) 2019-12-09T18:14:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:testGetRequest (test.functional.tests.TestAccountNoContainersUTF8) ... ok 2019-12-09T18:14:07.185 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:14:07.178+0000 1694f700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.052636+0000 front 2019-12-09T18:13:21.012717+0000 (oldest deadline 2019-12-09T18:14:06.290548+0000) 2019-12-09T18:14:07.445 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:14:07.439+0000 1694f700 -1 osd.2 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.103132+0000 front 2019-12-09T18:13:21.158528+0000 (oldest deadline 2019-12-09T18:14:03.377842+0000) 2019-12-09T18:14:07.722 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:14:07.716+0000 1694f700 -1 osd.3 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:22.856564+0000 front 2019-12-09T18:13:22.612885+0000 (oldest deadline 2019-12-09T18:14:06.688220+0000) 2019-12-09T18:14:07.815 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:14:07.810+0000 1694f700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.004703+0000 front 2019-12-09T18:13:20.991921+0000 (oldest deadline 2019-12-09T18:14:05.670465+0000) 2019-12-09T18:14:07.834 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:14:07.828+0000 1694f700 -1 osd.4 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.269000+0000 front 2019-12-09T18:13:21.269855+0000 (oldest deadline 2019-12-09T18:14:07.144639+0000) 2019-12-09T18:14:08.233 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:14:08.228+0000 1694f700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.052636+0000 front 2019-12-09T18:13:21.012717+0000 (oldest deadline 2019-12-09T18:14:06.290548+0000) 2019-12-09T18:14:08.397 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:14:08.392+0000 1694f700 -1 osd.2 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.103132+0000 front 2019-12-09T18:13:21.158528+0000 (oldest deadline 2019-12-09T18:14:03.377842+0000) 2019-12-09T18:14:08.745 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:14:08.708+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:22.856564+0000 front 2019-12-09T18:13:22.612885+0000 (oldest deadline 2019-12-09T18:14:06.688220+0000) 2019-12-09T18:14:08.816 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:14:08.811+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.269000+0000 front 2019-12-09T18:13:21.269855+0000 (oldest deadline 2019-12-09T18:14:07.144639+0000) 2019-12-09T18:14:08.817 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:14:08.812+0000 1694f700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.004703+0000 front 2019-12-09T18:13:20.991921+0000 (oldest deadline 2019-12-09T18:14:05.670465+0000) 2019-12-09T18:14:09.267 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:14:09.261+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.052636+0000 front 2019-12-09T18:13:21.012717+0000 (oldest deadline 2019-12-09T18:14:06.290548+0000) 2019-12-09T18:14:09.379 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:14:09.352+0000 1694f700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.103132+0000 front 2019-12-09T18:13:21.158528+0000 (oldest deadline 2019-12-09T18:14:03.377842+0000) 2019-12-09T18:14:09.763 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:14:09.757+0000 1694f700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:22.856564+0000 front 2019-12-09T18:13:22.612885+0000 (oldest deadline 2019-12-09T18:14:06.688220+0000) 2019-12-09T18:14:09.848 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:14:09.843+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.004703+0000 front 2019-12-09T18:13:20.991921+0000 (oldest deadline 2019-12-09T18:14:05.670465+0000) 2019-12-09T18:14:09.865 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:14:09.859+0000 1694f700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.269000+0000 front 2019-12-09T18:13:21.269855+0000 (oldest deadline 2019-12-09T18:14:07.144639+0000) 2019-12-09T18:14:10.286 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:14:10.278+0000 1694f700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.052636+0000 front 2019-12-09T18:13:21.012717+0000 (oldest deadline 2019-12-09T18:14:06.290548+0000) 2019-12-09T18:14:10.360 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:14:10.354+0000 1694f700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.103132+0000 front 2019-12-09T18:13:21.158528+0000 (oldest deadline 2019-12-09T18:14:03.377842+0000) 2019-12-09T18:14:10.891 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:14:10.884+0000 1694f700 -1 osd.1 156 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:13:21.004703+0000 front 2019-12-09T18:13:20.991921+0000 (oldest deadline 2019-12-09T18:14:05.670465+0000) 2019-12-09T18:14:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:testAccountHead (test.functional.tests.TestAccountUTF8) ... ok 2019-12-09T18:15:03.729 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:09:24.786 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:03.742 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:09:24.798 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:03.748 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:09:24.805 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:03.751 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:09:24.808 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:03.752 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:09:24.787 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:03.769 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:09:24.803 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:03.861 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:09:24.918 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:03.872 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:09:24.929 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:03.905 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:09:24.939 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:05.569 INFO:teuthology.orchestra.run.smithi146.stderr:testContainerListing (test.functional.tests.TestAccountUTF8) ... ok 2019-12-09T18:15:26.975 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T18:15:26.876+0000 20e25700 -1 RGWWatcher::handle_error cookie 821937536 err (107) Transport endpoint is not connected 2019-12-09T18:16:17.556 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:17.549+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:17.682 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:17.677+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:18.556 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:18.550+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:18.704 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:18.698+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:18.980 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:18.975+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:18.996 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:18.990+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:19.533 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:19.528+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:19.717 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:19.711+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:19.975 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:19.970+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:20.032 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:20.027+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:20.517 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:20.511+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:20.767 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:20.760+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:20.808 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:20.800+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:20.817 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:20.810+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:20.987 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:20.980+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:21.013 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:21.008+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:21.493 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:21.487+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:21.782 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:21.776+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:21.827 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:21.822+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:21.866 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:21.860+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:21.866 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:21.860+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:21.970 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:21.964+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:21.981 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:21.975+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:22.510 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:22.505+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:22.802 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:22.797+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:22.842 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:22.838+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:22.891 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:22.886+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:22.905 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:22.899+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:22.953 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:22.949+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:22.988 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:22.983+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:23.562 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:23.555+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:23.800 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:23.795+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:23.880 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:23.873+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:23.889 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:23.884+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:23.925 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:23.920+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:23.951 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:23.946+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:24.039 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:24.032+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:24.593 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:24.588+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:24.824 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:24.819+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:24.890 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:24.883+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:24.901 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:24.890+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:24.915 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:24.907+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:24.969 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:24.963+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:25.024 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:25.019+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:25.645 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:25.639+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:25.841 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:25.836+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:25.864 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:25.860+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:25.892 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:25.886+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:25.899 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:25.894+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:25.979 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:25.973+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:26.078 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:26.072+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:26.653 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:26.648+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:26.814 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:26.808+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:26.844 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:26.838+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:26.860 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:26.855+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:26.873 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:26.868+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:27.009 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:27.002+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:27.076 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:27.071+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:27.679 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:27.675+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:27.772 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:27.766+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:27.860 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:27.855+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:27.885 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:27.880+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:27.895 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:27.890+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:27.994 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:27.990+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:28.074 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:28.069+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:28.725 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:28.719+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:28.803 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:28.796+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:28.847 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:28.841+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:28.854 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:28.849+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:28.866 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:28.860+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:28.998 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:28.993+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:29.122 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:29.116+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:29.715 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:29.710+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:29.814 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:29.807+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:29.845 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:29.838+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:29.854 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:29.848+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:29.894 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:29.887+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:30.015 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:30.008+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:30.106 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:30.101+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:30.738 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:30.732+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:30.812 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:30.806+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:30.837 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:30.831+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:30.866 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:30.860+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:30.889 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:30.880+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:31.041 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:31.035+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:31.064 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:31.058+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:31.722 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:31.716+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:31.785 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:31.774+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:31.818 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:31.813+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:31.841 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:31.835+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:31.871 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:31.867+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:32.089 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:32.083+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:32.102 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:32.097+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:32.745 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:32.739+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:32.798 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:32.794+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:32.815 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:32.809+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:32.846 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:32.841+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:32.856 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:32.850+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:33.073 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:33.067+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:33.087 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:33.081+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:33.764 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:33.759+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:33.792 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:33.785+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:33.827 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:33.822+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:33.870 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:33.865+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:33.889 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:33.884+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:34.087 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:34.082+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:34.096 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:34.089+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:34.753 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:34.748+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:34.806 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:34.800+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:34.843 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:34.838+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:34.876 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:34.870+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:34.903 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:34.898+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:35.067 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:35.062+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:35.069 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:35.064+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:35.782 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:35.775+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:35.800 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:35.794+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:35.855 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:35.849+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:35.891 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:35.885+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:35.929 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:35.923+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:36.033 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:36.028+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:36.071 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:36.067+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:36.757 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:36.750+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:36.842 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:36.835+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:16:36.903 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:16:36.897+0000 1694f700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:37.923730+0000 front 2019-12-09T18:15:38.808047+0000 (oldest deadline 2019-12-09T18:16:20.253104+0000) 2019-12-09T18:16:36.937 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:16:36.932+0000 1694f700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.191953+0000 front 2019-12-09T18:15:34.412328+0000 (oldest deadline 2019-12-09T18:16:19.997534+0000) 2019-12-09T18:16:36.951 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:16:36.946+0000 1694f700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:35.782366+0000 front 2019-12-09T18:15:35.666498+0000 (oldest deadline 2019-12-09T18:16:21.490057+0000) 2019-12-09T18:16:37.031 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:16:37.026+0000 1694f700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:39.085794+0000 front 2019-12-09T18:15:36.482653+0000 (oldest deadline 2019-12-09T18:16:18.492718+0000) 2019-12-09T18:16:37.035 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:16:37.030+0000 1694f700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.888591+0000 front 2019-12-09T18:15:32.855020+0000 (oldest deadline 2019-12-09T18:16:18.649260+0000) 2019-12-09T18:16:37.773 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:16:37.768+0000 1694f700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:32.597246+0000 front 2019-12-09T18:15:32.424980+0000 (oldest deadline 2019-12-09T18:16:17.491730+0000) 2019-12-09T18:16:37.845 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:16:37.840+0000 1694f700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:15:34.414966+0000 front 2019-12-09T18:15:38.484716+0000 (oldest deadline 2019-12-09T18:16:17.668209+0000) 2019-12-09T18:17:32.119 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:17:32.026+0000 3378a700 -1 osd.6 168 build_incremental_map_msg missing incremental map 168 2019-12-09T18:17:32.315 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:17:32.236+0000 35f8f700 -1 osd.6 168 build_incremental_map_msg missing incremental map 168 2019-12-09T18:17:32.319 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:17:32.252+0000 32788700 -1 osd.6 168 build_incremental_map_msg missing incremental map 168 2019-12-09T18:17:32.336 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:17:32.273+0000 36f91700 -1 osd.6 168 build_incremental_map_msg missing incremental map 168 2019-12-09T18:17:35.619 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:17:35.612+0000 32788700 -1 osd.6 169 build_incremental_map_msg missing incremental map 146 2019-12-09T18:17:35.664 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:17:35.659+0000 32788700 -1 osd.6 169 build_incremental_map_msg missing incremental map 168 2019-12-09T18:17:35.782 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:35.777+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:35.913 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:35.907+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:36.835 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:36.827+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:36.915 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:36.909+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:36.933 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:36.928+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:36.985 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:36.927+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:37.670 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:37.664+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:37.833 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:37.823+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:37.934 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:37.927+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:37.937 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:37.931+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:37.944 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:37.938+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:38.662 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:38.656+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:38.873 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:38.866+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:38.955 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:38.949+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:38.967 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:38.959+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:38.978 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:38.971+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:39.706 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:39.701+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:39.772 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:39.765+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:39.915 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:39.910+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:39.922 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:39.916+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:39.925 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:39.919+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:39.994 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:39.986+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:40.730 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:40.724+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:40.773 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:40.765+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:40.888 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:40.883+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:40.906 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:40.893+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:40.921 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:40.915+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:40.986 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:40.979+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:41.739 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:41.732+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:41.741 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:41.735+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:41.859 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:41.853+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:41.872 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:41.860+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:41.895 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:41.889+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:41.952 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:41.945+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:42.722 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:42.717+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:42.786 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:42.780+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:42.832 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:42.826+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:42.862 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:42.857+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:42.909 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:42.901+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:42.958 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:42.953+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:43.768 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:43.761+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:43.827 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:43.820+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:43.856 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:43.851+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:43.879 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:43.874+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:43.879 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:43.874+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:43.915 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:43.910+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:44.780 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:44.774+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:44.855 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:44.849+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:44.862 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:44.855+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:44.885 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:44.879+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:44.911 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:44.904+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:44.918 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:44.912+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:45.775 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:45.768+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:45.883 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:45.877+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:45.900 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:45.894+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:45.905 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:45.895+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:45.923 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:45.918+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:45.952 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:45.945+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:46.790 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:46.783+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:46.888 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:46.882+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:46.890 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:46.883+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:46.897 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:46.891+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:46.901 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:46.894+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:46.934 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:46.927+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:47.753 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:47.746+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:47.871 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:47.864+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:47.886 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:47.881+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:47.897 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:47.890+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:47.934 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:47.927+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:47.949 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:47.944+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:48.775 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:48.768+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:48.853 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:48.844+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:48.910 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:48.903+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:48.936 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:48.929+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:48.963 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:48.956+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:48.976 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:48.970+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:49.755 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:49.747+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:49.880 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:49.873+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:49.939 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:49.933+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:49.968 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:49.961+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:49.970 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:49.965+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:50.027 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:50.015+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:50.800 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:50.794+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:50.875 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:50.869+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:50.941 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:50.934+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:50.954 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:50.946+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:50.976 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:50.969+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:51.019 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:51.013+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:51.824 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:51.818+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:51.866 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:51.860+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:51.913 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:51.906+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:51.975 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:51.968+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:51.992 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:51.987+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:52.066 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:52.059+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:52.839 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:17:52.826+0000 1694f700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.957815+0000 front 2019-12-09T18:16:52.959563+0000 (oldest deadline 2019-12-09T18:17:36.750572+0000) 2019-12-09T18:17:52.917 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:17:52.910+0000 1694f700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:51.641412+0000 front 2019-12-09T18:16:51.676773+0000 (oldest deadline 2019-12-09T18:17:36.836377+0000) 2019-12-09T18:17:52.924 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:17:52.917+0000 1694f700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.142732+0000 front 2019-12-09T18:16:53.275408+0000 (oldest deadline 2019-12-09T18:17:36.541755+0000) 2019-12-09T18:17:52.972 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:52.966+0000 1694f700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:50.218873+0000 front 2019-12-09T18:16:50.518733+0000 (oldest deadline 2019-12-09T18:17:35.505177+0000) 2019-12-09T18:17:52.996 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:17:52.989+0000 1694f700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:52.993856+0000 front 2019-12-09T18:16:53.014272+0000 (oldest deadline 2019-12-09T18:17:35.056418+0000) 2019-12-09T18:17:53.131 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:17:53.117+0000 1694f700 -1 osd.5 169 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:16:53.143689+0000 front 2019-12-09T18:16:53.276855+0000 (oldest deadline 2019-12-09T18:17:39.022944+0000) 2019-12-09T18:17:55.358 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:17:55.334+0000 1694f700 -1 osd.7 171 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:108774 2.2fs0 2:f670604a:::eaaaea16-3e32-4d4e-94b4-60e1a08a3965.4382.610_%e9%90%8c%e0%a4%82%ef%84%90%e5%98%85%e8%94%8b%e8%94%89%e3%9c%85%e5%98%87%eb%8c%8d%e9%90%89%ef%84%92%ce%a9%e3%9c%85%e9%90%8a%e3%9c%86:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~18725 in=18725b,setxattr user.rgw.manifest (386) in=403b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e165) 2019-12-09T18:18:54.532 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:13:15.589 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:54.534 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:13:15.591 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:54.590 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:13:15.624 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:54.596 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:13:15.630 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:54.608 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:13:15.664 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:54.615 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:13:15.667 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:54.883 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:13:15.917 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:55.026 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:13:16.083 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:55.040 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:13:16.097 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:19:53.335 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:19:53.329+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:19:54.386 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:19:54.381+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:19:54.894 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:19:54.889+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:19:55.006 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:19:54.999+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:19:55.088 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:19:55.083+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:19:55.383 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:19:55.378+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:19:55.863 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:19:55.859+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:19:56.057 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:19:56.051+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:19:56.116 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:19:56.110+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:19:56.356 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:19:56.349+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:19:56.708 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:19:56.702+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:19:56.829 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:19:56.824+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:19:57.019 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:19:57.012+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:19:57.170 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:19:57.163+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:19:57.390 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:19:57.384+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:19:57.713 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:19:57.708+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:19:57.836 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:19:57.831+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:19:58.038 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:19:58.031+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:19:58.215 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:19:58.209+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:19:58.429 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:19:58.422+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:19:58.710 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:19:58.705+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:19:58.791 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:19:58.785+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:19:58.854 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:19:58.842+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:19:59.022 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:19:59.015+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:19:59.188 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:19:59.183+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:19:59.390 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:19:59.380+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:19:59.700 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:19:59.693+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:19:59.845 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:19:59.838+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:19:59.862 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:19:59.856+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:00.030 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:00.022+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:00.175 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:00.168+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:00.416 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:00.409+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:00.680 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:00.675+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:00.824 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:00.816+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:00.899 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:00.892+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:01.066 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:01.060+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:01.164 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:01.158+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:01.384 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:01.378+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:01.651 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:01.645+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:01.791 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:01.785+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:01.937 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:01.930+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:02.068 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:02.062+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:02.141 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:02.135+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:02.365 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:02.358+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:02.639 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:02.634+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:02.770 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:02.762+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:02.898 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:02.893+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:03.030 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:03.024+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:03.107 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:03.101+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:03.356 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:03.351+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:03.648 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:03.642+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:03.774 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:03.768+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:03.945 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:03.938+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:04.075 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:04.067+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:04.083 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:04.077+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:04.351 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:04.344+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:04.653 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:04.647+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:04.751 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:04.746+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:04.942 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:04.937+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:05.050 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:05.043+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:05.064 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:05.057+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:05.377 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:05.372+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:05.634 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:05.628+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:05.717 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:05.712+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:05.946 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:05.941+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:06.004 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:05.998+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:06.072 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:06.065+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:06.349 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:06.341+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:06.630 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:06.625+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:06.676 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:06.671+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:06.992 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:06.986+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:07.046 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:07.034+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:07.057 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:07.050+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:07.373 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:07.366+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:07.621 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:07.616+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:07.696 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:07.691+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:07.994 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:07.987+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:08.045 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:08.038+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:08.066 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:08.059+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:08.384 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:08.377+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:08.646 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:08.640+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:08.716 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:08.711+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:09.008 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:09.002+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:09.024 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:09.017+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:09.111 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:09.104+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:09.399 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:09.392+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:09.649 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:09.630+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:09.735 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:09.729+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:09.984 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:09.978+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:09.989 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:09.984+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:10.160 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:10.153+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:10.451 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:10.444+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:10.687 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:10.681+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:10.740 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:10.734+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:11.015 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:11.009+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:11.035 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:11.029+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:11.129 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:11.123+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:11.470 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:11.464+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:11.677 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:11.673+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:11.759 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:11.753+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:12.018 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:12.013+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:12.037 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:12.030+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:12.128 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:12.121+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:12.474 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:12.468+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:12.639 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:12.632+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:12.774 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:12.768+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:13.041 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:13.033+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:13.061 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:13.053+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:13.159 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:13.153+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:13.527 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:13.520+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:13.600 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:13.595+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:13.732 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:13.727+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:14.035 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:14.028+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:14.094 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:14.089+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:14.122 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:14.115+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:14.525 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:14.516+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:14.626 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:14.621+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:14.697 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:14.691+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:15.056 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:15.050+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:15.078 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:15.071+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:15.103 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:15.098+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:15.567 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:15.560+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:15.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:15.623+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:15.709 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:15.704+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:16.089 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:16.083+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:16.096 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:16.090+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:16.121 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:16.115+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:16.552 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:16.546+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:16.672 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:16.667+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:16.674 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:16.670+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:17.052 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:17.045+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:17.108 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:17.103+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:17.144 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:17.138+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:17.596 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:17.589+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:17.651 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:17.641+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:17.674 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:17.668+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:18.012 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:18.007+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:18.079 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:18.074+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:18.187 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:18.176+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:18.560 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:18.554+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:18.619 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:18.613+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:18.657 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:18.652+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:19.040 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:19.033+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:19.046 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:19.040+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:19.159 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:19.153+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:19.579 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:19.574+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:19.601 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:19.595+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:19.629 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:19.624+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:20.012 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:20.007+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:20.035 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:20.029+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:20.159 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:20.154+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:20.570 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:20.565+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:20.571 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:20.566+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:20.585 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:20.581+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:20.977 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:20.970+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:21.019 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:21.010+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:21.191 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:21.185+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:21.571 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:21.565+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:21.585 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:21.580+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:21.585 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:21.581+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:21.986 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:21.980+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:21.988 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:21.981+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:22.166 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:22.162+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:22.532 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:22.525+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:22.554 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:22.548+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:22.598 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:22.592+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:20:22.969 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:20:22.964+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.217204+0000 front 2019-12-09T18:19:13.630562+0000 (oldest deadline 2019-12-09T18:19:54.062152+0000) 2019-12-09T18:20:22.970 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:20:22.965+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:13.494820+0000 front 2019-12-09T18:19:13.496746+0000 (oldest deadline 2019-12-09T18:19:58.435851+0000) 2019-12-09T18:20:23.198 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:20:23.193+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.453688+0000 front 2019-12-09T18:19:09.362417+0000 (oldest deadline 2019-12-09T18:19:54.450662+0000) 2019-12-09T18:20:23.550 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:20:23.527+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 43sec e178 v178) 2019-12-09T18:20:23.574 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:20:23.568+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:11.756924+0000 front 2019-12-09T18:19:11.699180+0000 (oldest deadline 2019-12-09T18:19:54.243772+0000) 2019-12-09T18:20:23.582 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:20:23.576+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:15.207792+0000 front 2019-12-09T18:19:13.387164+0000 (oldest deadline 2019-12-09T18:19:56.333119+0000) 2019-12-09T18:20:23.589 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:20:23.584+0000 1694f700 -1 osd.1 178 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:19:09.850637+0000 front 2019-12-09T18:19:13.533093+0000 (oldest deadline 2019-12-09T18:19:53.167257+0000) 2019-12-09T18:21:11.614 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:11.516+0000 31786700 -1 osd.6 184 build_incremental_map_msg missing incremental map 184 2019-12-09T18:21:11.654 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:11.535+0000 124b0700 -1 osd.6 184 build_incremental_map_msg missing incremental map 184 2019-12-09T18:21:12.776 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:12.764+0000 34f8d700 -1 osd.6 184 build_incremental_map_msg missing incremental map 184 2019-12-09T18:21:13.549 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:13.542+0000 34f8d700 -1 osd.6 184 build_incremental_map_msg missing incremental map 184 2019-12-09T18:21:21.610 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:21.601+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:22.629 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:22.622+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:22.996 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:22.988+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:23.593 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:23.586+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:23.687 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:23.681+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:24.019 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:24.014+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:24.176 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:24.171+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:24.619 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:24.612+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:24.694 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:24.686+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:25.068 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:25.061+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:25.132 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:25.125+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:25.168 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:25.160+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:25.223 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:25.215+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:25.585 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:25.578+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:25.687 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:25.681+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:26.085 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:26.079+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:26.103 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:26.096+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:26.209 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:26.203+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:26.237 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:26.230+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:26.604 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:26.594+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:26.675 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:26.669+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:27.125 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:27.115+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:27.134 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:27.128+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:27.207 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:27.197+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:27.238 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:27.233+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:27.607 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:27.601+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:27.704 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:27.697+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:28.098 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:28.092+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:28.117 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:28.112+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:28.188 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:28.181+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:28.216 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:28.209+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:28.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:28.561+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:28.673 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:28.668+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:29.100 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:29.095+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:29.128 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:29.118+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:29.143 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:29.136+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:29.251 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:29.244+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:29.597 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:29.590+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:29.726 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:29.720+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:30.117 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:30.110+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:30.123 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:30.116+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:30.172 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:30.166+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:30.304 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:30.297+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:30.610 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:30.603+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:30.716 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:30.709+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:31.099 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:31.088+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:31.142 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:31.135+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:31.157 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:31.152+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:31.321 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:31.314+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:31.580 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:31.573+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:31.729 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:31.722+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:32.070 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:32.056+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:32.119 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:32.110+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:32.202 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:32.196+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:32.351 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:32.341+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:32.588 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:32.581+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:32.716 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:32.710+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:33.050 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:33.041+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:33.154 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:33.147+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:33.182 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:33.176+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:33.317 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:33.310+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:33.625 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:33.618+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:33.763 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:33.756+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:34.041 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:34.035+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:34.126 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:34.114+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:34.218 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:34.211+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:34.328 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:34.322+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:34.640 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:34.633+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:34.795 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:34.788+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:35.039 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:35.035+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:35.161 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:35.154+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:35.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:35.259+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:35.311 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:35.304+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:35.682 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:35.675+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:35.773 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:35.767+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:36.077 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:36.071+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:36.121 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:36.114+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:36.270 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:36.264+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:36.317 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:36.310+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:36.661 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:36.655+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:36.792 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:36.786+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:37.085 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:37.078+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:37.128 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:37.123+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:37.280 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:37.275+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:37.286 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:37.280+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:37.712 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:37.705+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:37.757 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:37.750+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:38.039 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:38.033+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:38.142 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:38.137+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:38.242 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:38.237+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:38.312 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:38.305+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:38.674 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:38.668+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:38.747 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:38.740+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:39.088 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:39.081+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:39.105 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:39.100+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:39.236 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:39.230+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:39.365 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:39.358+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:39.690 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:39.683+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:39.746 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:39.739+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:40.108 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:40.101+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:40.128 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:40.123+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:40.287 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:40.281+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:40.384 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:40.377+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:40.650 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:40.643+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:40.738 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:40.733+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:41.120 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:41.114+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:41.147 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:41.140+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:41.250 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:41.245+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:41.425 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:41.420+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:41.613 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:41.607+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:41.702 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:41.697+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:42.114 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:42.108+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:42.120 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:42.114+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:42.232 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:42.226+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:42.475 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:42.466+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:42.625 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:42.616+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:42.671 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:42.664+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:43.074 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:43.067+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:43.104 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:43.099+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:43.236 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:43.231+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:43.493 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:43.487+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:43.496 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:43.490+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:43.602 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:43.595+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:43.669 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:43.663+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:44.046 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:44.038+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:44.122 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:44.116+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:44.287 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:44.280+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:44.491 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:44.485+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:44.512 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:44.505+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:44.634 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:44.627+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:44.652 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:44.646+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:45.007 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:45.001+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:45.145 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:45.140+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:45.314 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:45.308+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:45.497 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:45.490+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:45.509 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:45.504+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:45.654 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:45.647+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:45.680 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:45.674+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:46.013 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:46.006+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:46.146 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:46.140+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:46.324 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:46.318+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:46.536 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:46.529+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:46.568 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:46.555+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:46.569 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:46.564+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:46.661 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:46.654+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:46.693 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:46.682+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:47.041 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:47.035+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:47.107 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:47.102+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:47.337 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:47.332+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:47.586 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:47.579+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:47.616 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:47.607+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:47.617 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:47.610+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:47.655 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:47.647+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:47.672 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:47.666+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:48.027 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:48.021+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:48.105 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:48.094+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:48.376 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:48.370+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:48.569 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:48.562+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:48.588 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:48.570+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:48.594 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:48.585+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:48.666 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:48.659+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:48.692 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:48.683+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:49.030 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:49.023+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:49.065 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:49.060+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:49.370 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:49.363+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:49.560 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:49.553+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:49.622 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:49.615+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:49.623 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:49.618+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:49.669 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:49.662+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:49.714 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:49.708+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:50.051 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:50.046+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:50.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:50.050+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:50.360 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:50.354+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:50.590 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:50.583+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:50.592 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:50.587+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:50.609 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:50.602+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:50.699 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:50.693+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:50.737 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:50.730+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:51.017 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:51.012+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:51.044 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:51.037+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:51.398 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:51.393+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:51.573 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:51.566+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:51.613 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:51.605+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:51.613 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:51.608+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:51.689 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:51.677+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:51.752 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:51.745+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:51.975 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:51.970+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:52.108 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:52.095+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:52.424 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:52.418+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:52.553 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:52.547+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:52.618 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:52.611+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:52.619 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:52.614+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:52.637 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:52.632+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:52.717 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:52.711+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:52.962 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:52.956+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:53.153 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:53.147+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:53.409 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:53.403+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:53.553 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:53.546+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:53.614 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:53.608+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:53.666 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:53.658+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:53.667 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:53.662+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:53.712 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:53.705+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:53.809 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:21:53.800+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e184 v184) 2019-12-09T18:21:53.982 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:53.976+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:54.189 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:54.183+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:54.460 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:54.454+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:54.515 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:54.509+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:54.662 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:54.655+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:54.669 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:54.663+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:54.673 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:54.667+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:54.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:54.713+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:54.940 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:54.933+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:55.152 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:55.146+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:55.423 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:55.417+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:55.493 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:55.486+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:55.683 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:55.676+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:55.687 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:55.682+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:55.697 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:55.692+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:55.758 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:55.750+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:55.951 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:55.943+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:56.159 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:56.150+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:56.376 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:56.371+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:56.500 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:56.493+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:56.653 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:56.648+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:56.695 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:56.685+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:56.696 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:56.688+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:56.758 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:56.752+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:56.971 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:56.965+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:57.188 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:57.182+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:57.386 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:57.381+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:57.461 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:57.455+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:57.661 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:57.655+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:57.704 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:57.697+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:57.704 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:57.699+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:57.739 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:57.733+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:57.981 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:57.976+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:58.239 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:58.233+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:58.401 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:58.395+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:58.419 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:58.412+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:58.689 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:58.684+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:58.713 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:58.707+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:58.721 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:58.709+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:58.787 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:58.781+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:21:58.974 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:21:58.968+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e184 v184) 2019-12-09T18:21:59.006 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:16:20.062 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:21:59.015 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:59.009+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:21:59.061 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:16:20.118 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:21:59.073 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:16:20.130 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:21:59.076 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:16:20.110 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:21:59.078 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:16:20.112 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:21:59.086 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:16:20.143 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:21:59.228 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:21:59.221+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:21:59.253 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:16:20.310 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:21:59.282 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:16:20.316 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:21:59.333 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:16:20.390 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:21:59.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:21:59.419+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:21:59.458 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:21:59.451+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:21:59.733 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:21:59.727+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:21:59.750 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:59.745+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:21:59.752 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:21:59.748+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:21:59.805 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:21:59.800+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:00.001 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:21:59.996+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:00.254 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:00.248+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:00.395 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:00.390+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:00.499 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:00.492+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:00.746 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:00.739+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:00.747 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:00.742+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:00.761 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:00.753+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:00.830 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:00.822+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:00.978 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:00.972+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:01.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:01.220+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:01.429 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:01.424+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:01.531 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:01.526+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:01.721 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:01.714+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:01.722 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:01.717+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:01.822 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:01.811+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:01.862 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:01.856+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:01.934 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:01.929+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:02.231 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:02.224+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:02.412 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:02.405+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:02.517 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:02.511+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:02.713 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:02.706+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:02.714 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:02.709+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:02.813 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:02.806+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:02.818 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:02.811+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:02.902 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:02.896+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:03.222 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:03.215+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:03.424 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:03.419+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:03.569 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:03.562+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:03.726 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:03.718+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:03.727 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:03.721+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:03.772 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:03.765+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:03.797 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:03.787+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:03.874 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:03.868+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:03.982 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:22:03.978+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e184 v184) 2019-12-09T18:22:04.256 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:04.249+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:04.467 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:04.461+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:04.549 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:04.542+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:04.720 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:04.714+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:04.724 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:04.719+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:04.789 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:04.782+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:04.808 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:04.803+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:04.870 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:04.865+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:05.281 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:05.274+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:05.449 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:05.444+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:05.577 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:05.568+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:05.758 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:05.751+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:05.762 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:05.757+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:05.772 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:05.766+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:05.842 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:05.835+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:05.904 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:05.896+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:06.327 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:06.320+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:06.504 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:06.497+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:06.574 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:06.568+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:06.762 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:06.754+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:06.764 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:06.758+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:06.801 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:06.794+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:06.827 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:06.821+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:06.920 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:06.913+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:07.325 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:07.318+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:07.493 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:07.487+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:07.548 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:07.541+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:07.774 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:07.766+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:07.800 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:07.792+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:07.801 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:07.795+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:07.853 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:07.846+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:07.891 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:07.884+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:08.334 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:08.327+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:08.508 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:08.502+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:08.594 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:08.587+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:08.755 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:08.749+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:08.764 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:08.754+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:08.766 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:08.759+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:08.863 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:08.856+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:08.894 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:08.886+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:09.005 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:22:08.996+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e184 v184) 2019-12-09T18:22:09.364 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:09.355+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:09.540 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:09.532+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:09.632 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:09.626+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:09.794 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:09.786+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:09.807 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:09.799+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:09.808 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:09.803+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:09.889 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:09.883+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:09.904 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:09.897+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:10.326 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:10.319+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:10.576 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:10.569+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:10.617 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:10.609+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:10.764 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:10.758+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:10.785 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:10.778+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:10.787 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:10.781+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:10.920 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:10.912+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:10.929 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:10.923+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:11.302 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:11.296+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:11.622 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:11.615+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:11.648 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:11.641+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:11.744 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:11.736+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:11.805 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:11.799+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:11.808 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:11.803+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:11.956 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:11.946+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:11.963 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:11.957+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:12.265 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:12.260+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:12.624 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:12.617+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:12.647 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:12.640+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:12.763 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:12.756+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:12.764 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:12.759+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:12.769 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:12.761+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:12.949 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:12.941+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:12.961 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:12.955+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:13.238 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:13.231+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:13.583 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:13.576+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:13.694 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:13.688+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:13.776 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:13.770+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:13.808 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:13.800+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:13.811 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:13.803+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:13.927 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:13.920+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:13.939 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:13.932+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:14.011 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:22:14.006+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e184 v184) 2019-12-09T18:22:14.287 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:14.282+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:14.607 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:14.600+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:14.720 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:14.713+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:14.746 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:14.738+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:14.768 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:14.757+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:14.769 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:14.759+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:14.938 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:14.930+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:14.987 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:14.982+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:15.289 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:15.284+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:15.646 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:15.640+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:15.681 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:15.672+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:15.732 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:15.725+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:15.733 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:15.728+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:15.745 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:15.738+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:15.957 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:15.949+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:15.961 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:15.954+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:16.298 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:16.291+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:16.642 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:16.635+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:16.692 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:16.685+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:16.732 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:16.726+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:16.736 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:16.732+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:16.741 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:16.734+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:16.939 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:16.930+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:16.978 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:16.971+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:17.335 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:17.328+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:17.663 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:17.656+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:17.720 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:17.712+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:17.742 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:17.734+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:17.784 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:17.777+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:17.785 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:17.780+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:17.915 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:17.908+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:18.009 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:18.001+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:18.300 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:18.293+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:18.684 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:22:18.677+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:40.186353+0000 front 2019-12-09T18:20:39.982688+0000 (oldest deadline 2019-12-09T18:21:24.666806+0000) 2019-12-09T18:22:18.740 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:22:18.733+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.440544+0000 front 2019-12-09T18:20:37.441629+0000 (oldest deadline 2019-12-09T18:21:23.238751+0000) 2019-12-09T18:22:18.743 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:22:18.736+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.932067+0000 front 2019-12-09T18:20:37.589824+0000 (oldest deadline 2019-12-09T18:21:23.422249+0000) 2019-12-09T18:22:18.834 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:18.826+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:21:06.007428+0000 (oldest deadline 2019-12-09T18:21:46.007428+0000) 2019-12-09T18:22:18.835 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:22:18.830+0000 1694f700 -1 osd.6 184 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e182) 2019-12-09T18:22:18.892 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:22:18.886+0000 1694f700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:41.005172+0000 front 2019-12-09T18:20:40.842122+0000 (oldest deadline 2019-12-09T18:21:22.533236+0000) 2019-12-09T18:22:19.011 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:22:19.005+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:37.659201+0000 front 2019-12-09T18:20:38.094092+0000 (oldest deadline 2019-12-09T18:21:21.131488+0000) 2019-12-09T18:22:19.083 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:22:19.077+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e184 v184) 2019-12-09T18:22:19.303 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:22:19.292+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:20:39.466661+0000 front 2019-12-09T18:20:39.501207+0000 (oldest deadline 2019-12-09T18:21:24.719862+0000) 2019-12-09T18:22:42.821 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:17:03.878 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:42.837 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:17:03.871 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:42.838 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:17:03.895 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:42.838 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:17:03.895 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:42.842 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:17:03.877 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:42.844 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:17:03.901 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:42.929 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:17:03.963 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:42.932 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:17:03.989 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:42.965 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:17:04.018 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:44.928 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:17:05.985 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:44.948 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:17:06.005 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:44.970 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:17:06.002 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:44.985 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:17:06.042 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:45.017 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:17:06.051 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:45.053 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:17:06.073 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:45.110 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:17:06.167 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:45.111 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:17:06.168 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:22:45.134 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:17:06.191 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:23:43.418 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:43.413+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:44.238 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:44.232+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:44.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:44.420+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:44.443 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:44.438+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:45.174 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:45.170+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:45.211 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:45.206+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:45.423 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:45.417+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:45.462 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:45.456+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:45.723 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:45.717+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:46.208 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:46.203+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:46.217 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:46.211+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:46.258 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:46.252+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:46.378 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:46.372+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:46.424 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:46.416+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:46.737 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:46.731+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:47.182 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:47.176+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:47.227 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:47.223+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:47.234 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:47.228+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:47.355 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:47.350+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:47.405 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:47.399+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:47.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:47.702+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:48.179 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:23:48.173+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:23:48.188 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:48.183+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:48.189 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:48.184+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:48.248 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:48.241+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:48.373 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:48.364+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:48.402 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:48.397+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:48.697 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:48.692+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:49.138 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:23:49.133+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:23:49.171 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:49.166+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:49.215 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:49.210+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:49.287 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:49.281+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:49.346 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:49.341+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:49.409 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:49.401+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:49.725 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:49.719+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:50.101 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:23:50.096+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:23:50.192 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:50.188+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:50.224 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:50.218+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:50.315 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:50.309+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:50.331 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:50.325+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:50.430 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:50.425+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:50.744 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:50.738+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:51.085 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:23:51.080+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:23:51.156 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:51.151+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:51.224 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:51.219+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:51.285 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:51.281+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:51.354 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:51.348+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:51.429 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:51.418+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:51.756 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:51.751+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:52.105 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:23:52.098+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:23:52.162 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:52.157+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:52.248 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:52.241+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:52.332 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:52.327+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:52.382 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:52.377+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:52.433 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:52.428+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:52.803 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:52.798+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:53.118 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:23:53.113+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:23:53.144 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:53.138+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:53.283 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:53.277+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:53.302 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:53.296+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:53.396 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:53.391+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:53.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:53.477+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:53.786 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:53.780+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:54.127 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:54.121+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:54.163 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:23:54.158+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:23:54.243 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:54.236+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:54.259 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:54.254+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:54.416 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:54.411+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:54.518 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:54.513+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:54.788 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:54.782+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:55.154 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:55.149+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:55.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:23:55.204+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:23:55.226 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:55.221+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:55.308 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:55.302+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:55.436 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:55.428+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:55.489 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:55.483+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:55.794 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:55.789+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:56.201 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:56.196+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:56.231 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:56.225+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:56.234 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:23:56.228+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:23:56.318 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:56.313+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:56.445 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:56.439+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:56.488 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:56.482+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:56.847 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:56.841+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:57.193 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:57.187+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:57.197 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:23:57.192+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:23:57.247 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:57.241+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:57.371 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:57.366+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:57.413 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:57.408+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:57.496 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:57.491+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:57.816 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:57.810+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:58.156 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:23:58.151+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:23:58.226 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:58.219+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:58.234 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:58.229+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:58.373 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:58.364+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:58.382 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:58.376+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:58.510 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:58.504+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:58.857 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:58.851+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:23:59.137 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:23:59.131+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:23:59.221 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:23:59.208+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:23:59.228 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:23:59.217+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:23:59.349 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:23:59.344+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:23:59.414 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:23:59.408+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:23:59.531 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:23:59.526+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:23:59.891 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:23:59.886+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:00.135 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:00.128+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:00.210 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:00.205+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:00.265 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:00.260+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:00.333 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:00.328+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:00.385 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:00.379+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:00.576 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:00.571+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:00.933 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:00.927+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:01.156 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:01.150+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:01.244 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:01.239+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:01.257 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:01.251+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:01.337 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:01.331+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:01.424 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:01.416+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:01.625 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:01.619+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:01.891 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:01.885+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:02.204 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:02.199+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:02.244 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:02.237+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:02.288 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:02.283+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:02.371 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:02.364+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:02.411 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:02.402+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:02.653 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:02.647+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:02.867 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:02.862+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:03.188 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:03.179+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:03.283 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:03.278+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:03.314 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:03.303+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:03.372 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:03.367+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:03.408 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:03.403+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:03.651 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:03.646+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:03.830 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:03.826+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:04.219 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:04.213+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:04.259 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:04.254+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:04.349 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:04.343+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:04.414 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:04.403+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:04.460 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:04.454+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:04.683 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:04.678+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:04.819 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:04.813+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:05.205 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:05.200+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:05.213 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:05.209+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:05.357 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:05.352+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:05.443 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:05.438+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:05.468 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:05.461+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:05.682 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:05.676+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:05.860 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:05.856+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:06.169 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:06.163+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:06.175 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:06.171+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:06.390 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:06.385+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:06.423 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:06.417+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:06.491 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:06.485+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:06.703 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:06.697+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:06.848 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:06.843+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:07.148 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:07.141+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:07.220 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:07.214+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:07.383 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:07.378+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:07.437 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:07.426+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:07.469 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:07.462+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:07.697 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:07.692+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:07.905 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:07.899+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:08.192 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:08.186+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:08.242 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:08.236+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:08.380 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:08.374+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:08.392 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:08.386+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:08.508 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:08.503+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:08.752 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:08.744+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:08.894 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:08.889+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:09.201 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:09.196+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:09.242 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:09.237+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:09.364 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:09.357+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:09.376 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:09.366+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:09.558 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:09.553+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:09.799 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:09.793+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:09.862 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:09.857+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:10.184 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:10.176+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:10.231 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:10.226+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:10.337 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:10.329+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:10.343 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:10.338+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:10.595 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:10.589+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:10.789 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:10.783+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:10.837 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:10.833+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:11.194 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:11.188+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:11.262 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:11.257+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:11.310 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:11.304+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:11.375 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:11.370+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:11.648 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:11.642+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:11.785 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:11.779+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:11.867 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:11.861+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:12.228 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:12.222+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:12.270 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:12.264+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:12.286 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:12.281+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:12.346 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:12.340+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:12.673 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:12.666+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:12.791 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:12.785+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:12.866 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:12.861+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:13.230 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:13.224+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:13.286 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:13.280+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:13.321 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:13.315+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:13.328 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:13.322+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:13.701 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:13.695+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:13.812 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:13.806+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:13.910 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:13.904+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:14.199 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:14.193+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:14.265 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:14.260+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:24:14.289 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:14.283+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:14.328 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:14.320+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:14.694 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:24:14.687+0000 1694f700 -1 osd.2 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.051391+0000 front 2019-12-09T18:23:01.050477+0000 (oldest deadline 2019-12-09T18:23:43.826416+0000) 2019-12-09T18:24:14.825 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:24:14.819+0000 1694f700 -1 osd.3 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.915562+0000 front 2019-12-09T18:23:03.202013+0000 (oldest deadline 2019-12-09T18:23:42.583208+0000) 2019-12-09T18:24:14.876 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:24:14.870+0000 1694f700 -1 osd.1 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.438305+0000 front 2019-12-09T18:23:00.859776+0000 (oldest deadline 2019-12-09T18:23:45.149432+0000) 2019-12-09T18:24:15.153 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:24:15.147+0000 1694f700 -1 osd.5 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:02.430724+0000 front 2019-12-09T18:23:02.472132+0000 (oldest deadline 2019-12-09T18:23:47.992323+0000) 2019-12-09T18:24:15.200 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:24:15.193+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 43sec e189 v189) 2019-12-09T18:24:15.272 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:24:15.266+0000 1694f700 -1 osd.7 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:00.284241+0000 front 2019-12-09T18:23:00.283338+0000 (oldest deadline 2019-12-09T18:23:46.131003+0000) 2019-12-09T18:24:15.294 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:24:15.282+0000 1694f700 -1 osd.4 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:22:59.205593+0000 front 2019-12-09T18:22:59.206676+0000 (oldest deadline 2019-12-09T18:23:44.941859+0000) 2019-12-09T18:24:15.317 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:24:15.311+0000 1694f700 -1 osd.0 189 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:23:01.966783+0000 front 2019-12-09T18:23:02.160736+0000 (oldest deadline 2019-12-09T18:23:43.619103+0000) 2019-12-09T18:25:14.046 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:14.041+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:14.184 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:14.178+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:14.269 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:14.263+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:14.388 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:14.381+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:15.004 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:14.997+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:15.173 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:15.165+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:15.241 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:15.236+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:15.392 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:15.386+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:15.469 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:15.463+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:16.027 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:16.019+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:16.161 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:16.154+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:16.201 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:16.196+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:16.429 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:16.423+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:16.430 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:16.423+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:16.440 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:16.431+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:17.022 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:17.016+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:17.199 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:17.191+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:17.225 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:17.217+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:17.394 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:17.388+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:17.422 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:17.416+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:17.434 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:17.428+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:18.061 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:18.056+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:18.215 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:18.209+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:18.244 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:18.239+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:18.404 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:18.397+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:18.473 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:18.466+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:18.480 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:18.475+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:19.102 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:19.096+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:19.214 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:19.207+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:19.241 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:19.235+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:19.455 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:19.447+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:19.476 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:19.469+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:19.503 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:19.497+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:20.098 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:20.090+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:20.217 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:20.210+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:20.255 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:20.247+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:20.442 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:20.435+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:20.472 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:20.464+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:20.481 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:20.473+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:21.087 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:21.080+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:21.184 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:21.178+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:21.216 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:21.210+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:21.463 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:21.456+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:21.487 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:21.479+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:21.517 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:21.510+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:22.094 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:22.086+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:22.141 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:22.134+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:22.188 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:22.180+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:22.423 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:22.416+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:22.488 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:22.470+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:22.535 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:22.528+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:23.052 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:23.045+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:23.107 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:23.100+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:23.230 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:23.223+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:23.426 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:23.420+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:23.508 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:23.500+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:23.568 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:23.561+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:24.042 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:24.036+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:24.130 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:24.123+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:24.199 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:24.192+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:24.437 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:24.430+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:24.512 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:24.505+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:24.625 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:24.614+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:25.016 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:25.009+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:25.170 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:25.164+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:25.206 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:25.201+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:25.249 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:25.243+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:25.402 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:25.397+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:25.493 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:25.487+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:25.618 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:25.613+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:26.035 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:26.028+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:26.148 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:26.141+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:26.214 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:26.209+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:26.226 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:26.219+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:26.365 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:26.358+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:26.510 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:26.504+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:26.649 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:26.641+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:27.027 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:27.020+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:27.116 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:27.109+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:27.255 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:27.249+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:27.280 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:27.274+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:27.406 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:27.400+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:27.476 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:27.470+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:27.619 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:27.612+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:28.039 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:28.030+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:28.144 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:28.137+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:28.266 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:28.260+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:28.278 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:28.270+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:28.431 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:28.425+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:28.433 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:28.425+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:28.666 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:28.661+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:29.025 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:29.018+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:29.134 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:29.127+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:29.255 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:29.249+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:29.285 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:29.280+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:29.393 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:29.387+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:29.412 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:29.405+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:29.643 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:29.636+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:30.046 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:30.040+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:30.180 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:30.160+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:30.219 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:30.211+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:30.248 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:30.243+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:30.450 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:30.442+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:30.461 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:30.455+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:30.657 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:30.650+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:31.084 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:31.077+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:31.178 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:31.171+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:31.266 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:31.260+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:31.266 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:31.261+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:31.466 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:31.458+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:31.480 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:31.471+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:31.691 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:31.683+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:32.047 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:32.041+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:32.155 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:32.148+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:32.265 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:32.259+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:32.284 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:32.276+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:32.286 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:32.280+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:32.446 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:32.440+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:32.529 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:32.522+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:32.648 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:32.641+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:33.083 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:33.075+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:33.195 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:33.188+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:33.264 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:33.256+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:33.265 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:33.260+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:33.273 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:33.266+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:33.432 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:33.426+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:33.528 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:33.522+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:33.621 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:33.615+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:34.078 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:34.072+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:34.247 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:34.241+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:34.269 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:34.262+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:34.271 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:34.265+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:34.284 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:34.277+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:34.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:34.419+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:34.501 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:34.495+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:34.651 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:34.645+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:35.111 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:35.104+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:35.226 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:35.218+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:35.227 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:35.221+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:35.240 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:35.233+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:35.294 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:35.289+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:35.401 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:35.395+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:35.508 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:35.501+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:35.629 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:35.621+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:36.111 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:36.104+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:36.226 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:36.219+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:36.268 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:36.261+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:36.270 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:36.264+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:36.334 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:36.327+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:36.372 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:36.364+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:36.475 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:36.469+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:36.661 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:36.655+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:37.159 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:37.152+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:37.275 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:37.268+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:37.312 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:37.304+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:37.312 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:37.307+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:37.379 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:37.373+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:37.381 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:37.373+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:37.499 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:37.490+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:37.694 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:37.688+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:38.203 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:38.196+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:38.306 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:38.299+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:38.362 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:38.356+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:38.366 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:38.361+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:38.382 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:38.375+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:38.429 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:38.422+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:38.550 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:38.543+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:38.704 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:38.696+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:39.211 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:39.205+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:39.326 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:39.318+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:39.332 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:39.326+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:39.335 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:39.330+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:39.364 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:39.358+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:39.445 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:39.439+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:39.580 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:39.573+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:39.697 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:39.690+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:40.205 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:40.197+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:40.330 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:40.323+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:40.359 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:40.352+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:40.361 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:40.355+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:40.402 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:40.396+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:40.428 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:40.422+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:40.552 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:40.538+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:40.679 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:40.673+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:41.254 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:41.248+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:41.323 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:41.316+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:41.324 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:41.319+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:41.359 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:41.352+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:41.418 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:41.405+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:41.428 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:41.421+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:41.512 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:41.503+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:41.678 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:41.671+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:42.304 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:42.298+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:42.322 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:42.314+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:42.323 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:42.318+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:42.369 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:42.364+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:42.405 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:42.399+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:42.412 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:42.405+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:42.559 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:42.552+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:42.683 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:42.677+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:43.340 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:43.330+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:43.344 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:43.339+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:43.365 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:43.357+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:43.366 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:43.360+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:43.385 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:43.374+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:43.462 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:43.452+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:43.572 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:43.567+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:43.712 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:43.706+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:44.314 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:44.306+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:44.342 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:44.336+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:44.344 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:44.338+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:44.346 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:44.341+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:44.412 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:44.406+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:44.436 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:44.429+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:44.555 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:44.548+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:44.740 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:44.731+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:45.309 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:45.304+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:45.351 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:45.346+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:45.356 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:45.349+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:45.357 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:45.352+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:45.365 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:45.360+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:45.437 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:45.430+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:45.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:45.511+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:45.544 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:25:45.536+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e194 v194) 2019-12-09T18:25:45.714 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:45.707+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:46.326 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:46.320+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:46.357 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:46.350+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:46.363 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:46.356+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:46.364 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:46.359+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:46.380 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:46.375+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:46.475 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:46.468+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:46.480 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:46.474+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:46.689 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:46.682+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:47.342 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:47.337+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:47.392 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:47.386+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:47.401 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:47.396+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:47.406 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:47.397+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:47.408 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:47.401+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:47.462 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:47.455+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:47.527 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:47.520+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:47.711 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:47.704+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:48.330 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:48.324+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:48.384 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:48.378+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:48.392 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:48.385+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:48.457 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:48.443+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:48.457 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:48.447+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:48.486 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:48.479+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:48.501 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:48.494+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:48.688 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:48.681+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:49.342 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:49.337+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:49.371 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:49.365+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:49.391 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:49.386+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:49.416 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:49.409+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:49.417 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:49.412+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:49.527 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:49.520+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:49.538 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:49.532+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:49.726 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:49.718+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:50.367 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:50.362+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:50.395 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:50.390+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:50.404 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:50.396+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:50.405 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:50.399+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:50.415 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:50.409+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:50.482 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:50.475+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:50.507 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:50.501+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:50.550 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:25:50.546+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e194 v194) 2019-12-09T18:25:50.756 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:50.749+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:51.353 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:51.345+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:51.368 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:51.362+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:51.374 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:51.366+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:51.378 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:51.373+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:51.406 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:51.400+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:51.513 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:51.506+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:51.518 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:51.511+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:51.804 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:51.798+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:52.309 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:52.302+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:52.361 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:52.351+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:52.412 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:52.405+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:52.414 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:52.408+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:52.419 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:52.412+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:52.475 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:52.468+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:52.556 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:52.549+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:52.842 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:52.835+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:53.328 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:53.322+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:53.330 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:53.324+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:53.438 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:53.430+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:53.439 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:53.434+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:53.441 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:53.434+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:53.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:53.508+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:53.573 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:53.567+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:53.802 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:53.794+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:54.284 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:54.279+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:54.327 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:54.320+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:54.412 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:54.403+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:54.493 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:54.471+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:54.494 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:54.474+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:54.497 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:54.488+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:54.592 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:54.586+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:54.797 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:54.791+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:55.318 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:55.313+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:55.364 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:55.358+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:55.376 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:55.370+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:55.455 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:55.448+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:55.456 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:55.451+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:55.544 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:55.537+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:55.576 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:25:55.565+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e194 v194) 2019-12-09T18:25:55.631 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:55.624+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:55.840 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:55.834+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:56.274 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:56.268+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:56.328 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:56.323+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:56.344 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:56.338+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:56.414 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:56.408+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:56.416 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:56.410+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:56.597 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:56.591+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:56.614 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:56.608+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:56.886 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:56.880+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:57.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:57.225+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:57.285 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:57.280+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:57.371 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:57.365+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:57.399 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:57.391+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:57.402 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:57.396+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:57.562 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:57.557+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:57.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:57.621+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:57.883 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:57.876+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:58.232 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:58.226+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:58.325 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:58.319+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:58.365 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:58.359+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:58.378 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:58.372+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:58.382 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:58.377+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:58.550 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:58.544+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:58.669 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:58.661+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:58.905 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:58.898+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:25:59.186 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:25:59.181+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:25:59.298 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:25:59.292+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:25:59.324 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:25:59.317+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:25:59.406 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:59.399+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:25:59.406 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:25:59.401+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:25:59.565 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:25:59.558+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:25:59.692 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:25:59.686+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:25:59.865 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:25:59.859+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:26:00.177 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:26:00.168+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:26:00.285 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:26:00.279+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:26:00.308 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:26:00.302+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:26:00.392 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:00.387+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:26:00.395 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:00.391+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:26:00.523 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:26:00.518+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:26:00.590 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:26:00.582+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e194 v194) 2019-12-09T18:26:00.645 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:26:00.639+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:26:00.829 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:26:00.821+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:26:01.207 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:26:01.202+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:26:01.240 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:26:01.235+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:26:01.332 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:26:01.327+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:26:01.365 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:01.354+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:26:01.365 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:01.359+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:26:01.484 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:26:01.477+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:26:01.602 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:26:01.596+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:26:01.787 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:26:01.780+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:26:02.243 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:26:02.237+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:26:02.279 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:26:02.273+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:26:02.325 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:26:02.318+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:26:02.360 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:02.346+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:26:02.366 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:02.350+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:26:02.450 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:26:02.443+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:26:02.630 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:26:02.624+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:26:02.829 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:26:02.823+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:26:03.227 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:26:03.222+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:26:03.309 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:26:03.303+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:26:03.310 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:26:03.304+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:26:03.392 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:03.384+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:26:03.393 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:03.388+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:26:03.479 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:26:03.470+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:26:03.678 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:26:03.672+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:26:03.813 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:26:03.804+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:26:04.250 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:26:04.242+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:26:04.276 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:26:04.269+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:26:04.338 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:26:04.331+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:26:04.369 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:04.362+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:26:04.373 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:04.368+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:26:04.444 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:26:04.438+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:26:04.697 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:26:04.690+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:26:04.850 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:26:04.844+0000 1694f700 -1 osd.4 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.247756+0000 front 2019-12-09T18:24:29.240834+0000 (oldest deadline 2019-12-09T18:25:15.121379+0000) 2019-12-09T18:26:05.257 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:26:05.250+0000 1694f700 -1 osd.2 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.963345+0000 front 2019-12-09T18:24:28.758013+0000 (oldest deadline 2019-12-09T18:25:13.408176+0000) 2019-12-09T18:26:05.289 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:26:05.284+0000 1694f700 -1 osd.3 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:31.871461+0000 front 2019-12-09T18:24:31.898116+0000 (oldest deadline 2019-12-09T18:25:15.847356+0000) 2019-12-09T18:26:05.345 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:26:05.340+0000 1694f700 -1 osd.1 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.016666+0000 front 2019-12-09T18:24:28.846377+0000 (oldest deadline 2019-12-09T18:25:13.530160+0000) 2019-12-09T18:26:05.420 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:05.412+0000 1694f700 -1 osd.6 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:24:52.013675+0000 (oldest deadline 2019-12-09T18:25:32.013675+0000) 2019-12-09T18:26:05.421 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:05.415+0000 1694f700 -1 osd.6 194 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:26:05.459 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:26:05.453+0000 1694f700 -1 osd.7 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:28.708660+0000 front 2019-12-09T18:24:28.405505+0000 (oldest deadline 2019-12-09T18:25:13.685446+0000) 2019-12-09T18:26:05.648 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:26:05.643+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e194 v194) 2019-12-09T18:26:05.702 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:26:05.695+0000 1694f700 -1 osd.5 194 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:24:29.566725+0000 front 2019-12-09T18:24:29.511222+0000 (oldest deadline 2019-12-09T18:25:13.570765+0000) 2019-12-09T18:26:06.445 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:26:06.393+0000 1694f700 -1 osd.6 195 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e193) 2019-12-09T18:26:28.004 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:26:27.909+0000 21852700 -1 reset not still connected to 0xed81c80 2019-12-09T18:26:28.049 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:26:27.910+0000 21852700 -1 reset not still connected to 0x1cf1ee80 2019-12-09T18:26:28.050 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:26:27.910+0000 21852700 -1 reset not still connected to 0xed81c80 2019-12-09T18:26:35.221 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:26:35.139+0000 36790700 -1 osd.0 199 build_incremental_map_msg missing incremental map 199 2019-12-09T18:26:36.347 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:26:36.304+0000 32f89700 -1 osd.0 199 build_incremental_map_msg missing incremental map 199 2019-12-09T18:26:37.723 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:20:58.780 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:37.732 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:20:58.788 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:37.741 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:20:58.798 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:37.744 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:20:58.778 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:37.746 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:20:58.804 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:37.748 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:20:58.782 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:38.028 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:20:59.085 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:38.038 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:20:59.071 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:38.063 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:20:59.120 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:27:33.453 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:33.447+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:33.832 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:33.824+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:33.841 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:33.833+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:33.965 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:33.958+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:34.480 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:34.473+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:34.801 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:34.795+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:34.853 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:34.846+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:34.870 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:34.862+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:34.957 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:34.948+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:35.504 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:35.497+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:35.795 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:35.790+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:35.827 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:35.821+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:35.832 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:35.825+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:35.847 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:35.841+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:36.004 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:35.997+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:36.556 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:36.546+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:36.765 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:36.760+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:36.770 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:36.765+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:36.810 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:36.803+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:36.837 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:36.831+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:36.886 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:36.879+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:37.000 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:36.994+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:37.519 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:37.513+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:37.766 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:37.760+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:37.784 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:37.777+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:37.823 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:37.816+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:37.836 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:37.830+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:37.878 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:37.873+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:38.030 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:38.025+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:38.479 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:38.473+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:38.737 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:38.732+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:38.813 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:38.807+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:38.818 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:38.813+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:38.860 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:38.854+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:38.886 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:38.879+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:39.071 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:39.065+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:39.527 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:39.521+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:39.707 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:39.702+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:39.848 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:39.843+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:39.860 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:39.854+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:39.870 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:39.864+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:39.876 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:39.870+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:40.086 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:40.081+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:40.525 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:40.519+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:40.667 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:40.660+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:40.816 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:40.811+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:40.846 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:40.839+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:40.882 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:40.876+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:40.915 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:40.908+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:41.055 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:41.050+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:41.522 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:41.515+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:41.677 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:41.672+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:41.785 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:41.780+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:41.851 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:41.844+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:41.861 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:41.854+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:41.912 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:41.905+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:42.022 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:42.017+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:42.488 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:42.481+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:42.710 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:42.705+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:42.801 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:42.795+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:42.829 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:42.822+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:42.859 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:42.852+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:42.924 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:42.916+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:43.028 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:43.022+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:43.474 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:43.468+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:43.704 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:43.696+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:43.832 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:43.826+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:43.846 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:43.840+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:43.894 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:43.887+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:43.898 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:43.892+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:44.052 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:44.046+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:44.513 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:44.506+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:44.723 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:44.716+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:44.837 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:44.830+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:44.885 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:44.880+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:44.944 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:44.936+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:44.945 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:44.937+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:45.020 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:45.015+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:45.500 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:45.493+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:45.773 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:45.768+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:45.879 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:45.873+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:45.895 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:45.889+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:45.900 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:45.893+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:45.953 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:45.944+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:45.988 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:45.982+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:46.502 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:46.495+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:46.765 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:46.759+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:46.875 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:46.869+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:46.879 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:46.873+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:46.918 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:46.912+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:46.940 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:46.932+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:47.034 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:47.029+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:47.480 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:47.475+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:47.767 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:47.762+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:47.883 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:47.877+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:47.929 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:47.920+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:47.960 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:47.952+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:47.971 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:47.960+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:48.087 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:48.081+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:48.502 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:48.496+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:48.790 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:48.781+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:48.865 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:48.859+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:48.949 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:48.932+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:48.953 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:48.946+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:48.974 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:48.968+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:49.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:49.055+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:49.543 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:49.537+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:49.819 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:49.810+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:49.896 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:49.890+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:49.902 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:49.897+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:49.972 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:49.965+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:50.012 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:50.006+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:50.060 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:50.053+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:50.542 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:50.536+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:50.854 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:50.848+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:50.931 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:50.926+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:50.940 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:50.933+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:50.958 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:50.952+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:51.009 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:51.003+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:51.080 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:51.075+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:51.511 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:51.506+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:51.854 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:51.848+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:51.903 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:51.898+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:51.910 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:51.904+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:51.956 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:51.949+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:52.013 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:52.008+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:52.063 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:52.057+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:52.536 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:52.531+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:52.829 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:52.822+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:52.873 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:52.865+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:52.903 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:52.898+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:52.959 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:52.954+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:53.026 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:53.018+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:53.100 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:53.095+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:53.562 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:53.556+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:53.857 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:53.849+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:53.908 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:53.902+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:53.915 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:53.910+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:53.994 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:53.988+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:54.048 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:54.042+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:54.069 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:54.064+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:54.557 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:54.553+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:54.811 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:54.806+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:54.954 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:54.948+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:54.963 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:54.957+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:55.022 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:55.017+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:55.052 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:55.047+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:55.068 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:55.063+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:55.603 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:55.597+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:55.824 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:55.819+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:55.988 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:55.976+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:55.991 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:55.987+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:55.997 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:55.991+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:56.044 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:56.039+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:56.106 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:27:56.100+0000 1694f700 -1 osd.5 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.510333+0000 front 2019-12-09T18:26:53.637393+0000 (oldest deadline 2019-12-09T18:27:32.995558+0000) 2019-12-09T18:27:56.656 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:56.650+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:56.803 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:56.798+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:56.958 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:56.953+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:56.965 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:56.956+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:56.991 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:56.986+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:57.064 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:57.058+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:57.642 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:57.636+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:57.850 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:57.844+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:57.938 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:57.933+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:57.951 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:57.945+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:57.999 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:57.993+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:58.105 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:58.100+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:58.641 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:58.626+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:58.857 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:58.851+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:58.924 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:58.919+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:58.937 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:58.931+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:58.952 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:58.947+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:27:59.097 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:27:59.092+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:27:59.601 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:27:59.596+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:27:59.842 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:27:59.836+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:27:59.929 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:27:59.924+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:27:59.939 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:27:59.932+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:27:59.943 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:27:59.937+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:28:00.144 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:28:00.138+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:28:00.651 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:28:00.645+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:28:00.889 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:28:00.882+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:28:00.897 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:28:00.892+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:28:00.901 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:28:00.896+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:28:00.961 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:28:00.955+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:28:01.180 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:28:01.175+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:28:01.614 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:28:01.609+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:28:01.876 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:28:01.870+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:28:01.921 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:28:01.917+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:28:01.950 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:28:01.943+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:28:02.014 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:28:02.008+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:28:02.172 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:28:02.168+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:28:02.659 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:28:02.654+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:28:02.911 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:28:02.906+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:28:02.920 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:28:02.915+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:28:02.952 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:28:02.945+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:28:03.020 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:28:03.014+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:28:03.185 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:28:03.177+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:28:03.661 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:28:03.655+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:28:03.892 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:28:03.887+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:28:03.921 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:28:03.914+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:28:03.993 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:28:03.987+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:28:04.076 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:28:04.069+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:28:04.160 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:28:04.155+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:28:04.636 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:28:04.629+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:28:04.906 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:28:04.901+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:28:04.940 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:28:04.935+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:28:05.013 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:28:05.006+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:28:05.050 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:28:05.045+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:28:05.128 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:28:05.122+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:28:05.651 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:28:05.646+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:28:05.929 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:28:05.920+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:28:05.936 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:28:05.927+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:28:06.005 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:28:05.998+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:28:06.038 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:28:06.032+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e199 v199) 2019-12-09T18:28:06.087 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:28:06.081+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:28:06.099 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:28:06.092+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:28:06.625 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:28:06.619+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:28:06.973 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:28:06.962+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:28:06.985 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:28:06.969+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:28:06.993 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:28:06.988+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:28:07.078 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:28:07.072+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:28:07.143 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:28:07.137+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:28:07.579 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:28:07.574+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:28:07.922 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:28:07.916+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:28:07.981 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:28:07.976+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:28:08.031 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:28:08.026+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:28:08.060 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:28:08.055+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:28:08.147 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:28:08.142+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:28:08.549 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:28:08.544+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:28:08.900 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:28:08.895+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:28:08.982 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:28:08.976+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:28:09.015 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:28:09.008+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:28:09.073 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:28:09.068+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:28:09.131 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:28:09.127+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:28:09.569 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:28:09.563+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:28:09.893 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:28:09.887+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:28:09.987 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:28:09.982+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:28:09.992 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:28:09.986+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:28:10.063 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:28:10.057+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:28:10.150 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:28:10.145+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:28:10.575 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:28:10.571+0000 1694f700 -1 osd.3 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.976526+0000 front 2019-12-09T18:26:48.978556+0000 (oldest deadline 2019-12-09T18:27:32.900004+0000) 2019-12-09T18:28:10.879 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:28:10.874+0000 1694f700 -1 osd.7 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:52.987653+0000 front 2019-12-09T18:26:53.097368+0000 (oldest deadline 2019-12-09T18:27:35.784789+0000) 2019-12-09T18:28:10.957 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:28:10.952+0000 1694f700 -1 osd.2 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:53.634917+0000 front 2019-12-09T18:26:53.510091+0000 (oldest deadline 2019-12-09T18:27:33.651532+0000) 2019-12-09T18:28:10.965 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:28:10.958+0000 1694f700 -1 osd.4 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:51.265424+0000 front 2019-12-09T18:26:51.018894+0000 (oldest deadline 2019-12-09T18:27:35.089505+0000) 2019-12-09T18:28:11.086 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:28:11.075+0000 1694f700 -1 osd.0 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:48.425744+0000 front 2019-12-09T18:26:53.680204+0000 (oldest deadline 2019-12-09T18:27:32.975432+0000) 2019-12-09T18:28:11.127 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:28:11.114+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e199 v199) 2019-12-09T18:28:11.183 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:28:11.178+0000 1694f700 -1 osd.1 199 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:26:49.560681+0000 front 2019-12-09T18:26:50.036551+0000 (oldest deadline 2019-12-09T18:27:34.161628+0000) 2019-12-09T18:28:41.411 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:28:41.406+0000 1694f700 -1 osd.7 201 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:109936 5.9 5:93e5b521:::notify.7:head [watch reconnect cookie 822144816 gen 64] snapc 0=[] ondisk+write+known_if_redirected e200) 2019-12-09T18:28:48.410 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:28:48.403+0000 3578e700 -1 osd.6 204 build_incremental_map_msg missing incremental map 204 2019-12-09T18:28:48.532 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:28:48.509+0000 35f8f700 -1 osd.6 204 build_incremental_map_msg missing incremental map 204 2019-12-09T18:28:48.562 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:28:48.548+0000 36790700 -1 osd.6 204 build_incremental_map_msg missing incremental map 204 2019-12-09T18:28:48.937 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:28:48.892+0000 36790700 -1 osd.6 204 build_incremental_map_msg missing incremental map 204 2019-12-09T18:28:51.290 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:28:51.277+0000 34f8d700 -1 osd.6 206 build_incremental_map_msg missing incremental map 204 2019-12-09T18:29:11.428 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:11.423+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:11.532 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:11.523+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:11.559 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:11.554+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:12.454 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:12.448+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:12.534 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:12.528+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:12.547 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:12.542+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:12.992 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:12.984+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:13.312 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:13.305+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:13.459 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:13.453+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:13.539 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:13.533+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:13.584 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:13.577+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:13.688 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:13.678+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:13.992 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:13.986+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:14.300 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:14.293+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:14.430 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:14.424+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:14.513 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:14.508+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:14.567 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:14.562+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:14.654 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:14.647+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:14.964 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:14.957+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:15.308 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:15.301+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:15.389 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:15.384+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:15.469 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:15.463+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:15.554 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:15.548+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:15.615 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:15.610+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:15.961 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:15.954+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:16.332 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:16.325+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:16.407 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:16.402+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:16.464 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:16.459+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:16.523 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:16.516+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:16.598 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:16.592+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:16.997 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:16.987+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:17.319 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:17.313+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:17.377 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:17.369+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:17.444 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:17.438+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:17.480 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:17.473+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:17.591 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:17.586+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:17.978 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:17.971+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:18.303 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:18.296+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:18.360 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:18.355+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:18.410 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:18.403+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:18.466 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:18.459+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:18.475 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:18.468+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:18.575 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:18.570+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:18.959 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:18.952+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:19.322 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:19.318+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:19.355 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:19.348+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:19.423 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:19.418+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:19.464 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:19.457+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:19.522 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:19.515+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:19.622 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:19.616+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:19.986 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:19.979+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:20.306 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:20.301+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:20.380 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:20.373+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:20.387 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:20.379+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:20.490 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:20.483+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:20.546 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:20.541+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:20.628 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:20.623+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:21.019 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:21.013+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:21.283 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:21.277+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:21.405 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:21.398+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:21.408 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:21.402+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:21.514 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:21.508+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:21.568 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:21.563+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:21.645 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:21.640+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:22.043 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:22.036+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:22.339 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:22.334+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:22.363 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:22.357+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:22.397 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:22.383+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:22.481 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:22.474+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:22.575 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:22.568+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:22.612 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:22.606+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:23.008 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:23.000+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:23.367 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:23.362+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:23.373 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:23.367+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:23.384 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:23.378+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:23.479 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:23.472+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:23.597 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:23.592+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:23.600 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:23.595+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:24.044 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:24.037+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:24.361 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:24.355+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:24.371 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:24.366+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:24.408 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:24.403+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:24.480 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:24.473+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:24.559 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:24.554+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:24.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:24.613+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:25.014 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:25.007+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:25.340 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:25.334+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:25.342 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:25.338+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:25.370 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:25.363+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:25.436 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:25.431+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:25.447 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:25.439+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:25.566 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:25.561+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:25.596 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:25.590+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:25.984 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:25.978+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:26.334 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:26.324+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:26.338 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:26.333+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:26.419 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:26.413+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:26.420 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:26.415+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:26.445 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:26.439+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:26.527 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:26.522+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:26.627 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:26.621+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:27.031 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:27.024+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:27.311 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:27.304+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:27.312 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:27.307+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:27.388 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:27.381+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:27.404 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:27.398+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:27.461 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:27.454+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:27.504 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:27.498+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:27.620 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:27.614+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:28.048 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:28.039+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:28.312 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:28.306+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:28.316 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:28.312+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:28.376 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:28.369+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:28.397 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:28.392+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:28.419 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:28.413+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:28.524 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:28.509+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:28.578 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:28.572+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:29.059 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:29.052+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:29.313 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:29.305+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:29.315 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:29.309+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:29.347 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:29.340+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:29.394 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:29.388+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:29.422 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:29.415+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:29.551 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:29.546+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:29.600 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:29.595+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:30.074 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:30.067+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:30.333 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:30.327+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:30.349 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:30.343+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:30.352 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:30.348+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:30.370 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:30.364+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:30.439 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:30.433+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:30.536 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:30.530+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:30.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:30.613+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:31.095 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:31.088+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:31.312 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:31.304+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:31.313 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:31.307+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:31.323 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:31.317+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:31.420 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:31.413+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:31.423 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:31.416+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:31.511 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:31.506+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:31.651 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:31.646+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:32.068 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:32.062+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:32.276 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:32.269+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:32.280 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:32.274+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:32.334 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:32.327+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:32.408 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:32.400+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:32.410 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:32.403+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:32.519 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:32.514+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:32.645 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:32.639+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:33.096 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:33.089+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:33.276 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:33.264+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:33.279 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:33.267+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:33.339 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:33.330+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:33.364 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:33.358+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:33.385 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:33.378+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:33.545 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:33.537+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:33.652 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:33.646+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:34.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:34.053+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:34.275 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:34.267+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:34.276 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:34.271+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:34.325 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:34.318+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:34.349 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:34.339+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:34.362 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:34.345+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:34.576 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:34.571+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:34.634 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:34.628+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:35.091 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:35.082+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:35.271 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:35.263+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:35.272 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:35.267+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:35.345 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:35.339+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:35.367 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:35.362+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:35.394 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:35.387+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:35.561 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:35.555+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:35.598 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:35.593+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:36.094 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:36.083+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:36.312 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:36.306+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:36.324 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:36.318+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:36.328 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:36.323+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:36.369 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:36.362+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:36.395 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:36.390+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:36.577 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:36.572+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:36.626 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:36.620+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:37.128 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:37.120+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:37.321 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:37.315+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:37.347 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:37.339+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:37.347 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:37.343+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:37.350 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:37.344+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:37.447 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:37.440+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:37.566 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:37.560+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:37.676 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:37.671+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:38.092 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:38.086+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:38.296 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:38.290+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:38.374 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:38.368+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:38.374 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:38.369+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:38.401 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:38.396+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:38.439 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:38.432+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:38.561 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:38.553+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:38.720 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:38.713+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:39.144 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:39.137+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:39.346 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:39.339+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:39.417 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:39.407+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:39.417 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:39.410+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:39.421 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:39.414+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:39.445 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:39.439+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:39.528 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:39.521+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:39.684 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:39.678+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:40.177 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:40.170+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:40.359 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:40.349+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:40.371 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:40.365+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:40.374 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:40.369+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:40.434 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:40.428+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:40.445 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:40.437+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:40.490 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:40.484+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:40.656 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:40.650+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:41.150 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:41.143+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:41.352 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:41.346+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:41.359 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:41.351+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:41.369 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:41.363+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:41.397 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:41.389+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:41.420 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:41.413+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:41.459 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:41.453+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:41.619 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:41.613+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:42.196 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:42.189+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:42.365 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:42.358+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:42.387 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:42.377+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:42.392 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:42.383+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:42.403 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:42.398+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:42.440 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:42.434+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:42.457 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:42.449+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:42.648 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:42.641+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:43.158 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:43.150+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:43.399 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:43.391+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:43.422 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:43.415+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:43.442 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:43.434+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:43.443 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:43.437+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:43.461 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:43.454+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:43.487 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:43.480+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:43.679 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:43.673+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:44.205 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:44.197+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:44.374 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:44.367+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:44.436 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:44.427+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:44.447 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:44.440+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:44.448 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:44.442+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:44.478 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:44.472+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:44.482 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:44.476+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:44.689 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:44.681+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:45.194 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:45.187+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:45.426 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:45.419+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:45.463 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:45.456+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:45.473 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:45.465+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:45.476 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:45.469+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:45.478 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:45.472+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:45.499 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:45.493+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:45.692 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:45.685+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:46.187 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:46.179+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:46.416 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:46.408+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:46.440 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:46.432+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:46.443 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:46.437+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:46.448 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:46.441+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:46.451 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:29:46.443+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e206 v206) 2019-12-09T18:29:46.466 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:46.459+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:46.517 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:46.509+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:46.651 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:46.645+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:47.178 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:47.172+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:47.403 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:47.396+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:47.405 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:47.397+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:47.406 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:47.400+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:47.421 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:47.415+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:47.453 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:47.447+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:47.486 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:47.480+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:47.670 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:47.664+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:48.194 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:48.187+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:48.432 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:48.422+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:48.432 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:48.425+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:48.456 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:48.447+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:48.459 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:48.451+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:48.466 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:48.458+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:48.468 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:48.460+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:48.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:48.699+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:49.197 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:49.191+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:49.415 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:49.408+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:49.416 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:49.411+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:49.440 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:49.433+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:49.453 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:49.446+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:49.469 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:49.463+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:49.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:49.508+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:49.682 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:49.677+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:50.160 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:50.153+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:50.397 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:50.390+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:50.400 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:50.396+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:50.429 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:50.422+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:50.434 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:50.427+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:50.452 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:50.445+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:50.565 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:50.559+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:50.677 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:50.671+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:51.121 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:51.114+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:51.411 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:51.405+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:51.411 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:51.407+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:51.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:51.410+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:51.433 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:51.426+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:51.438 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:51.432+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:51.461 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:29:51.454+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e206 v206) 2019-12-09T18:29:51.585 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:51.579+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:51.685 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:51.678+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:52.172 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:52.165+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:52.373 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:52.366+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:52.379 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:52.368+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:52.394 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:52.387+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:52.437 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:52.431+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:52.480 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:52.474+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:52.587 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:52.562+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:52.679 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:52.673+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:53.127 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:53.120+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:53.341 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:53.334+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:53.342 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:53.337+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:53.449 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:53.435+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:53.469 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:53.461+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:53.504 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:53.496+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:53.585 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:53.579+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:53.665 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:53.656+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:54.181 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:54.174+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:54.378 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:54.373+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:54.379 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:54.374+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:54.457 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:54.450+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:54.488 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:54.480+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:54.489 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:54.482+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:54.575 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:54.568+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:54.652 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:54.645+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:55.212 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:55.205+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:55.437 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:55.425+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:55.437 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:55.428+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:55.474 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:55.466+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:55.482 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:55.474+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:55.511 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:55.504+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:55.605 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:55.597+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:55.640 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:55.632+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:29:56.200 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:29:56.193+0000 1694f700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:26.871412+0000 front 2019-12-09T18:28:26.630133+0000 (oldest deadline 2019-12-09T18:29:12.511389+0000) 2019-12-09T18:29:56.459 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:56.448+0000 1694f700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:28:44.625061+0000 (oldest deadline 2019-12-09T18:29:24.625061+0000) 2019-12-09T18:29:56.460 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:29:56.454+0000 1694f700 -1 osd.6 206 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e203) 2019-12-09T18:29:56.483 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:29:56.476+0000 1694f700 -1 osd.3 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:27.454538+0000 front 2019-12-09T18:28:27.476504+0000 (oldest deadline 2019-12-09T18:29:10.786218+0000) 2019-12-09T18:29:56.489 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:29:56.482+0000 1694f700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.801612+0000 front 2019-12-09T18:28:28.801902+0000 (oldest deadline 2019-12-09T18:29:12.906126+0000) 2019-12-09T18:29:56.503 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:29:56.497+0000 1694f700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:25.710417+0000 front 2019-12-09T18:28:25.730736+0000 (oldest deadline 2019-12-09T18:29:10.990832+0000) 2019-12-09T18:29:56.532 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:29:56.525+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e206 v206) 2019-12-09T18:29:56.649 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:29:56.634+0000 1694f700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.676733+0000 front 2019-12-09T18:28:28.848695+0000 (oldest deadline 2019-12-09T18:29:13.272812+0000) 2019-12-09T18:29:56.662 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:29:56.653+0000 1694f700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:28:28.829380+0000 front 2019-12-09T18:28:28.830043+0000 (oldest deadline 2019-12-09T18:29:11.020844+0000) 2019-12-09T18:30:21.768 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:24:42.825 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:21.796 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:24:42.853 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:21.822 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:24:42.874 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:21.822 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:24:42.879 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:21.843 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:24:42.877 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:21.845 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:24:42.879 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:21.982 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:24:43.039 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:22.040 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:24:43.095 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:22.076 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:24:43.109 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:28.649 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:30:28.613+0000 3578e700 -1 osd.0 212 build_incremental_map_msg missing incremental map 212 2019-12-09T18:30:28.998 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:30:28.944+0000 32f89700 -1 osd.0 212 build_incremental_map_msg missing incremental map 212 2019-12-09T18:30:29.017 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:30:28.968+0000 32f89700 -1 osd.0 212 build_incremental_map_msg missing incremental map 212 2019-12-09T18:30:29.452 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:30:29.422+0000 37792700 -1 osd.0 212 build_incremental_map_msg missing incremental map 212 2019-12-09T18:30:29.583 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:30:29.461+0000 32788700 -1 osd.0 212 build_incremental_map_msg missing incremental map 212 2019-12-09T18:30:31.740 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:30:31.729+0000 33f8b700 -1 osd.0 212 build_incremental_map_msg missing incremental map 212 2019-12-09T18:30:31.808 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:24:52.865 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:31.812 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:24:52.870 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:31.824 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:24:52.878 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:31.828 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:24:52.884 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:31.830 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:24:52.864 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:31.841 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:24:52.875 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:31.865 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:24:52.922 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:31.878 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:24:52.935 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:30:31.899 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:24:52.932 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:31:24.627 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:24.621+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:24.847 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:24.841+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:25.591 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:25.585+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:25.802 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:25.797+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:26.643 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:26.638+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:26.772 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:26.768+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:27.651 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:27.645+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:27.801 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:27.795+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:28.606 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:28.600+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:28.778 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:28.767+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:29.615 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:29.610+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:29.733 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:29.728+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:30.329 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:30.325+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:30.597 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:30.591+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:30.766 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:30.758+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:31.366 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:31.359+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:31.400 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:31.394+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:31.467 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:31.462+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:31.501 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:31.495+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:31.564 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:31.559+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:31.727 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:31.722+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:31.825 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:31.818+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:32.336 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:32.324+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:32.406 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:32.398+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:32.436 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:32.426+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:32.462 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:32.452+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:32.598 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:32.592+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:32.762 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:32.755+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:32.813 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:32.806+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:33.363 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:33.358+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:33.385 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:33.380+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:33.458 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:33.453+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:33.489 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:33.483+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:33.637 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:33.632+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:33.768 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:33.761+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:33.770 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:33.765+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:34.323 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:34.317+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:34.381 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:34.376+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:34.438 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:34.431+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:34.535 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:34.530+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:34.640 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:34.635+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:34.767 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:34.762+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:34.772 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:34.767+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:35.281 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:35.275+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:35.365 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:35.359+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:35.466 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:35.461+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:35.548 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:35.542+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:35.648 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:35.643+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:35.762 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:35.757+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:35.765 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:35.760+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:36.324 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:36.318+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:36.379 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:36.374+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:36.505 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:36.499+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:36.513 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:36.508+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:36.620 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:36.614+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:36.756 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:36.750+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:36.804 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:36.798+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:37.292 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:37.286+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:37.426 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:37.421+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:37.485 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:37.479+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:37.552 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:37.544+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:37.640 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:37.634+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:37.799 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:37.794+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:37.800 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:37.795+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:38.301 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:38.292+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:38.442 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:38.437+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:38.461 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:38.455+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:38.513 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:38.507+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:38.611 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:38.606+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:38.787 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:38.782+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:38.843 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:38.838+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:39.254 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:39.248+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:39.486 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:39.482+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:39.492 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:39.486+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:39.553 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:39.548+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:39.658 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:39.654+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:39.766 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:39.760+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:39.804 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:39.797+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:40.213 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:40.207+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:40.517 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:40.512+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:40.527 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:40.521+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:40.548 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:40.542+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:40.658 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:40.653+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:40.752 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:40.746+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:40.765 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:40.759+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:41.222 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:41.216+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:41.506 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:41.501+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:41.539 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:41.520+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:41.539 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:41.526+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:41.663 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:41.658+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:41.800 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:41.793+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:41.810 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:41.804+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:42.259 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:42.254+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:42.497 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:42.490+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:42.498 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:42.491+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:42.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:42.509+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:42.701 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:42.696+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:42.776 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:42.771+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:42.806 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:42.800+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:43.226 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:43.220+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:43.512 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:43.505+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:43.519 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:43.515+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:43.532 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:43.526+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:43.737 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:43.732+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:43.775 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:43.770+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:43.825 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:43.814+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:44.269 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:44.263+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:44.484 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:44.479+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:44.497 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:44.489+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:44.570 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:44.561+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:44.731 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:44.725+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:44.760 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:44.755+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:44.861 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:44.854+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:45.282 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:45.276+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:45.517 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:45.511+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:45.526 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:45.521+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:45.614 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:45.608+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:45.753 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:45.748+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:45.777 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:45.772+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:45.866 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:45.860+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:46.327 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:46.322+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:46.485 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:46.480+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:46.504 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:46.498+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:46.642 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:46.635+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:46.751 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:46.745+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:46.752 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:46.746+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:46.833 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:46.822+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:47.334 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:47.322+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:47.524 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:47.518+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:47.545 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:47.537+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:47.615 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:47.609+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:47.734 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:47.727+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:47.793 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:47.784+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:47.813 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:47.805+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:48.316 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:48.312+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:48.553 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:48.543+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:48.569 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:48.561+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:48.600 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:48.591+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:48.770 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:48.765+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:48.785 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:48.777+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:48.793 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:48.785+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:49.305 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:49.299+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:49.502 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:49.498+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:49.530 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:49.524+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:49.587 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:49.581+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:49.754 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:49.748+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:49.817 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:49.811+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:49.833 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:49.826+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:50.277 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:50.270+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:50.533 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:50.519+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:50.548 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:50.542+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:50.569 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:50.563+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:50.788 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:50.781+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:50.855 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:50.849+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:50.863 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:50.857+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:51.236 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:51.230+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:51.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:51.511+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:51.551 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:51.545+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:51.568 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:51.560+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:51.797 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:51.792+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:51.830 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:51.823+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:51.915 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:51.909+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:52.198 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:52.193+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:52.530 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:52.524+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:52.582 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:52.576+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:52.597 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:52.590+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:52.815 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:52.809+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:52.820 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:52.813+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:52.901 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:52.895+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:53.198 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:53.193+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:53.497 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:53.491+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:53.606 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:53.600+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:53.625 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:53.618+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:53.775 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:53.768+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:53.815 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:53.809+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:53.877 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:53.870+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:54.183 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:54.177+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:54.512 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:54.506+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:54.590 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:54.584+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:54.636 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:54.630+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:54.748 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:54.742+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:54.829 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:54.824+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:54.891 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:54.884+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:55.191 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:55.186+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:55.528 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:55.522+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:55.615 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:55.609+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:55.675 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:55.669+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:55.709 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:55.702+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:55.798 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:55.791+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:55.880 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:55.873+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:56.246 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:56.237+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:56.542 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:56.535+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:56.572 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:56.564+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:56.686 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:56.681+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:56.757 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:56.750+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:56.797 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:56.792+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:56.907 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:56.900+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:57.046 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:31:57.040+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e212 v212) 2019-12-09T18:31:57.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:57.203+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:57.524 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:57.516+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:57.552 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:57.546+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:57.680 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:57.674+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:57.759 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:57.753+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:57.774 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:57.768+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:57.882 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:57.876+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:58.235 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:58.229+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:58.550 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:58.544+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:58.551 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:58.544+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:58.682 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:58.677+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:58.740 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:58.734+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:58.793 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:58.788+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:58.855 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:58.849+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:31:59.223 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:31:59.217+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:31:59.570 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:31:59.565+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:31:59.577 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:31:59.571+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:31:59.717 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:31:59.712+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:31:59.765 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:31:59.760+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:31:59.807 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:31:59.801+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:31:59.839 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:31:59.832+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:32:00.232 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:32:00.226+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:32:00.546 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:32:00.539+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:32:00.624 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:32:00.617+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:32:00.738 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:32:00.732+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:32:00.750 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:32:00.745+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:32:00.844 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:32:00.837+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:32:00.859 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:32:00.852+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:32:01.190 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:32:01.185+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:32:01.560 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:32:01.554+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:32:01.597 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:32:01.590+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:32:01.770 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:32:01.765+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:32:01.786 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:32:01.780+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:32:01.817 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:32:01.808+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:32:01.817 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:32:01.809+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:32:02.066 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:32:02.059+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e212 v212) 2019-12-09T18:32:02.157 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:32:02.151+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:32:02.584 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:32:02.577+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:32:02.642 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:32:02.636+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:32:02.751 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:32:02.745+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:32:02.797 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:32:02.789+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:32:02.821 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:32:02.815+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:32:02.836 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:32:02.830+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:32:03.129 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:32:03.113+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:32:03.608 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:32:03.601+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:32:03.657 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:32:03.651+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:32:03.757 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:32:03.750+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:32:03.795 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:32:03.791+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:32:03.803 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:32:03.797+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:32:03.865 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:32:03.859+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:32:04.129 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:32:04.121+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:32:04.587 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:32:04.581+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:32:04.665 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:32:04.659+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:32:04.769 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:32:04.763+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:32:04.792 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:32:04.786+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:32:04.831 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:32:04.823+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:32:04.845 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:32:04.838+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:32:05.107 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:32:05.100+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:32:05.545 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:32:05.539+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:32:05.619 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:32:05.613+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:32:05.765 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:32:05.759+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:32:05.812 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:32:05.806+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:32:05.870 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:32:05.865+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:32:05.882 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:32:05.875+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:32:06.083 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:32:06.078+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:32:06.549 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:32:06.543+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.890819+0000 front 2019-12-09T18:30:47.891728+0000 (oldest deadline 2019-12-09T18:31:30.883216+0000) 2019-12-09T18:32:06.613 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:32:06.605+0000 1694f700 -1 osd.2 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.886875+0000 front 2019-12-09T18:30:46.915063+0000 (oldest deadline 2019-12-09T18:31:30.860949+0000) 2019-12-09T18:32:06.782 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:32:06.776+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:42.505480+0000 front 2019-12-09T18:30:42.452957+0000 (oldest deadline 2019-12-09T18:31:24.585164+0000) 2019-12-09T18:32:06.825 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:32:06.811+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:45.307322+0000 front 2019-12-09T18:30:45.209562+0000 (oldest deadline 2019-12-09T18:31:30.924319+0000) 2019-12-09T18:32:06.893 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:32:06.888+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:47.726126+0000 front 2019-12-09T18:30:47.765535+0000 (oldest deadline 2019-12-09T18:31:31.794926+0000) 2019-12-09T18:32:06.903 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:32:06.895+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:46.039977+0000 front 2019-12-09T18:30:43.069531+0000 (oldest deadline 2019-12-09T18:31:24.073772+0000) 2019-12-09T18:32:07.091 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:32:07.084+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:30:48.478533+0000 front 2019-12-09T18:30:48.447462+0000 (oldest deadline 2019-12-09T18:31:29.617801+0000) 2019-12-09T18:32:07.142 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:32:07.132+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e212 v212) 2019-12-09T18:32:44.851 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:32:44.833+0000 36790700 -1 osd.6 218 build_incremental_map_msg missing incremental map 218 2019-12-09T18:32:45.704 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:32:45.367+0000 36790700 -1 osd.6 218 build_incremental_map_msg missing incremental map 218 2019-12-09T18:32:45.705 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:32:45.369+0000 36790700 -1 osd.6 218 build_incremental_map_msg missing incremental map 218 2019-12-09T18:33:05.296 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:05.290+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:05.604 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:05.594+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:06.271 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:06.262+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:06.575 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:06.567+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:06.800 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:33:06.793+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.964196+0000 front 2019-12-09T18:32:20.876043+0000 (oldest deadline 2019-12-09T18:33:06.688621+0000) 2019-12-09T18:33:07.319 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:07.310+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:07.604 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:07.598+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:07.664 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:07.658+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:07.736 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:07.729+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:07.847 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:33:07.841+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.964196+0000 front 2019-12-09T18:32:20.876043+0000 (oldest deadline 2019-12-09T18:33:06.688621+0000) 2019-12-09T18:33:08.355 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:08.349+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:08.640 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:08.631+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:08.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:08.658+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:08.766 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:08.760+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:08.875 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:33:08.867+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.964196+0000 front 2019-12-09T18:32:20.876043+0000 (oldest deadline 2019-12-09T18:33:06.688621+0000) 2019-12-09T18:33:08.984 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:08.977+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:09.377 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:09.371+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:09.630 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:09.623+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:09.673 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:09.666+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:09.783 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:09.776+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:09.942 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:09.937+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:10.437 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:10.426+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:10.664 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:10.658+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:10.687 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:10.680+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:10.837 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:10.830+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:10.905 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:10.899+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:11.481 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:11.474+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:11.649 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:11.642+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:11.694 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:11.688+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:11.862 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:11.851+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:11.917 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:11.910+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:12.500 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:12.493+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:12.678 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:12.669+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:12.727 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:12.721+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:12.909 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:12.898+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:12.963 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:12.954+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:13.454 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:13.448+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:13.471 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:13.463+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:13.689 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:13.683+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:13.704 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:13.700+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:13.865 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:13.859+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:13.965 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:13.960+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:14.421 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:14.415+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:14.430 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:14.424+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:14.676 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:14.669+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:14.682 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:14.675+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:14.840 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:14.832+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:15.008 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:15.002+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:15.442 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:15.434+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:15.467 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:15.461+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:15.679 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:15.674+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:15.681 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:15.676+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:15.817 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:15.810+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:15.982 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:15.977+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:16.426 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:16.420+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:16.470 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:16.464+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:16.650 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:16.644+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:16.701 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:16.695+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:16.834 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:16.827+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:17.025 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:17.018+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:17.419 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:17.413+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:17.453 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:17.448+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:17.693 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:17.686+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:17.748 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:17.742+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:17.853 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:17.846+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:18.054 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:18.048+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:18.421 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:18.416+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:18.481 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:18.466+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:18.661 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:18.655+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:18.741 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:18.730+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:18.855 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:18.848+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:19.068 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:19.062+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:19.393 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:19.387+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:19.396 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:19.391+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:19.463 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:19.457+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:19.620 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:19.614+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:19.770 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:19.766+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:19.881 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:19.874+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:20.066 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:20.060+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:20.414 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:20.406+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:20.415 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:20.409+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:20.490 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:20.483+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:20.616 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:20.609+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:20.791 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:20.784+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:20.907 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:20.901+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:21.093 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:21.088+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:21.454 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:21.446+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:21.458 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:21.454+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:21.479 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:21.473+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:21.587 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:21.580+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:21.749 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:21.742+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:21.950 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:21.943+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:22.144 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:22.138+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:22.463 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:22.456+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:22.464 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:22.458+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:22.521 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:22.512+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:22.593 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:22.586+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:22.776 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:22.771+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:22.929 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:22.922+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:23.127 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:23.121+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:23.453 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:23.446+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:23.455 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:23.449+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:23.507 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:23.501+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:23.630 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:23.624+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:23.778 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:23.772+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:23.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:23.964+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:24.177 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:24.172+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:24.476 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:24.469+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:24.488 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:24.482+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:24.492 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:24.487+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:24.613 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:24.604+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:24.794 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:24.790+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:24.949 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:24.942+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:25.145 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:25.139+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:25.452 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:25.446+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:25.453 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:25.448+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:25.531 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:25.525+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:25.656 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:25.649+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:25.798 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:25.792+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:25.975 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:25.968+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:26.153 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:26.148+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:26.452 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:26.442+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:26.452 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:26.446+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:26.557 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:26.549+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:26.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:26.663+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:26.753 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:26.746+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:27.029 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:27.021+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:27.148 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:27.141+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:27.411 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:27.404+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:27.414 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:27.409+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:27.572 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:27.564+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:27.714 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:27.708+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:27.787 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:27.780+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:28.066 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:28.060+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:28.123 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:28.116+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:28.467 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:28.460+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:28.471 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:28.466+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:28.569 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:28.563+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:28.709 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:28.703+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:28.815 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:28.809+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:29.070 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:29.063+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:29.140 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:29.134+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:29.491 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:29.484+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:29.494 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:29.489+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:29.533 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:29.526+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:29.667 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:29.661+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:29.836 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:29.829+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:30.081 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:30.074+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:30.103 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:30.098+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:30.510 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:30.505+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:30.514 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:30.509+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:30.536 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:30.530+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:30.636 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:30.627+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:30.815 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:30.808+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:31.076 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:31.071+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:31.089 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:31.082+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:31.481 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:31.475+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:31.482 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:31.477+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:31.564 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:31.557+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:31.670 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:31.663+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:31.841 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:31.835+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:32.036 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:32.029+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:32.127 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:32.118+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:32.476 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:32.464+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:32.481 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:32.472+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:32.527 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:32.521+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:32.638 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:32.632+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:32.796 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:32.789+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:33.024 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:33.019+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:33.122 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:33.116+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:33.510 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:33.503+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:33.511 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:33.506+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:33.530 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:33.523+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:33.626 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:33.620+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:33.845 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:33.839+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:34.007 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:34.001+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:34.113 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:34.107+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:34.505 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:34.498+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:34.527 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:34.519+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:34.528 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:34.522+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:34.649 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:34.642+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:34.875 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:34.869+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:35.054 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:35.048+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:35.119 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:35.112+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:35.544 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:35.537+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:35.561 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:35.554+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:35.565 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:35.560+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:35.690 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:35.684+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:35.840 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:35.835+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:36.040 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:36.035+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:36.145 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:36.138+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:36.574 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:36.567+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:36.575 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:36.567+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:36.576 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:36.571+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:36.675 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:36.668+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:36.881 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:36.875+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:37.047 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:37.042+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:37.199 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:37.192+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:37.546 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:37.538+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:37.546 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:37.540+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:37.572 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:37.565+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:37.650 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:37.643+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:37.880 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:37.875+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:38.068 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:38.062+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:38.236 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:38.230+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:38.578 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:38.572+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:38.583 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:38.577+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:38.583 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:38.576+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:38.684 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:38.677+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:38.852 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:38.846+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:39.119 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:39.111+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:39.260 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:39.254+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:39.574 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:39.567+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:39.577 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:39.573+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:39.604 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:39.595+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:39.683 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:39.676+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:39.833 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:39.828+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:40.126 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:40.118+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:40.251 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:40.245+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:40.541 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:40.535+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:40.545 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:40.540+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:40.627 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:40.620+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:40.649 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:40.642+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:40.873 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:40.867+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:41.158 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:41.152+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:41.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:41.219+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:41.599 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:41.590+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:41.600 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:41.592+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:41.667 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:41.661+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:41.705 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:41.693+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:41.850 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:41.844+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:42.132 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:42.127+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:42.268 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:42.261+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:42.417 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:33:42.412+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e218 v218) 2019-12-09T18:33:42.587 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:42.580+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:42.589 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:42.583+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:42.625 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:42.617+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:42.729 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:42.722+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:42.831 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:42.823+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:43.104 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:43.097+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:43.263 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:43.256+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:43.547 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:43.539+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:43.548 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:43.542+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:43.670 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:43.664+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:43.755 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:43.747+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:43.833 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:43.826+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:44.133 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:44.126+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:44.298 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:44.291+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:44.571 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:44.563+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:44.572 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:44.567+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:44.673 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:44.665+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:44.782 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:44.774+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:44.808 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:44.802+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:45.087 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:45.081+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:45.282 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:45.275+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:45.582 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:45.576+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:45.586 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:45.581+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:45.710 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:45.704+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:45.814 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:45.806+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:45.855 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:45.848+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:46.079 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:46.073+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:46.321 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:46.314+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:46.548 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:46.543+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:46.552 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:46.548+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:46.682 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:46.676+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:46.866 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:46.858+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:46.889 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:46.883+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:47.104 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:47.098+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:47.359 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:47.351+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:47.433 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:33:47.426+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e218 v218) 2019-12-09T18:33:47.539 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:47.531+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:47.540 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:47.534+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:47.663 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:47.656+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:47.857 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:47.852+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:47.863 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:47.856+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:48.071 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:48.061+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:48.345 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:48.338+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:48.548 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:48.541+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:48.553 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:48.544+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:48.641 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:48.635+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:48.831 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:48.824+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:48.864 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:48.858+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:49.044 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:49.038+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:49.339 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:49.333+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:49.510 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:49.502+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:49.511 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:49.506+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:49.640 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:49.633+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:49.864 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:49.857+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:49.883 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:49.877+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:50.083 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:50.077+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:50.358 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:50.351+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:50.551 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:50.544+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:50.552 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:50.547+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:50.641 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:50.634+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:50.896 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:50.890+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:50.899 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:50.895+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:51.113 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:51.108+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:51.383 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:51.376+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:51.605 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:51.597+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:51.605 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:51.600+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:51.662 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:51.653+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:51.913 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:33:51.906+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:20.355454+0000 front 2019-12-09T18:32:19.098952+0000 (oldest deadline 2019-12-09T18:33:04.980408+0000) 2019-12-09T18:33:51.914 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:33:51.902+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.678229+0000 front 2019-12-09T18:32:24.313218+0000 (oldest deadline 2019-12-09T18:33:07.566100+0000) 2019-12-09T18:33:52.153 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:33:52.147+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:24.409206+0000 front 2019-12-09T18:32:24.301169+0000 (oldest deadline 2019-12-09T18:33:08.243967+0000) 2019-12-09T18:33:52.413 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:33:52.398+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.434097+0000 front 2019-12-09T18:32:23.436421+0000 (oldest deadline 2019-12-09T18:33:06.861950+0000) 2019-12-09T18:33:52.491 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:33:52.486+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e218 v218) 2019-12-09T18:33:52.620 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:33:52.613+0000 1694f700 -1 osd.5 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:32:23.441209+0000 front 2019-12-09T18:32:23.342070+0000 (oldest deadline 2019-12-09T18:33:04.888665+0000) 2019-12-09T18:33:52.620 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:52.613+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:32:39.208556+0000 (oldest deadline 2019-12-09T18:33:19.208556+0000) 2019-12-09T18:33:52.621 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:52.616+0000 1694f700 -1 osd.6 218 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e216) 2019-12-09T18:33:53.351 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:33:53.257+0000 34f8d700 -1 osd.6 219 build_incremental_map_msg missing incremental map 218 2019-12-09T18:34:27.608 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:34:27.584+0000 31786700 -1 osd.0 223 build_incremental_map_msg missing incremental map 223 2019-12-09T18:34:27.610 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:34:27.590+0000 31786700 -1 osd.0 223 build_incremental_map_msg missing incremental map 223 2019-12-09T18:34:27.619 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:34:27.601+0000 31786700 -1 osd.0 223 build_incremental_map_msg missing incremental map 223 2019-12-09T18:34:29.871 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:28:50.928 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:34:29.878 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:28:50.935 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:34:29.891 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:28:50.948 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:34:29.893 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:28:50.927 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:34:29.895 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:28:50.952 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:34:29.904 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:28:50.939 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:34:30.147 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:28:51.204 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:34:30.178 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:28:51.212 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:34:30.180 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:28:51.237 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:34:31.205 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:34:31.128+0000 36f91700 -1 osd.0 224 build_incremental_map_msg missing incremental map 223 2019-12-09T18:35:27.652 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:27.646+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:27.780 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:27.775+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:28.629 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:28.623+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:28.763 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:28.759+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:29.252 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:29.246+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:29.479 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:29.474+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:29.632 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:29.627+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:29.765 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:29.759+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:30.186 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:30.180+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:30.273 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:30.267+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:30.438 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:30.432+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:30.552 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:30.543+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:30.675 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:30.669+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:30.770 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:30.754+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:31.232 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:31.227+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:31.255 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:31.248+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:31.400 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:31.395+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:31.583 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:31.576+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:31.649 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:31.642+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:31.802 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:31.798+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:32.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:32.220+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:32.262 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:32.257+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:32.451 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:32.447+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:32.589 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:32.583+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:32.707 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:32.700+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:32.813 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:32.808+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:33.021 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:33.015+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:33.250 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:33.245+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:33.270 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:33.263+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:33.470 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:33.465+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:33.628 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:33.624+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:33.705 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:33.699+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:33.864 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:33.858+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:34.059 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:34.053+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:34.216 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:34.211+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:34.280 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:34.275+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:34.437 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:34.432+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:34.672 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:34.666+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:34.749 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:34.743+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:34.870 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:34.865+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:35.017 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:35.012+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:35.240 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:35.232+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:35.257 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:35.252+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:35.398 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:35.390+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:35.714 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:35.709+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:35.727 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:35.720+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:35.849 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:35.843+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:36.031 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:36.025+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:36.199 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:36.194+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:36.250 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:36.240+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:36.385 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:36.380+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:36.701 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:36.696+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:36.714 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:36.709+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:36.864 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:36.858+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:37.018 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:37.013+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:37.160 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:37.156+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:37.232 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:37.226+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:37.360 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:37.354+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:37.740 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:37.733+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:37.747 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:37.740+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:37.832 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:37.827+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:38.027 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:38.021+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:38.185 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:38.180+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:38.209 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:38.203+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:38.369 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:38.364+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:38.738 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:38.732+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:38.789 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:38.784+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:38.790 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:38.784+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:39.077 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:39.072+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:39.147 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:39.142+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:39.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:39.247+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:39.332 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:39.327+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:39.779 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:39.774+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:39.790 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:39.785+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:39.792 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:39.786+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:40.094 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:40.088+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:40.169 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:40.164+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:40.217 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:40.210+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:40.373 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:40.368+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:40.777 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:40.772+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:40.794 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:40.790+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:40.833 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:40.828+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:41.122 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:41.116+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:41.153 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:41.147+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:41.214 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:41.209+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:41.352 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:41.346+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:41.830 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:41.818+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:41.846 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:41.840+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:41.848 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:41.844+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:42.101 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:42.092+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:42.136 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:42.130+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:42.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:42.220+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:42.326 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:42.320+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:42.837 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:42.831+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:42.844 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:42.839+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:42.863 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:42.857+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:43.086 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:43.080+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:43.122 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:43.117+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:43.231 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:43.225+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:43.319 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:43.314+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:43.845 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:43.839+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:43.851 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:43.846+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:43.852 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:43.847+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:44.090 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:44.083+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:44.091 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:44.076+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:44.215 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:44.210+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:44.281 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:44.276+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:44.808 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:44.802+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:44.853 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:44.845+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:44.865 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:44.859+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:45.061 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:45.048+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:45.111 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:45.105+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:45.266 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:45.260+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:45.284 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:45.279+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:45.770 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:45.764+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:45.867 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:45.863+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:45.909 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:45.904+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:46.072 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:46.068+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:46.089 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:46.083+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:46.287 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:46.282+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:46.306 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:46.300+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:46.762 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:46.756+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:46.919 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:46.914+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:46.929 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:46.924+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:47.083 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:47.077+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:47.107 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:47.100+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:47.298 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:47.294+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:47.322 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:47.318+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:47.721 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:47.715+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:47.949 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:47.944+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:47.957 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:47.952+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:48.076 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:48.072+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:48.111 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:48.106+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:48.297 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:48.293+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:48.298 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:48.292+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:48.716 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:48.709+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:48.934 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:48.929+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:48.984 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:48.980+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:49.035 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:49.030+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:49.131 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:49.126+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:49.345 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:49.339+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:49.346 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:49.341+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:49.720 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:49.715+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:49.916 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:49.911+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:49.996 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:49.990+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:50.049 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:50.042+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:50.134 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:50.128+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:50.354 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:50.349+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:50.381 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:50.376+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:50.685 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:50.679+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:50.909 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:50.903+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:50.996 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:50.991+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:51.098 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:51.092+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:51.101 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:51.095+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:51.387 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:51.381+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:51.402 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:51.396+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:51.698 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:51.691+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:51.925 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:51.915+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:52.036 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:52.031+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:52.086 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:52.080+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:52.087 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:52.082+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:52.436 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:52.428+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:52.447 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:52.441+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:52.700 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:52.694+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:52.935 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:52.929+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:53.037 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:53.029+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:53.048 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:53.043+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:53.119 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:53.114+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:53.412 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:53.407+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:53.424 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:53.419+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:53.718 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:53.712+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:53.983 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:53.978+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:54.073 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:54.067+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:54.081 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:54.076+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:54.124 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:54.118+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:54.423 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:54.418+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:54.459 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:54.453+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:54.676 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:54.671+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:54.989 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:54.976+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:55.050 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:55.045+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:55.128 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:55.120+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:55.142 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:55.137+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:55.439 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:55.434+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:55.468 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:55.463+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:55.688 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:55.682+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:55.990 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:55.985+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:56.004 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:55.998+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:56.120 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:56.116+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:56.141 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:56.136+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:56.433 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:56.427+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:56.452 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:56.438+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:56.679 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:56.673+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:56.969 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:56.964+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:56.972 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:56.967+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:57.083 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:57.078+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:57.113 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:57.107+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:57.438 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:57.432+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:57.480 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:57.474+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:57.712 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:57.706+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:57.929 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:35:57.921+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 40sec e224 v224) 2019-12-09T18:35:57.942 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:57.936+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:57.954 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:57.949+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:58.078 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:58.073+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:58.114 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:58.109+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:58.418 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:58.413+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:58.449 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:58.444+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:58.743 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:58.734+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:58.913 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:58.908+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:35:58.938 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:58.933+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:59.065 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:35:59.060+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:35:59.143 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:35:59.138+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:35:59.375 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:35:59.370+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:35:59.426 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:35:59.421+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:35:59.755 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:35:59.750+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:35:59.898 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:35:59.892+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:35:59.944 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:35:59.937+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:36:00.043 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:36:00.038+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:36:00.103 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:36:00.098+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:36:00.404 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:36:00.391+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:36:00.433 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:36:00.427+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:36:00.737 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:36:00.731+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:36:00.899 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:36:00.894+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:36:00.934 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:36:00.928+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:36:01.073 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:36:01.068+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:36:01.138 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:36:01.133+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:36:01.383 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:36:01.379+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:36:01.477 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:36:01.472+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:36:01.751 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:36:01.746+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:36:01.853 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:36:01.848+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:36:01.962 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:36:01.957+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:36:02.117 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:36:02.112+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:36:02.190 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:36:02.184+0000 1694f700 -1 osd.3 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:44.216694+0000 front 2019-12-09T18:34:45.102653+0000 (oldest deadline 2019-12-09T18:35:29.695868+0000) 2019-12-09T18:36:02.398 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:36:02.393+0000 1694f700 -1 osd.2 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.026208+0000 front 2019-12-09T18:34:46.200710+0000 (oldest deadline 2019-12-09T18:35:29.034393+0000) 2019-12-09T18:36:02.494 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:36:02.487+0000 1694f700 -1 osd.7 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.961773+0000 front 2019-12-09T18:34:45.950808+0000 (oldest deadline 2019-12-09T18:35:28.815255+0000) 2019-12-09T18:36:02.774 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:36:02.768+0000 1694f700 -1 osd.4 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.917629+0000 front 2019-12-09T18:34:46.184110+0000 (oldest deadline 2019-12-09T18:35:27.295175+0000) 2019-12-09T18:36:02.856 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:36:02.850+0000 1694f700 -1 osd.5 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.464960+0000 front 2019-12-09T18:34:47.025655+0000 (oldest deadline 2019-12-09T18:35:32.024410+0000) 2019-12-09T18:36:02.954 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:36:02.949+0000 1694f700 -1 osd.0 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:47.259508+0000 front 2019-12-09T18:34:47.013922+0000 (oldest deadline 2019-12-09T18:35:29.574098+0000) 2019-12-09T18:36:03.008 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:36:02.999+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 40sec e224 v224) 2019-12-09T18:36:03.167 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:36:03.161+0000 1694f700 -1 osd.1 224 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:34:46.833352+0000 front 2019-12-09T18:34:47.029026+0000 (oldest deadline 2019-12-09T18:35:27.441196+0000) 2019-12-09T18:36:13.384 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:30:34.441 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:36:13.387 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:30:34.445 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:36:13.431 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:30:34.489 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:36:13.442 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:30:34.499 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:36:13.471 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:30:34.505 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:36:13.477 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:30:34.511 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:36:13.553 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:30:34.610 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:36:13.560 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:30:34.617 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:36:13.574 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:30:34.608 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:37:01.297 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:01.291+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:01.519 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:01.512+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:02.320 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:02.308+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:02.535 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:02.529+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:03.325 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:03.319+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:03.543 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:03.537+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:03.743 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:03.737+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:04.155 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:04.147+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:04.339 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:04.330+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:04.548 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:04.542+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:04.740 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:04.734+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:05.183 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:05.176+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:05.308 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:05.303+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:05.568 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:05.561+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:05.787 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:05.782+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:06.075 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:06.068+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:06.197 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:06.190+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:06.307 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:06.301+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:06.569 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:06.564+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:06.813 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:06.805+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:06.826 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:06.822+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:07.083 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:07.073+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:07.280 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:07.188+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:07.301 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:07.294+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:07.566 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:07.558+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:07.776 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:07.770+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:07.834 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:07.825+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:08.104 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:08.095+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:08.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:08.241+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:08.330 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:08.324+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:08.584 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:08.575+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:08.829 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:08.820+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:08.882 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:08.873+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:09.125 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:09.113+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:09.261 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:09.252+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:09.311 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:09.306+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:09.563 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:09.557+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:09.804 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:09.798+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:09.837 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:09.828+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:10.081 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:10.069+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:10.266 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:10.259+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:10.283 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:10.274+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:10.563 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:10.556+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:10.813 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:10.806+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:10.877 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:10.869+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:11.128 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:11.121+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:11.305 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:11.292+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:11.312 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:11.299+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:11.631 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:11.606+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:11.865 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:11.858+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:11.872 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:11.864+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:12.090 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:12.078+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:12.157 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:12.152+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:12.281 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:12.270+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:12.347 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:12.341+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:12.589 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:12.581+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:12.830 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:12.823+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:12.877 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:12.867+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:13.105 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:13.094+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:13.181 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:13.172+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:13.309 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:13.301+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:13.321 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:13.311+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:13.585 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:13.574+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:13.834 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:13.827+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:13.915 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:13.909+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:14.109 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:14.099+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:14.141 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:14.135+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:14.278 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:14.272+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:14.353 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:14.344+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:14.608 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:14.602+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:14.873 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:14.864+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:14.885 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:14.879+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:15.108 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:15.101+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:15.139 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:15.134+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:15.256 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:15.249+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:15.315 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:15.307+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:15.608 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:15.599+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:15.854 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:15.848+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:15.885 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:15.879+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:16.071 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:16.065+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:16.160 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:16.154+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:16.263 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:16.256+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:16.312 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:16.305+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:16.576 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:16.566+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:16.875 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:16.868+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:16.893 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:16.887+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:17.111 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:17.103+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:17.123 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:17.111+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:17.302 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:17.294+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:17.327 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:17.320+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:17.532 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:17.523+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:17.908 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:17.901+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:17.937 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:17.927+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:18.114 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:18.108+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:18.163 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:18.156+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:18.317 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:18.306+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:18.365 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:18.351+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:18.534 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:18.527+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:18.945 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:18.935+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:18.955 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:18.949+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:19.129 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:19.119+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:19.129 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:19.123+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:19.135 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:19.125+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:19.310 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:19.302+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:19.369 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:19.361+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:19.497 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:19.488+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:19.907 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:19.900+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:19.984 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:19.978+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:20.112 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:20.105+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:20.165 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:20.155+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:20.166 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:20.161+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:20.341 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:20.334+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:20.362 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:20.356+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:20.460 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:20.453+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:20.910 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:20.903+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:20.969 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:20.963+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:21.074 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:21.066+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:21.180 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:21.172+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:21.181 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:21.176+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:21.308 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:21.301+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:21.390 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:21.383+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:21.504 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:21.498+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:21.947 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:21.937+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:21.957 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:21.946+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:22.104 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:22.096+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:22.179 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:22.171+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:22.179 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:22.174+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:22.340 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:22.333+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:22.437 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:22.431+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:22.504 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:22.497+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:22.929 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:22.921+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:22.949 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:22.943+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:23.105 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:23.094+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:23.230 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:23.220+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:23.230 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:23.224+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:23.304 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:23.291+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:23.443 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:23.437+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:23.531 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:23.525+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:23.914 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:23.908+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:23.969 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:23.962+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:24.126 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:24.120+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:24.236 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:24.230+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:24.239 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:24.234+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:24.313 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:24.302+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:24.426 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:24.420+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:24.483 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:24.478+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:24.911 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:24.904+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:24.957 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:24.948+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:25.156 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:25.147+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:25.193 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:25.186+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:25.194 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:25.189+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:25.312 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:25.305+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:25.450 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:25.445+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:25.490 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:25.484+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:25.883 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:25.874+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:25.944 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:25.938+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:26.176 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:26.169+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:26.178 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:26.172+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:26.193 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:26.187+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:26.271 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:26.264+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:26.415 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:26.408+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:26.454 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:26.447+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:26.920 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:26.913+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:26.931 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:26.923+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:27.208 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:27.198+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:27.209 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:27.203+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:27.228 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:27.221+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:27.247 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:27.240+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:27.400 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:27.394+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:27.449 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:27.443+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:27.902 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:27.893+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:27.905 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:27.899+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:28.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:28.219+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:28.251 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:28.242+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:28.251 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:28.245+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:28.270 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:28.264+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:28.379 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:28.372+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:28.468 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:28.459+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:28.894 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:28.887+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:28.908 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:28.903+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:29.230 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:29.223+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:29.234 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:29.228+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:29.238 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:29.233+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:29.281 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:29.274+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:29.417 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:29.411+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:29.432 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:29.426+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:29.916 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:29.910+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:29.953 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:29.947+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:30.201 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:30.193+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:30.202 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:30.197+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:30.266 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:30.257+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:30.298 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:30.291+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:30.375 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:30.369+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:30.387 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:30.382+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:30.925 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:30.918+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:30.989 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:30.978+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:31.218 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:31.211+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:31.219 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:31.213+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:31.252 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:31.245+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:31.341 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:31.333+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:31.396 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:31.392+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:31.417 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:31.412+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:31.960 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:31.954+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:32.010 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:32.005+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:32.224 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:32.216+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:32.269 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:32.252+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:32.269 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:32.256+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:32.306 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:32.300+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:32.432 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:32.426+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:32.437 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:32.432+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:32.967 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:32.960+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:32.993 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:32.987+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:33.231 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:33.223+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:33.233 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:33.227+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:33.244 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:33.238+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:33.346 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:33.339+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:33.413 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:33.407+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:33.483 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:33.477+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:33.550 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:37:33.545+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e229 v229) 2019-12-09T18:37:33.926 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:33.919+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:33.968 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:33.962+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:34.222 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:34.215+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:34.226 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:34.221+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:34.246 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:34.239+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:34.382 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:34.371+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:34.392 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:34.386+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:34.506 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:34.501+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:34.906 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:34.899+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:35.011 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:34.998+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:35.211 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:35.204+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:35.214 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:35.209+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:35.250 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:35.242+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:35.411 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:35.406+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:35.435 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:35.428+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:35.492 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:35.486+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:35.944 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:35.933+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:36.048 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:36.041+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:36.222 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:36.214+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:36.223 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:36.217+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:36.250 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:36.243+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:36.455 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:36.450+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:36.479 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:36.470+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:36.505 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:36.500+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:36.949 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:36.941+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:37.023 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:37.016+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:37.198 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:37.190+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:37.199 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:37.192+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:37.287 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:37.281+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:37.489 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:37.478+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:37.505 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:37.497+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:37.513 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:37.504+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:37.951 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:37.946+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:37.977 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:37.970+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:38.198 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:38.192+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:38.199 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:38.195+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:38.276 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:38.269+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:38.463 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:38.456+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:38.524 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:38.517+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:38.528 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:38.523+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:38.569 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:37:38.566+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e229 v229) 2019-12-09T18:37:38.947 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:38.940+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:38.975 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:38.968+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:39.190 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:39.182+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:39.191 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:39.186+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:39.292 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:39.284+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:39.418 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:39.411+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:39.507 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:39.501+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:39.554 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:39.546+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:39.970 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:39.965+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:39.989 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:39.984+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:40.236 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:40.227+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:40.236 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:40.230+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:40.337 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:40.330+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:40.466 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:40.459+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:40.472 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:40.467+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:40.549 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:40.543+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:40.976 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:40.972+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:40.999 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:40.993+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:41.221 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:41.213+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:41.222 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:41.217+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:41.304 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:41.297+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:41.438 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:41.433+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:41.447 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:41.440+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:41.588 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:41.583+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:41.995 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:41.990+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:42.038 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:42.031+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:42.209 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:42.199+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:42.209 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:42.203+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:42.319 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:42.312+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:42.434 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:42.428+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:42.443 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:42.432+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:42.592 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:42.586+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:42.959 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:42.951+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:43.082 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:43.075+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:43.230 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:43.215+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:43.230 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:43.218+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:43.314 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:43.307+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:43.455 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:43.449+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:43.468 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:43.461+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:43.585 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:43.577+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:43.593 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:37:43.587+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e229 v229) 2019-12-09T18:37:43.960 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:43.954+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:44.072 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:44.065+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:44.234 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:44.227+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:44.235 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:44.230+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:44.324 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:44.317+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:44.432 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:44.419+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:44.443 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:44.436+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:44.594 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:44.588+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:44.937 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:44.931+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:45.028 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:45.021+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:45.235 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:45.227+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:45.235 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:45.230+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:45.357 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:45.351+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:45.394 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:45.388+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:45.492 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:45.485+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:45.588 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:45.581+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:45.959 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:45.953+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:46.029 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:46.015+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:46.216 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:46.208+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:46.217 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:46.212+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:46.337 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:46.328+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:46.385 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:46.380+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:46.466 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:46.459+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:46.564 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:46.557+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:46.917 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:46.911+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:47.062 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:47.055+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:47.225 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:47.209+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:47.225 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:47.213+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:47.365 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:47.359+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:47.373 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:47.361+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:47.449 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:47.436+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:47.595 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:47.589+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:47.890 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:47.883+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:48.076 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:48.067+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:48.205 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:48.199+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:48.206 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:48.202+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:48.389 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:48.382+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:48.398 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:48.389+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:48.424 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:48.417+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:48.605 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:37:48.597+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e229 v229) 2019-12-09T18:37:48.619 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:48.614+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:48.885 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:48.879+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:49.125 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:49.116+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:49.217 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:49.210+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:49.226 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:49.213+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:49.356 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:49.348+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:49.360 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:49.354+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:49.458 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:49.451+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:49.661 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:49.651+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:49.887 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:49.883+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:50.149 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:50.143+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:50.218 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:50.211+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:50.220 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:50.214+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:50.396 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:50.390+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:50.397 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:50.390+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:50.492 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:50.485+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:50.714 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:50.700+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:50.914 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:50.909+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:51.164 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:51.157+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:51.222 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:51.214+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:51.223 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:51.218+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:51.434 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:51.421+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:51.443 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:51.438+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:51.513 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:51.506+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:51.726 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:51.721+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:51.902 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:51.896+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:52.216 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:52.209+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:52.274 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:52.267+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:52.278 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:52.272+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:52.426 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:52.417+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:52.478 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:52.466+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:52.551 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:52.543+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:52.717 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:52.710+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:52.899 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:52.892+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:53.185 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:37:53.178+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.623076+0000 front 2019-12-09T18:36:20.623434+0000 (oldest deadline 2019-12-09T18:37:06.489185+0000) 2019-12-09T18:37:53.238 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:53.231+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:36:38.691530+0000 (oldest deadline 2019-12-09T18:37:18.691530+0000) 2019-12-09T18:37:53.241 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:53.237+0000 1694f700 -1 osd.6 229 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:37:53.384 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:37:53.379+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:17.698807+0000 front 2019-12-09T18:36:17.290046+0000 (oldest deadline 2019-12-09T18:37:01.024022+0000) 2019-12-09T18:37:53.439 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:37:53.432+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:20.318367+0000 front 2019-12-09T18:36:20.363933+0000 (oldest deadline 2019-12-09T18:37:03.741373+0000) 2019-12-09T18:37:53.541 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:37:53.534+0000 1694f700 -1 osd.5 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.587740+0000 front 2019-12-09T18:36:19.315193+0000 (oldest deadline 2019-12-09T18:37:05.193275+0000) 2019-12-09T18:37:53.673 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:37:53.667+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e229 v229) 2019-12-09T18:37:53.713 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:37:53.706+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:15.531997+0000 front 2019-12-09T18:36:15.604158+0000 (oldest deadline 2019-12-09T18:37:01.405533+0000) 2019-12-09T18:37:53.916 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:37:53.909+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:36:19.137430+0000 front 2019-12-09T18:36:19.151436+0000 (oldest deadline 2019-12-09T18:37:03.671457+0000) 2019-12-09T18:37:54.580 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:37:54.574+0000 1694f700 -1 osd.6 230 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e228) 2019-12-09T18:38:25.985 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:32:47.041 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:25.989 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:32:47.046 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:26.000 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:32:47.033 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:26.005 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:32:47.039 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:26.006 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:32:47.063 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:26.007 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:32:47.065 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:26.165 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:32:47.199 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:26.166 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:32:47.224 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:26.194 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:32:47.251 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:44.012 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:33:05.069 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:44.045 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:33:05.102 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:44.061 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:33:05.118 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:44.064 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:33:05.121 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:44.082 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:33:05.140 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:44.092 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:33:05.126 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:44.094 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:33:05.127 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:44.095 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:33:05.153 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:38:44.125 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:33:05.159 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:39:21.333 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:21.322+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:21.665 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:21.660+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:21.829 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:21.822+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:22.236 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:22.221+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:22.356 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:22.349+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:22.718 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:22.711+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:22.793 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:22.786+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:23.184 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:23.176+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:23.341 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:23.333+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:23.355 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:23.350+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:23.765 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:23.758+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:23.789 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:23.784+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:24.024 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:24.018+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:24.142 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:24.136+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:24.318 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:24.312+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:24.407 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:24.401+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:24.746 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:24.740+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:24.817 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:24.810+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:25.031 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:25.026+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:25.111 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:25.103+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:25.309 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:25.303+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:25.384 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:25.376+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:25.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:25.419+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:25.746 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:25.741+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:25.801 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:25.793+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:26.005 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:25.999+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:26.139 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:26.133+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:26.341 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:26.333+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:26.399 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:26.393+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:26.413 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:26.406+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:26.744 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:26.738+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:26.835 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:26.830+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:26.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:26.963+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:27.167 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:27.160+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:27.343 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:27.337+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:27.366 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:27.359+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:27.463 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:27.453+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:27.714 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:27.709+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:27.806 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:27.801+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:27.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:27.965+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:28.176 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:28.170+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:28.329 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:28.323+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:28.405 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:28.398+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:28.423 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:28.416+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:28.689 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:28.684+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:28.815 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:28.809+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:28.929 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:28.924+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:29.166 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:29.161+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:29.296 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:29.290+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:29.410 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:29.403+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:29.447 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:29.435+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:29.677 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:29.671+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:29.856 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:29.851+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:29.957 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:29.947+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:30.133 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:30.123+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:30.285 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:30.280+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:30.366 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:30.360+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:30.398 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:30.392+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:30.710 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:30.704+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:30.868 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:30.862+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:30.957 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:30.953+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:31.164 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:31.158+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:31.316 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:31.309+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:31.342 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:31.335+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:31.384 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:31.378+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:31.750 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:31.743+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:31.861 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:31.856+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:31.940 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:31.934+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:32.149 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:32.143+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:32.338 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:32.326+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:32.338 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:32.331+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:32.341 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:32.335+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:32.777 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:32.771+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:32.880 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:32.874+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:32.949 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:32.944+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:33.161 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:33.154+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:33.306 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:33.299+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:33.309 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:33.302+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:33.388 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:33.382+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:33.769 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:33.763+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:33.913 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:33.908+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:33.961 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:33.956+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:34.172 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:34.167+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:34.284 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:34.275+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:34.353 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:34.344+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:34.396 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:34.388+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:34.760 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:34.754+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:34.923 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:34.917+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:34.935 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:34.929+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:35.187 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:35.181+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:35.244 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:35.238+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:35.328 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:35.319+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:35.384 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:35.377+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:35.776 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:35.770+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:35.902 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:35.897+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:35.913 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:35.907+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:36.175 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:36.168+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:36.283 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:36.277+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:36.290 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:36.284+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:36.395 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:36.388+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:36.768 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:36.763+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:36.913 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:36.906+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:36.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:36.920+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:37.167 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:37.160+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:37.241 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:37.234+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:37.329 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:37.323+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:37.381 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:37.375+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:37.738 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:37.733+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:37.885 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:37.875+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:37.958 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:37.952+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:38.124 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:38.118+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:38.282 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:38.274+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:38.339 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:38.333+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:38.421 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:38.413+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:38.718 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:38.711+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:38.885 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:38.879+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:38.924 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:38.919+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:39.175 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:39.170+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:39.296 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:39.292+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:39.362 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:39.357+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:39.398 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:39.392+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:39.758 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:39.753+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:39.842 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:39.837+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:39.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:39.919+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:40.131 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:40.126+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:40.252 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:40.246+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:40.369 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:40.363+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:40.376 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:40.372+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:40.770 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:40.764+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:40.867 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:40.861+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:40.918 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:40.908+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:41.139 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:41.134+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:41.298 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:41.293+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:41.349 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:41.344+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:41.422 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:41.417+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:41.761 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:41.756+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:41.854 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:41.849+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:41.897 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:41.890+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:42.104 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:42.097+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:42.285 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:42.280+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:42.385 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:42.378+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:42.418 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:42.413+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:42.799 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:42.794+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:42.881 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:42.876+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:42.899 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:42.893+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:43.125 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:43.118+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:43.305 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:43.299+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:43.413 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:43.408+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:43.429 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:43.422+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:43.805 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:43.800+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:43.919 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:43.915+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:43.945 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:43.935+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:44.129 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:44.124+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:44.280 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:44.274+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:44.381 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:44.375+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:44.446 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:44.440+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:44.856 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:44.850+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:44.915 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:44.908+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:44.969 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:44.956+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:45.104 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:45.093+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:45.294 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:45.290+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:45.351 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:45.345+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:45.484 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:45.479+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:45.818 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:45.812+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:45.916 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:45.911+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:45.959 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:45.953+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:46.095 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:46.089+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:46.318 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:46.313+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:46.358 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:46.352+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:46.461 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:46.455+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:46.825 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:46.819+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:46.894 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:46.888+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:47.003 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:46.992+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:47.111 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:47.106+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:47.356 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:47.351+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:47.398 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:47.392+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:47.498 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:47.493+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:47.877 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:47.872+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:47.920 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:47.915+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:48.025 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:48.019+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:48.066 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:48.061+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:48.375 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:48.371+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:48.395 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:48.389+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:48.492 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:48.485+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:48.915 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:48.909+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:48.935 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:48.929+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:49.025 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:49.019+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:49.060 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:49.055+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:49.332 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:49.327+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:49.403 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:49.398+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:49.538 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:49.532+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:49.908 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:49.903+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:49.916 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:49.910+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:50.022 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:50.016+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:50.059 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:50.055+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:50.376 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:50.372+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:50.444 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:50.439+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:50.557 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:50.552+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:50.894 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:50.888+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:50.957 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:50.951+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:50.985 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:50.979+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:51.076 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:51.070+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:51.381 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:51.375+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:51.436 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:51.431+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:51.546 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:51.540+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:51.926 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:51.921+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:51.934 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:51.929+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:51.950 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:51.945+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:52.039 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:52.033+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:52.397 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:52.392+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:52.475 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:52.470+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:52.502 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:52.497+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:52.947 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:52.942+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:52.953 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:52.948+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:52.963 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:52.958+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:53.022 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:53.000+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:53.406 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:53.401+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:53.478 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:53.472+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:53.494 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:53.489+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:53.961 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:53.956+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:53.979 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:53.975+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:53.991 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:53.986+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:54.027 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:54.022+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:54.212 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:39:54.206+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e235 v235) 2019-12-09T18:39:54.448 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:54.442+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:54.488 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:54.482+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:54.540 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:54.535+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:55.003 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:54.998+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:55.018 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:55.012+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:55.030 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:55.023+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:55.045 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:55.036+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:55.470 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:55.465+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:55.503 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:55.498+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:55.508 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:55.503+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:55.982 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:55.978+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:55.988 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:55.983+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:55.995 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:55.989+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:56.046 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:56.040+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:56.469 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:56.459+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:56.469 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:56.463+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:56.537 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:56.530+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:56.938 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:56.933+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:57.006 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:57.000+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:57.031 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:57.027+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:57.063 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:57.059+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:57.472 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:57.466+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:57.488 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:57.483+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:57.579 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:57.575+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:57.952 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:57.947+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:58.024 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:58.018+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:58.047 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:58.041+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:58.078 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:58.072+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:58.515 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:39:58.509+0000 1694f700 -1 osd.2 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.076212+0000 front 2019-12-09T18:38:39.253983+0000 (oldest deadline 2019-12-09T18:39:24.439469+0000) 2019-12-09T18:39:58.538 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:39:58.532+0000 1694f700 -1 osd.1 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.023989+0000 front 2019-12-09T18:38:39.254845+0000 (oldest deadline 2019-12-09T18:39:23.103792+0000) 2019-12-09T18:39:58.598 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:39:58.593+0000 1694f700 -1 osd.3 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082805+0000 front 2019-12-09T18:38:36.702936+0000 (oldest deadline 2019-12-09T18:39:21.176169+0000) 2019-12-09T18:39:58.939 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:39:58.935+0000 1694f700 -1 osd.0 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:37.082803+0000 front 2019-12-09T18:38:35.992693+0000 (oldest deadline 2019-12-09T18:39:21.690979+0000) 2019-12-09T18:39:59.030 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:39:59.022+0000 1694f700 -1 osd.4 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:41.349859+0000 front 2019-12-09T18:38:40.860377+0000 (oldest deadline 2019-12-09T18:39:20.771079+0000) 2019-12-09T18:39:59.095 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:39:59.090+0000 1694f700 -1 osd.7 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:40.609536+0000 front 2019-12-09T18:38:40.860602+0000 (oldest deadline 2019-12-09T18:39:23.986054+0000) 2019-12-09T18:39:59.130 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:39:59.125+0000 1694f700 -1 osd.5 235 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:38:39.340547+0000 front 2019-12-09T18:38:39.046207+0000 (oldest deadline 2019-12-09T18:39:21.324842+0000) 2019-12-09T18:39:59.286 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:39:59.280+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e235 v235) 2019-12-09T18:40:57.155 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:40:57.148+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:40:57.420 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:40:57.413+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:40:58.208 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:40:58.195+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:40:58.435 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:40:58.428+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:40:59.213 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:40:59.204+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:40:59.402 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:40:59.395+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:40:59.647 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:40:59.642+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:00.140 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:00.134+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:00.203 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:00.198+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:00.370 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:00.364+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:00.622 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:00.616+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:00.658 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:41:00.652+0000 1694f700 -1 osd.3 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:16.289196+0000 front 2019-12-09T18:40:16.290641+0000 (oldest deadline 2019-12-09T18:40:59.739629+0000) 2019-12-09T18:41:01.139 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:01.132+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:01.238 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:01.233+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:01.343 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:01.335+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:01.644 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:01.638+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:01.675 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:41:01.671+0000 1694f700 -1 osd.3 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:16.289196+0000 front 2019-12-09T18:40:16.290641+0000 (oldest deadline 2019-12-09T18:40:59.739629+0000) 2019-12-09T18:41:01.746 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:01.739+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:02.174 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:02.167+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:02.235 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:02.229+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:02.306 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:02.299+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:02.603 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:02.593+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:02.680 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:41:02.674+0000 1694f700 -1 osd.3 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:16.289196+0000 front 2019-12-09T18:40:16.290641+0000 (oldest deadline 2019-12-09T18:40:59.739629+0000) 2019-12-09T18:41:02.790 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:02.784+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:03.113 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:03.108+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:03.181 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:03.173+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:03.226 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:03.219+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:03.317 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:03.310+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:03.563 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:03.557+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:03.671 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:41:03.665+0000 1694f700 -1 osd.3 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:16.289196+0000 front 2019-12-09T18:40:16.290641+0000 (oldest deadline 2019-12-09T18:40:59.739629+0000) 2019-12-09T18:41:03.802 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:03.793+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:04.116 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:04.111+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:04.193 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:04.186+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:04.207 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:04.201+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:04.297 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:04.290+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:04.597 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:04.589+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:04.768 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:04.762+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:05.075 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:05.071+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:05.157 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:05.149+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:05.178 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:05.173+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:05.329 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:05.321+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:05.570 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:05.566+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:05.766 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:05.759+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:06.091 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:06.086+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:06.167 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:06.159+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:06.169 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:06.162+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:06.360 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:06.353+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:06.625 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:06.619+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:06.784 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:06.777+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:07.138 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:07.133+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:07.147 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:07.140+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:07.218 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:07.212+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:07.384 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:07.378+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:07.608 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:07.602+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:07.778 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:07.770+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:08.132 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:08.126+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:08.164 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:08.159+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:08.243 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:08.236+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:08.341 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:08.332+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:08.619 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:08.611+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:08.760 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:08.753+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:09.165 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:09.159+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:09.201 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:09.196+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:09.249 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:09.244+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:09.338 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:09.331+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:09.613 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:09.605+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:09.713 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:09.708+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:10.162 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:10.157+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:10.182 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:10.176+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:10.282 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:10.276+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:10.319 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:10.312+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:10.585 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:10.571+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:10.676 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:10.669+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:11.170 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:11.161+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:11.203 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:11.196+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:11.204 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:11.199+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:11.337 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:11.324+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:11.351 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:11.344+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:11.545 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:11.534+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:11.676 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:11.670+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:12.210 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:12.203+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:12.238 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:12.231+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:12.243 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:12.238+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:12.359 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:12.352+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:12.365 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:12.360+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:12.581 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:12.573+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:12.713 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:12.706+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:13.202 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:13.193+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:13.202 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:13.197+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:13.247 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:13.241+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:13.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:13.346+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:13.366 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:13.360+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:13.582 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:13.575+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:13.746 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:13.738+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:14.210 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:14.202+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:14.211 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:14.206+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:14.300 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:14.293+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:14.327 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:14.321+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:14.412 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:14.405+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:14.633 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:14.619+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:14.768 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:14.761+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:15.194 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:15.186+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:15.195 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:15.189+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:15.282 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:15.274+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:15.283 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:15.277+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:15.405 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:15.392+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:15.646 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:15.640+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:15.761 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:15.754+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:16.192 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:16.186+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:16.196 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:16.191+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:16.289 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:16.282+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:16.337 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:16.331+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:16.393 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:16.386+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:16.690 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:16.684+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:16.766 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:16.758+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:17.183 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:17.175+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:17.184 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:17.179+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:17.287 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:17.281+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:17.314 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:17.308+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:17.421 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:17.414+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:17.657 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:17.652+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:17.772 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:17.761+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:18.145 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:18.137+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:18.148 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:18.143+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:18.299 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:18.292+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:18.361 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:18.355+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:18.420 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:18.413+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:18.649 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:18.643+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:18.822 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:18.815+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:19.139 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:19.131+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:19.141 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:19.134+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:19.328 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:19.320+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:19.377 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:19.364+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:19.465 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:19.457+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:19.659 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:19.654+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:19.778 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:19.771+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:20.097 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:20.090+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:20.101 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:20.096+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:20.328 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:20.321+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:20.343 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:20.338+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:20.495 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:20.488+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:20.619 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:20.614+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:20.823 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:20.816+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:21.064 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:21.056+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:21.065 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:21.059+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:21.283 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:21.276+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:21.326 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:21.320+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:21.507 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:21.501+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:21.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:21.611+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:21.800 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:21.795+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:22.035 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:22.027+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:22.036 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:22.030+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:22.287 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:22.281+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:22.342 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:22.334+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:22.570 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:22.554+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:22.656 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:22.649+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:22.775 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:22.769+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:23.022 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:23.015+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:23.022 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:23.017+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:23.337 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:23.331+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:23.372 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:23.366+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:23.548 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:23.540+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:23.653 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:23.646+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:23.789 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:23.783+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:23.975 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:23.969+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:23.977 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:23.971+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:24.360 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:24.353+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:24.378 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:24.371+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:24.544 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:24.537+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:24.693 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:24.683+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:24.757 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:24.750+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:24.939 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:24.932+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:24.940 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:24.935+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:25.369 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:25.361+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:25.417 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:25.410+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:25.516 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:25.509+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:25.688 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:25.681+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:25.808 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:25.803+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:25.901 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:25.894+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:25.902 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:25.897+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:26.324 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:26.317+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:26.392 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:26.385+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:26.488 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:26.473+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:26.678 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:26.671+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:26.781 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:26.774+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:26.940 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:26.932+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:26.943 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:26.935+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:27.350 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:27.343+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:27.361 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:27.353+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:27.525 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:27.518+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:27.708 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:27.702+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:27.821 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:27.802+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:27.926 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:27.919+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:27.927 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:27.922+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:28.316 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:28.310+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:28.345 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:28.339+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:28.536 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:28.527+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:28.723 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:28.716+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:28.830 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:28.824+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:28.887 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:28.879+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:28.887 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:28.882+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:29.356 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:29.349+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:29.378 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:29.371+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:29.534 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:29.526+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:29.542 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:41:29.534+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e241 v241) 2019-12-09T18:41:29.717 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:29.710+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:29.804 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:29.797+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:29.873 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:29.863+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:29.873 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:29.866+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:30.329 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:30.321+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:30.356 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:30.334+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:30.515 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:30.508+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:30.672 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:30.667+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:30.854 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:30.846+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:30.895 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:30.889+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:30.898 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:30.894+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:31.308 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:31.301+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:31.381 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:31.374+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:31.544 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:31.536+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:31.637 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:31.627+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:31.900 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:31.892+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:31.944 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:31.936+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:31.945 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:31.939+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:32.281 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:32.275+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:32.393 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:32.380+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:32.544 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:32.537+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:32.617 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:32.610+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:32.909 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:32.899+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:32.910 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:32.905+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:32.937 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:32.930+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:33.284 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:33.277+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:33.424 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:33.415+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:33.566 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:33.559+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:33.617 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:33.606+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:33.896 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:33.890+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:33.899 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:33.895+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:33.966 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:33.959+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:34.314 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:34.307+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:34.413 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:34.407+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:34.558 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:34.551+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:34.559 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:41:34.554+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e241 v241) 2019-12-09T18:41:34.570 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:34.563+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:34.923 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:34.916+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:34.951 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:34.945+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:34.955 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:34.950+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:35.315 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:35.308+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:35.400 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:35.392+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:35.541 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:35.535+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:35.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:35.579+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:35.913 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:35.905+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:35.916 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:35.911+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:35.953 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:35.943+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:36.283 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:36.277+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:36.378 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:36.368+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:36.573 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:36.565+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:36.594 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:36.587+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:36.964 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:36.956+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:36.965 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:36.959+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:36.975 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:36.968+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:37.292 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:37.286+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:37.375 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:37.369+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:37.568 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:37.561+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:37.586 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:37.564+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:37.977 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:37.969+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:37.978 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:37.972+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:38.021 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:38.015+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:38.255 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:38.250+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:38.409 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:38.372+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:38.526 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:38.518+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:38.559 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:38.552+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:38.965 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:38.960+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:38.972 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:38.963+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:39.035 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:39.029+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:39.274 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:39.269+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:39.339 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:39.333+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:39.539 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:39.530+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:39.575 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:41:39.568+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e241 v241) 2019-12-09T18:41:39.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:39.581+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:40.000 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:39.992+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:40.003 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:39.995+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:40.053 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:40.044+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:40.281 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:40.275+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:40.341 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:40.333+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:40.501 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:40.489+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:40.591 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:40.584+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:41.052 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:41.045+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:41.053 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:41.048+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:41.081 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:41.068+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:41.325 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:41.317+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:41.329 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:41.322+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:41.498 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:41.492+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:41.573 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:41.566+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:42.081 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:42.074+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:42.082 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:42.077+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:42.111 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:42.104+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:42.283 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:42.277+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:42.341 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:42.334+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:42.513 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:42.507+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:42.617 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:42.610+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:43.108 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:43.100+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:43.108 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:43.103+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:43.130 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:43.123+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:43.288 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:43.281+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:43.308 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:43.301+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:43.541 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:43.533+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:43.628 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:43.619+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:41:44.144 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:44.136+0000 1694f700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:40:30.157750+0000 (oldest deadline 2019-12-09T18:41:10.157750+0000) 2019-12-09T18:41:44.148 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:41:44.140+0000 1694f700 -1 osd.6 241 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e239) 2019-12-09T18:41:44.159 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:41:44.152+0000 1694f700 -1 osd.5 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.705414+0000 front 2019-12-09T18:40:15.517337+0000 (oldest deadline 2019-12-09T18:41:01.226877+0000) 2019-12-09T18:41:44.255 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:41:44.248+0000 1694f700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:14.946573+0000 front 2019-12-09T18:40:15.539317+0000 (oldest deadline 2019-12-09T18:40:59.970413+0000) 2019-12-09T18:41:44.287 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:41:44.279+0000 1694f700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:12.996905+0000 front 2019-12-09T18:40:13.525661+0000 (oldest deadline 2019-12-09T18:40:57.046560+0000) 2019-12-09T18:41:44.598 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:41:44.585+0000 1694f700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.950284+0000 front 2019-12-09T18:40:16.044789+0000 (oldest deadline 2019-12-09T18:40:58.646156+0000) 2019-12-09T18:41:44.631 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:41:44.622+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e241 v241) 2019-12-09T18:41:44.722 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:41:44.706+0000 1694f700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:40:15.353971+0000 front 2019-12-09T18:40:15.545649+0000 (oldest deadline 2019-12-09T18:40:57.017650+0000) 2019-12-09T18:42:16.276 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:42:16.198+0000 31f87700 -1 osd.6 245 build_incremental_map_msg missing incremental map 245 2019-12-09T18:42:16.289 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:42:16.199+0000 31f87700 -1 osd.6 245 build_incremental_map_msg missing incremental map 245 2019-12-09T18:42:16.349 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:42:16.241+0000 31f87700 -1 osd.6 245 build_incremental_map_msg missing incremental map 245 2019-12-09T18:42:16.458 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:42:16.323+0000 36790700 -1 osd.6 245 build_incremental_map_msg missing incremental map 245 2019-12-09T18:42:16.467 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:42:16.335+0000 31786700 -1 osd.6 245 build_incremental_map_msg missing incremental map 245 2019-12-09T18:42:16.810 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:42:16.805+0000 34f8d700 -1 osd.6 245 build_incremental_map_msg missing incremental map 245 2019-12-09T18:42:22.512 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:36:43.569 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:42:22.518 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:36:43.575 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:42:22.529 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:36:43.562 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:42:22.529 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:36:43.586 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:42:22.532 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:36:43.589 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:42:22.539 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:36:43.572 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:42:22.796 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:36:43.829 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:42:22.844 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:36:43.896 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:42:22.865 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:36:43.922 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:18.053 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:18.048+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:19.085 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:19.080+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:19.176 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:19.170+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:19.258 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:19.252+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:19.339 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:19.332+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:19.824 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:19.818+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:20.096 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:20.090+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:20.231 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:20.226+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:20.299 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:20.293+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:20.386 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:20.381+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:20.872 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:20.867+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:20.873 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:20.868+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:21.086 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:21.081+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:21.190 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:21.185+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:21.298 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:21.292+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:21.389 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:21.385+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:21.597 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:21.591+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:21.845 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:21.840+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:21.849 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:21.844+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:22.048 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:22.043+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:22.191 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:22.184+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:22.294 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:22.290+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:22.347 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:22.342+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:22.647 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:22.641+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:22.840 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:22.836+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:22.895 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:22.890+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:23.035 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:23.026+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:23.227 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:23.223+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:23.315 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:23.308+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:23.329 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:23.324+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:23.678 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:23.667+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:23.836 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:23.831+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:23.905 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:23.900+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:24.035 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:24.030+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:24.199 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:24.193+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:24.302 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:24.296+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:24.332 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:24.328+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:24.644 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:24.639+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:24.876 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:24.871+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:24.877 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:24.872+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:24.994 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:24.987+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:25.193 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:25.188+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:25.261 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:25.254+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:25.314 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:25.310+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:25.667 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:25.661+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:25.843 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:25.837+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:25.877 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:25.868+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:25.966 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:25.961+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:26.182 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:26.177+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:26.285 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:26.278+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:26.365 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:26.359+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:26.643 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:26.637+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:26.864 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:26.858+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:26.903 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:26.897+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:26.956 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:26.949+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:27.211 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:27.205+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:27.337 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:27.331+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:27.389 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:27.384+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:27.649 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:27.643+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:27.877 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:27.871+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:27.941 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:27.936+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:27.979 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:27.970+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:28.177 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:28.170+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:28.377 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:28.360+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:28.397 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:28.387+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:28.671 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:28.665+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:28.865 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:28.855+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:28.904 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:28.898+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:29.022 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:29.017+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:29.194 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:29.188+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:29.381 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:29.375+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:29.395 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:29.387+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:29.663 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:29.658+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:29.891 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:29.886+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:29.905 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:29.889+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:30.051 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:30.046+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:30.190 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:30.185+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:30.371 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:30.365+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:30.430 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:30.425+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:30.643 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:30.637+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:30.911 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:30.906+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:30.920 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:30.916+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:31.067 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:31.061+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:31.152 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:31.146+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:31.395 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:31.386+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:31.458 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:31.452+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:31.620 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:31.612+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:31.874 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:31.868+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:31.949 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:31.943+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:32.067 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:32.061+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:32.156 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:32.150+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:32.435 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:32.428+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:32.508 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:32.498+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:32.624 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:32.618+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:32.859 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:32.853+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:32.957 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:32.951+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:33.050 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:33.044+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:33.205 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:33.200+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:33.403 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:33.397+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:33.516 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:33.510+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:33.580 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:33.574+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:33.814 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:33.808+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:33.919 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:33.913+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:34.009 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:34.003+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:34.176 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:34.167+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:34.357 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:34.351+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:34.543 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:34.537+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:34.610 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:34.604+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:34.856 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:34.849+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:34.887 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:34.878+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:35.048 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:35.042+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:35.171 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:35.166+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:35.380 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:35.375+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:35.581 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:35.572+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:35.624 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:35.617+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:35.876 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:35.863+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:35.876 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:35.864+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:36.075 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:36.070+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:36.211 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:36.205+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:36.338 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:36.332+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:36.566 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:36.560+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:36.660 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:36.654+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:36.831 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:36.825+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:36.852 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:36.845+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:37.093 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:37.087+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:37.205 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:37.196+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:37.315 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:37.310+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:37.539 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:37.534+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:37.622 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:37.617+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:37.821 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:37.812+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:37.864 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:37.853+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:38.108 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:38.100+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:38.196 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:38.187+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:38.343 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:38.338+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:38.561 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:38.555+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:38.670 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:38.665+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:38.825 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:38.817+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:38.854 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:38.848+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:39.061 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:39.055+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:39.231 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:39.223+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:39.370 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:39.363+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:39.587 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:39.580+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:39.713 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:39.705+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:39.801 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:39.795+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:39.807 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:39.802+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:40.015 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:40.010+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:40.247 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:40.242+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:40.420 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:40.414+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:40.541 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:40.535+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:40.679 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:40.674+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:40.792 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:40.786+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:40.832 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:40.826+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:41.040 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:41.034+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:41.262 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:41.256+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:41.392 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:41.387+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:41.539 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:41.533+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:41.691 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:41.685+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:41.804 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:41.798+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:41.837 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:41.830+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:42.013 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:42.008+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:42.225 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:42.219+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:42.381 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:42.373+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:42.530 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:42.523+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:42.719 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:42.713+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:42.824 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:42.816+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:42.841 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:42.834+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:42.979 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:42.973+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:43.257 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:43.250+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:43.376 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:43.368+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:43.544 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:43.538+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:43.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:43.714+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:43.799 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:43.793+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:43.812 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:43.806+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:43.943 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:43.936+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:44.236 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:44.231+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:44.401 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:44.395+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:44.568 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:44.561+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:44.743 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:44.737+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:44.769 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:44.763+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:44.840 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:44.834+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:44.936 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:44.929+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:45.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:45.214+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:45.455 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:45.449+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:45.554 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:45.549+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:45.733 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:45.727+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:45.750 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:45.745+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:45.805 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:45.799+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:45.926 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:45.920+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:46.213 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:46.207+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:46.494 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:46.488+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:46.542 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:46.536+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:46.709 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:46.703+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:46.741 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:46.735+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:46.797 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:46.791+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:46.908 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:46.902+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:47.224 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:47.218+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:47.466 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:47.460+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:47.527 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:47.521+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:47.698 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:47.692+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:47.743 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:47.736+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:47.853 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:47.831+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:47.923 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:47.917+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:48.201 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:48.196+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:48.505 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:48.499+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:48.523 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:48.517+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:48.667 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:48.661+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:48.712 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:48.705+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:48.824 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:48.818+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:48.959 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:48.953+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:49.175 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:49.169+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:49.483 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:49.477+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:49.539 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:49.534+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:49.665 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:49.660+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:49.764 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:49.757+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:49.855 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:49.849+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:49.975 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:49.969+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:50.014 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:43:50.008+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e246 v246) 2019-12-09T18:43:50.191 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:50.186+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:50.483 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:50.477+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:50.580 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:50.572+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:50.654 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:50.649+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:50.741 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:50.729+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:50.859 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:50.852+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:50.968 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:50.962+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:51.201 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:51.195+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:51.514 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:51.507+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:51.551 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:51.544+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:51.666 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:51.661+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:51.720 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:51.714+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:51.906 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:51.900+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:51.979 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:51.968+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:52.215 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:52.210+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:52.504 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:52.498+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:52.535 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:52.528+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:52.727 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:52.721+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:52.746 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:52.737+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:52.887 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:52.881+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:53.025 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:53.015+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:53.232 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:53.226+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:53.473 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:53.465+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:53.494 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:53.488+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:53.714 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:53.707+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:53.717 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:53.711+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:53.909 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:53.903+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:54.009 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:54.004+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:54.223 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:54.218+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:43:54.441 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:43:54.429+0000 1694f700 -1 osd.0 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.130385+0000 front 2019-12-09T18:42:35.669926+0000 (oldest deadline 2019-12-09T18:43:19.107043+0000) 2019-12-09T18:43:54.511 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:43:54.505+0000 1694f700 -1 osd.4 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.236790+0000 front 2019-12-09T18:42:37.226273+0000 (oldest deadline 2019-12-09T18:43:18.296151+0000) 2019-12-09T18:43:54.700 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:43:54.694+0000 1694f700 -1 osd.5 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.442499+0000 front 2019-12-09T18:42:36.436131+0000 (oldest deadline 2019-12-09T18:43:20.945214+0000) 2019-12-09T18:43:54.715 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:43:54.707+0000 1694f700 -1 osd.3 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.680481+0000 front 2019-12-09T18:42:36.776594+0000 (oldest deadline 2019-12-09T18:43:19.466131+0000) 2019-12-09T18:43:54.892 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:43:54.887+0000 1694f700 -1 osd.2 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:36.183345+0000 front 2019-12-09T18:42:36.267853+0000 (oldest deadline 2019-12-09T18:43:20.211513+0000) 2019-12-09T18:43:55.049 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:43:55.038+0000 1694f700 -1 osd.1 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:37.215592+0000 front 2019-12-09T18:42:36.693090+0000 (oldest deadline 2019-12-09T18:43:17.773668+0000) 2019-12-09T18:43:55.085 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:43:55.075+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e246 v246) 2019-12-09T18:43:55.211 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:43:55.205+0000 1694f700 -1 osd.7 246 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:42:35.905662+0000 front 2019-12-09T18:42:35.957796+0000 (oldest deadline 2019-12-09T18:43:18.605274+0000) 2019-12-09T18:44:31.468 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:44:31.421+0000 3578e700 -1 osd.6 251 build_incremental_map_msg missing incremental map 251 2019-12-09T18:44:31.529 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:44:31.464+0000 31786700 -1 osd.6 251 build_incremental_map_msg missing incremental map 251 2019-12-09T18:44:31.647 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:44:31.584+0000 36790700 -1 osd.6 251 build_incremental_map_msg missing incremental map 251 2019-12-09T18:44:32.475 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:44:32.454+0000 33f8b700 -1 osd.6 252 build_incremental_map_msg missing incremental map 252 2019-12-09T18:44:32.566 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:44:32.485+0000 38f95700 -1 osd.6 252 build_incremental_map_msg missing incremental map 252 2019-12-09T18:44:32.599 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:44:32.510+0000 32788700 -1 osd.6 252 build_incremental_map_msg missing incremental map 252 2019-12-09T18:44:32.644 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:44:32.525+0000 34f8d700 -1 osd.6 252 build_incremental_map_msg missing incremental map 251 2019-12-09T18:44:32.696 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:44:32.567+0000 38f95700 -1 osd.6 252 build_incremental_map_msg missing incremental map 252 2019-12-09T18:44:32.781 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:44:32.621+0000 31f87700 -1 osd.6 252 build_incremental_map_msg missing incremental map 252 2019-12-09T18:44:32.878 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:44:32.743+0000 36f91700 -1 osd.6 252 build_incremental_map_msg missing incremental map 252 2019-12-09T18:44:33.608 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:44:33.580+0000 34f8d700 -1 osd.6 252 build_incremental_map_msg missing incremental map 251 2019-12-09T18:44:33.610 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:44:33.581+0000 34f8d700 -1 osd.6 252 build_incremental_map_msg missing incremental map 252 2019-12-09T18:44:53.294 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:44:53.288+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:44:53.412 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:44:53.405+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:44:53.693 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:44:53.682+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:44:54.243 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:44:54.237+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:44:54.291 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:44:54.275+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:44:54.382 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:44:54.374+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:44:54.678 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:44:54.670+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:44:55.233 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:44:55.226+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:44:55.294 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:44:55.288+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:44:55.347 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:44:55.340+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:44:55.711 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:44:55.702+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:44:56.208 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:44:56.198+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:44:56.283 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:44:56.276+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:44:56.337 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:44:56.327+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:44:56.733 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:44:56.727+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:44:57.200 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:44:57.193+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:44:57.303 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:44:57.297+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:44:57.365 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:44:57.353+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:44:57.373 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:44:57.363+0000 1694f700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.003654+0000 front 2019-12-09T18:44:11.046452+0000 (oldest deadline 2019-12-09T18:44:56.884557+0000) 2019-12-09T18:44:57.704 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:44:57.697+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:44:58.218 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:44:58.210+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:44:58.241 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:44:58.235+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:44:58.275 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:44:58.269+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:44:58.411 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:44:58.404+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:44:58.412 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:44:58.406+0000 1694f700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.003654+0000 front 2019-12-09T18:44:11.046452+0000 (oldest deadline 2019-12-09T18:44:56.884557+0000) 2019-12-09T18:44:58.665 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:44:58.656+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:44:59.247 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:44:59.243+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:44:59.270 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:44:59.261+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:44:59.275 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:44:59.268+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:44:59.411 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:44:59.404+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:44:59.458 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:44:59.453+0000 1694f700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.003654+0000 front 2019-12-09T18:44:11.046452+0000 (oldest deadline 2019-12-09T18:44:56.884557+0000) 2019-12-09T18:44:59.705 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:44:59.700+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:00.259 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:00.253+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:00.266 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:00.258+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:00.303 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:00.295+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:00.395 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:00.389+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:00.505 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:45:00.498+0000 1694f700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.003654+0000 front 2019-12-09T18:44:11.046452+0000 (oldest deadline 2019-12-09T18:44:56.884557+0000) 2019-12-09T18:45:00.728 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:00.723+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:01.257 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:01.252+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:01.275 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:01.268+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:01.276 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:01.269+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:01.405 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:01.390+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:01.561 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:45:01.553+0000 1694f700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.003654+0000 front 2019-12-09T18:44:11.046452+0000 (oldest deadline 2019-12-09T18:44:56.884557+0000) 2019-12-09T18:45:01.706 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:01.700+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:02.297 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:02.291+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:02.316 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:02.293+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:02.318 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:02.311+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:02.410 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:02.403+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:02.518 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:45:02.513+0000 1694f700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.003654+0000 front 2019-12-09T18:44:11.046452+0000 (oldest deadline 2019-12-09T18:44:56.884557+0000) 2019-12-09T18:45:02.709 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:02.704+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:03.114 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:03.108+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:03.263 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:03.253+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:03.287 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:03.281+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:03.350 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:03.344+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:03.451 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:03.445+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:03.531 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:45:03.525+0000 1694f700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.003654+0000 front 2019-12-09T18:44:11.046452+0000 (oldest deadline 2019-12-09T18:44:56.884557+0000) 2019-12-09T18:45:03.735 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:03.725+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:04.089 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:04.084+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:04.278 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:04.272+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:04.303 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:04.285+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:04.318 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:04.313+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:04.485 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:04.478+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:04.511 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:45:04.506+0000 1694f700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.003654+0000 front 2019-12-09T18:44:11.046452+0000 (oldest deadline 2019-12-09T18:44:56.884557+0000) 2019-12-09T18:45:04.756 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:04.750+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:05.079 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:05.071+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:05.247 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:05.241+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:05.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:05.300+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:05.330 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:05.321+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:05.456 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:05.448+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:05.479 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:45:05.474+0000 1694f700 -1 osd.3 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.003654+0000 front 2019-12-09T18:44:11.046452+0000 (oldest deadline 2019-12-09T18:44:56.884557+0000) 2019-12-09T18:45:05.763 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:05.757+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:06.092 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:06.085+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:06.245 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:06.235+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:06.287 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:06.280+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:06.294 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:06.286+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:06.421 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:06.413+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:06.801 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:06.795+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:07.085 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:07.077+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:07.262 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:07.253+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:07.277 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:07.270+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:07.278 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:07.270+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:07.465 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:07.457+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:07.830 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:07.825+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:08.072 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:08.066+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:08.076 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:08.071+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:08.260 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:08.254+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:08.295 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:08.290+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:08.297 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:08.291+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:08.518 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:08.510+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:08.805 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:08.798+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:09.080 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:09.072+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:09.082 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:09.076+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:09.233 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:09.225+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:09.275 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:09.269+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:09.323 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:09.316+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:09.541 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:09.533+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:09.776 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:09.771+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:10.131 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:10.125+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:10.135 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:10.130+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:10.231 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:10.226+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:10.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:10.245+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:10.284 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:10.277+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:10.597 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:10.590+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:10.742 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:10.737+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:11.116 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:11.109+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:11.117 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:11.112+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:11.201 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:11.195+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:11.284 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:11.277+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:11.331 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:11.323+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:11.611 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:11.605+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:11.757 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:11.752+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:12.100 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:12.091+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:12.104 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:12.098+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:12.239 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:12.233+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:12.268 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:12.260+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:12.330 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:12.322+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:12.656 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:12.649+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:12.756 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:12.748+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:13.121 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:13.114+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:13.123 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:13.119+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:13.195 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:13.188+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:13.311 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:13.291+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:13.332 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:13.321+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:13.652 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:13.645+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:13.770 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:13.765+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:14.111 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:14.103+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:14.111 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:14.107+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:14.196 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:14.192+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:14.299 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:14.290+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:14.377 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:14.370+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:14.632 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:14.624+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:14.756 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:14.749+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:15.153 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:15.145+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:15.157 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:15.148+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:15.169 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:15.160+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:15.281 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:15.272+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:15.410 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:15.403+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:15.623 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:15.615+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:15.727 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:15.720+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:16.125 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:16.118+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:16.165 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:16.157+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:16.166 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:16.160+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:16.293 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:16.285+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:16.417 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:16.405+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:16.653 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:16.644+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:16.753 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:16.748+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:17.111 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:17.105+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:17.184 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:17.176+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:17.184 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:17.178+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:17.261 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:17.251+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:17.461 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:17.454+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:17.649 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:17.636+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:17.741 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:17.733+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:18.078 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:18.073+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:18.211 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:18.203+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:18.212 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:18.207+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:18.277 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:18.270+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:18.497 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:18.490+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:18.615 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:18.608+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:18.772 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:18.766+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:19.053 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:19.048+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:19.210 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:19.202+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:19.211 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:19.205+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:19.309 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:19.301+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:19.505 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:19.499+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:19.610 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:19.604+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:19.779 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:19.774+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:20.012 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:20.005+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:20.204 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:20.195+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:20.206 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:20.199+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:20.360 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:20.353+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:20.511 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:20.505+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:20.634 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:20.626+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:20.813 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:20.804+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:21.011 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:21.006+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:21.197 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:21.187+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:21.199 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:21.190+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:21.407 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:21.400+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:21.502 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:21.495+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:21.667 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:21.657+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:21.764 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:21.759+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:22.033 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:22.028+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:22.176 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:22.168+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:22.177 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:22.171+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:22.414 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:22.408+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:22.550 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:22.543+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:22.714 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:22.708+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:22.774 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:22.768+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:23.039 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:23.033+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:23.201 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:23.194+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:23.204 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:23.199+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:23.462 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:23.455+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:23.575 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:23.568+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:23.742 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:23.734+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:23.756 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:23.749+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:24.061 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:24.055+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:24.220 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:24.213+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:24.224 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:24.219+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:24.506 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:24.498+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:24.572 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:24.560+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:24.742 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:24.735+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:24.754 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:24.748+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:25.113 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:25.107+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:25.221 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:25.211+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:25.222 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:25.214+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:25.331 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:45:25.327+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e252 v252) 2019-12-09T18:45:25.508 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:25.501+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:25.569 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:25.564+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:25.718 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:25.707+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:25.798 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:25.791+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:26.074 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:26.067+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:26.188 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:26.182+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:26.195 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:26.187+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:26.561 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:26.551+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:26.606 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:26.598+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:26.745 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:26.734+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:26.773 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:26.767+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:27.041 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:27.032+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:27.205 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:27.197+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:27.206 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:27.201+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:27.567 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:27.560+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:27.595 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:27.588+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:27.799 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:27.793+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:27.799 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:27.790+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:28.004 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:27.997+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:28.178 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:28.172+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:28.180 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:28.175+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:28.546 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:28.538+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:28.597 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:28.589+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:28.777 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:28.771+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:28.824 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:28.818+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:29.029 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:29.024+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:29.156 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:29.150+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:29.172 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:29.155+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:29.569 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:29.557+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:29.592 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:29.585+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:29.805 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:29.798+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:29.821 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:29.816+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:30.065 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:30.058+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:30.151 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:30.143+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:30.152 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:30.147+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:30.346 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:45:30.340+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e252 v252) 2019-12-09T18:45:30.560 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:30.553+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:30.563 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:30.556+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:30.809 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:30.800+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:30.812 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:30.807+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:31.116 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:31.111+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:31.194 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:31.186+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:31.195 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:31.190+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:31.559 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:31.552+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:31.595 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:31.584+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:31.784 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:31.779+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:31.803 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:31.797+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:32.123 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:32.118+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:32.241 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:32.233+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:32.242 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:32.237+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:32.613 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:32.603+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:32.615 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:32.608+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:32.741 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:32.735+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:32.816 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:32.809+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:33.101 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:33.096+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:33.203 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:33.195+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:33.204 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:33.198+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:33.592 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:33.585+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:33.595 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:33.588+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:33.791 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:33.784+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:33.833 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:33.815+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:34.153 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:34.148+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:34.182 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:34.177+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:34.185 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:34.180+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:34.558 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:34.551+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:34.612 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:34.604+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:34.810 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:34.805+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:34.857 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:34.851+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:35.144 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:35.138+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:35.168 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:35.159+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:35.172 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:35.163+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:35.361 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:45:35.356+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e252 v252) 2019-12-09T18:45:35.526 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:35.520+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:35.618 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:35.611+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:35.772 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:35.767+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:35.901 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:35.891+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:36.109 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:36.104+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:36.134 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:36.126+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:36.136 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:36.130+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:36.515 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:36.509+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:36.660 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:36.653+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:36.792 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:36.786+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:36.940 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:36.924+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:37.128 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:37.116+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:37.133 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:37.127+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:37.133 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:37.128+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:37.500 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:37.492+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:37.623 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:37.617+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:37.786 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:37.780+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:37.936 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:37.930+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:38.106 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:38.102+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:38.192 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:38.186+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:38.194 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:38.190+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:38.494 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:38.487+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:38.614 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:38.604+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:38.767 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:38.760+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:38.934 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:38.926+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:39.159 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:39.154+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:39.233 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:39.224+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:39.234 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:39.227+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:39.488 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:39.481+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:39.648 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:39.639+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:39.722 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:45:39.715+0000 1694f700 -1 osd.1 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.867697+0000 front 2019-12-09T18:44:11.170485+0000 (oldest deadline 2019-12-09T18:44:53.170415+0000) 2019-12-09T18:45:39.953 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:45:39.947+0000 1694f700 -1 osd.4 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:09.540328+0000 front 2019-12-09T18:44:09.338037+0000 (oldest deadline 2019-12-09T18:44:53.083868+0000) 2019-12-09T18:45:40.153 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:45:40.145+0000 1694f700 -1 osd.2 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:08.052386+0000 front 2019-12-09T18:44:07.882613+0000 (oldest deadline 2019-12-09T18:44:53.071564+0000) 2019-12-09T18:45:40.249 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:40.242+0000 1694f700 -1 osd.6 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:44:27.888294+0000 (oldest deadline 2019-12-09T18:45:07.888294+0000) 2019-12-09T18:45:40.259 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:40.249+0000 1694f700 -1 osd.6 252 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e250) 2019-12-09T18:45:40.434 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:45:40.423+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e252 v252) 2019-12-09T18:45:40.481 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:45:40.468+0000 1694f700 -1 osd.7 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:10.312626+0000 front 2019-12-09T18:44:10.315661+0000 (oldest deadline 2019-12-09T18:44:53.615617+0000) 2019-12-09T18:45:40.668 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:45:40.663+0000 1694f700 -1 osd.5 252 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:44:11.897639+0000 front 2019-12-09T18:44:11.913534+0000 (oldest deadline 2019-12-09T18:44:57.505374+0000) 2019-12-09T18:45:41.293 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:45:41.263+0000 38f95700 -1 osd.6 253 build_incremental_map_msg missing incremental map 252 2019-12-09T18:46:14.977 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:46:14.781+0000 38f95700 -1 osd.0 259 build_incremental_map_msg missing incremental map 259 2019-12-09T18:46:14.980 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:46:14.795+0000 3578e700 -1 osd.0 259 build_incremental_map_msg missing incremental map 259 2019-12-09T18:46:14.981 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:46:14.796+0000 3578e700 -1 osd.0 259 build_incremental_map_msg missing incremental map 259 2019-12-09T18:46:14.982 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:46:14.799+0000 3378a700 -1 osd.0 259 build_incremental_map_msg missing incremental map 259 2019-12-09T18:46:15.070 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:46:14.913+0000 36f91700 -1 osd.0 259 build_incremental_map_msg missing incremental map 259 2019-12-09T18:46:15.958 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:46:15.949+0000 37f93700 -1 osd.0 259 build_incremental_map_msg missing incremental map 259 2019-12-09T18:46:18.270 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:40:39.327 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:46:18.278 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:40:39.336 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:46:18.292 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:40:39.350 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:46:18.294 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:40:39.327 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:46:18.296 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:40:39.354 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:46:18.297 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:40:39.331 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:46:18.533 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:40:39.562 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:46:18.576 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:40:39.629 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:46:18.582 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:40:39.634 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:10.844 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:41:31.901 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:10.876 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:41:31.933 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:10.912 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:41:31.967 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:10.921 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:41:31.975 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:10.921 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:41:31.950 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:10.946 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:41:32.003 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:10.952 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:41:31.986 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:10.956 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:41:32.014 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:10.997 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:41:32.030 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:14.341 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:14.317+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:14.786 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:14.781+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:14.892 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:14.885+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:15.025 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:15.018+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:15.176 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:15.170+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:15.340 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:15.334+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:15.818 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:15.814+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:15.871 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:15.866+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:16.014 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:16.009+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:16.195 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:16.189+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:16.332 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:16.326+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:16.345 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:16.340+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:16.848 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:16.843+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:16.871 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:16.866+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:17.027 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:17.021+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:17.179 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:17.171+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:17.288 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:17.282+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:17.383 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:17.377+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:17.846 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:17.841+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:17.889 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:17.881+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:18.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:18.051+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:18.156 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:18.151+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:18.339 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:18.334+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:18.420 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:18.413+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:18.834 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:18.828+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:18.916 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:18.912+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:19.053 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:19.047+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:19.128 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:19.120+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:19.356 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:19.351+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:19.433 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:19.428+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:19.816 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:19.811+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:19.970 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:19.965+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:20.101 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:20.096+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:20.125 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:20.120+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:20.348 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:20.342+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:20.466 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:20.461+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:20.838 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:20.833+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:20.962 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:20.948+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:21.130 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:21.124+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:21.144 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:21.138+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:21.379 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:21.373+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:21.441 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:21.428+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:21.804 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:21.799+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:21.919 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:21.914+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:22.109 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:22.103+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:22.125 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:22.113+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:22.336 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:22.331+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:22.416 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:22.411+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:22.770 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:22.764+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:22.963 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:22.958+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:23.087 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:23.081+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:23.172 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:23.166+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:23.348 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:23.343+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:23.453 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:23.445+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:23.778 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:23.773+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:23.983 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:23.978+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:24.134 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:24.129+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:24.152 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:24.147+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:24.368 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:24.357+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:24.429 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:24.420+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:24.811 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:24.806+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:25.036 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:25.030+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:25.122 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:25.116+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:25.136 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:25.130+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:25.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:25.346+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:25.454 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:25.447+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:25.849 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:25.843+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:26.030 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:26.012+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:26.172 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:26.166+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:26.182 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:26.176+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:26.345 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:26.338+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:26.414 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:26.409+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:26.807 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:26.801+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:27.052 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:27.046+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:27.190 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:27.184+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:27.217 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:27.211+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:27.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:27.329+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:27.340 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:27.334+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:27.446 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:27.441+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:27.859 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:27.855+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:28.094 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:28.089+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:28.198 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:28.192+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:28.237 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:28.231+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:28.360 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:28.353+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:28.377 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:28.372+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:28.411 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:28.406+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:28.885 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:28.878+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:29.075 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:29.070+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:29.173 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:29.167+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:29.207 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:29.201+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:29.377 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:29.371+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:29.386 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:29.380+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:29.422 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:29.414+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:29.878 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:29.873+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:30.076 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:30.071+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:30.176 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:30.170+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:30.201 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:30.195+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:30.341 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:30.337+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:30.361 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:30.355+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:30.465 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:30.459+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:30.837 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:30.832+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:31.086 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:31.081+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:31.165 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:31.159+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:31.232 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:31.227+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:31.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:31.330+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:31.345 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:31.339+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:31.447 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:31.442+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:31.804 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:31.799+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:32.060 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:32.056+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:32.124 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:32.118+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:32.220 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:32.215+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:32.350 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:32.346+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:32.351 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:32.345+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:32.422 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:32.417+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:32.869 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:32.859+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:33.041 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:33.035+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:33.150 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:33.144+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:33.188 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:33.178+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:33.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:33.329+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:33.379 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:33.373+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:33.380 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:33.374+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:33.876 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:33.871+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:34.079 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:34.074+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:34.144 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:34.139+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:34.293 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:34.185+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:34.347 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:34.342+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:34.371 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:34.366+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:34.380 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:34.375+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:34.916 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:34.911+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:35.035 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:35.030+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:35.158 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:35.152+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:35.164 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:35.159+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:35.309 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:35.302+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:35.346 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:35.341+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:35.371 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:35.366+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:35.885 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:35.876+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:36.007 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:36.001+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:36.142 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:36.137+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:36.193 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:36.187+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:36.314 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:36.309+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:36.329 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:36.323+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:36.421 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:36.415+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:36.883 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:36.878+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:37.029 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:37.024+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:37.192 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:37.185+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:37.194 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:37.187+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:37.292 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:37.286+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:37.307 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:37.302+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:37.379 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:37.374+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:37.928 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:37.922+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:38.038 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:38.033+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:38.159 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:38.153+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:38.193 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:38.187+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:38.275 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:38.268+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:38.289 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:38.284+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:38.361 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:38.348+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:38.970 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:38.964+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:39.084 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:39.079+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:39.161 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:39.155+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:39.242 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:39.236+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:39.280 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:39.275+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:39.285 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:39.279+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:39.379 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:39.373+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:40.016 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:40.011+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:40.127 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:40.119+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:40.132 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:40.126+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:40.227 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:40.222+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:40.251 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:40.246+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:40.260 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:40.255+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:40.376 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:40.371+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:40.992 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:40.987+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:41.099 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:41.093+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:41.152 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:41.146+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:41.190 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:47:41.178+0000 1694f700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.132710+0000 front 2019-12-09T18:46:30.831482+0000 (oldest deadline 2019-12-09T18:47:14.387119+0000) 2019-12-09T18:47:41.267 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:41.261+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:41.281 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:41.274+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:41.343 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:41.338+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:42.037 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:42.030+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:42.107 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:42.101+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:42.120 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:42.113+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:42.273 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:42.267+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:42.318 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:42.312+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:42.379 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:42.373+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:43.044 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:43.039+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:43.104 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:43.098+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:43.137 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:43.132+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:43.293 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:43.286+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:43.309 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:43.303+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:43.365 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:43.360+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:44.067 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:44.063+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:44.133 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:44.128+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:44.189 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:44.185+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:44.266 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:44.261+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:44.291 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:44.284+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:44.334 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:44.328+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:45.061 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:45.056+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:45.107 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:45.101+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:45.244 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:45.239+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:45.269 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:45.263+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:45.283 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:45.278+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:45.336 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:45.331+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:46.082 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:46.076+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:46.099 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:46.094+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:46.234 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:46.229+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:46.244 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:46.239+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:46.318 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:46.313+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:46.335 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:46.330+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:47.049 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:47.044+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:47.132 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:47.128+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:47.225 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:47.218+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:47.283 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:47.278+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:47.312 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:47.307+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:47.330 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:47.325+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:48.076 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:48.068+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:48.167 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:48.160+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:48.259 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:48.253+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:48.295 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:48.288+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:48.331 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:48.322+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:48.358 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:48.351+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:49.069 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:49.062+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:49.143 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:49.136+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:49.250 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:49.244+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:49.268 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:49.261+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:49.287 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:49.282+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:49.389 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:49.383+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:50.099 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:47:50.094+0000 1694f700 -1 osd.5 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:29.844317+0000 front 2019-12-09T18:46:32.424877+0000 (oldest deadline 2019-12-09T18:47:14.514389+0000) 2019-12-09T18:47:50.179 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:50.172+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:50.262 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:50.256+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:47:50.296 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:47:50.290+0000 1694f700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.424589+0000 front 2019-12-09T18:46:29.365777+0000 (oldest deadline 2019-12-09T18:47:26.722492+0000) 2019-12-09T18:47:50.317 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:47:50.311+0000 1694f700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:30.838743+0000 front 2019-12-09T18:46:29.103591+0000 (oldest deadline 2019-12-09T18:47:14.120460+0000) 2019-12-09T18:47:50.347 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:47:50.341+0000 1694f700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.220571+0000 front 2019-12-09T18:46:32.423764+0000 (oldest deadline 2019-12-09T18:47:14.166875+0000) 2019-12-09T18:47:50.935 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:47:50.928+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 46sec e259 v259) 2019-12-09T18:47:51.168 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:47:51.162+0000 1694f700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:32.499226+0000 front 2019-12-09T18:46:31.132974+0000 (oldest deadline 2019-12-09T18:47:13.894176+0000) 2019-12-09T18:47:51.247 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:47:51.242+0000 1694f700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:46:31.221102+0000 front 2019-12-09T18:46:30.887069+0000 (oldest deadline 2019-12-09T18:47:15.697035+0000) 2019-12-09T18:48:49.277 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:48:49.270+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:48:50.311 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:48:50.304+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:48:50.744 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:48:50.739+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:48:51.297 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:48:51.290+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:48:51.356 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:48:51.349+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:48:51.433 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:48:51.428+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:48:51.680 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:48:51.673+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:48:51.771 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:48:51.765+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:48:52.283 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:48:52.275+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:48:52.367 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:48:52.360+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:48:52.442 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:48:52.436+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:48:52.679 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:48:52.672+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:48:52.686 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:48:52.678+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:48:52.732 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:48:52.726+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:48:53.273 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:48:53.264+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:48:53.323 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:48:53.316+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:48:53.469 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:48:53.462+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:48:53.648 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:48:53.642+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:48:53.722 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:48:53.715+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:48:53.728 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:48:53.722+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:48:54.300 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:48:54.293+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:48:54.317 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:48:54.310+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:48:54.513 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:48:54.503+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:48:54.693 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:48:54.681+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:48:54.709 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:48:54.698+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:48:54.758 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:48:54.750+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:48:55.288 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:48:55.277+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:48:55.298 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:48:55.291+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:48:55.482 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:48:55.475+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:48:55.673 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:48:55.665+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:48:55.675 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:48:55.668+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:48:55.777 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:48:55.769+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:48:56.249 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:48:56.240+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:48:56.255 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:48:56.248+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:48:56.515 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:48:56.507+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:48:56.644 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:48:56.637+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:48:56.673 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:48:56.666+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:48:56.823 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:48:56.814+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:48:57.213 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:48:57.206+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:48:57.248 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:48:57.242+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:48:57.493 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:48:57.487+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:48:57.669 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:48:57.663+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:48:57.723 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:48:57.715+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:48:57.821 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:48:57.813+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:48:58.208 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:48:58.200+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:48:58.261 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:48:58.254+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:48:58.536 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:48:58.530+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:48:58.628 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:48:58.619+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:48:58.757 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:48:58.750+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:48:58.848 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:48:58.841+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:48:59.229 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:48:59.215+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:48:59.311 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:48:59.302+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:48:59.552 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:48:59.543+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:48:59.601 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:48:59.594+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:48:59.769 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:48:59.761+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:48:59.841 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:48:59.835+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:00.265 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:00.259+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:00.272 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:00.264+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:00.591 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:00.585+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:00.594 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:00.586+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:00.723 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:00.717+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:00.838 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:00.831+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:01.240 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:01.232+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:01.243 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:01.236+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:01.619 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:01.611+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:01.628 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:01.621+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:01.702 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:01.695+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:01.749 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:01.741+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:01.833 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:01.826+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:02.201 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:02.194+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:02.217 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:02.210+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:02.581 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:02.574+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:02.624 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:02.616+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:02.696 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:02.690+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:02.778 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:02.770+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:02.829 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:02.822+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:03.205 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:03.198+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:03.208 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:03.201+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:03.547 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:03.540+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:03.671 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:03.666+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:03.686 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:03.681+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:03.784 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:03.776+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:03.849 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:03.840+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:04.197 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:04.191+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:04.198 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:04.192+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:04.592 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:04.586+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:04.691 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:04.685+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:04.716 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:04.706+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:04.778 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:04.772+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:04.815 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:04.806+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:05.193 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:05.186+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:05.249 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:05.241+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:05.562 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:05.555+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:05.719 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:05.711+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:05.757 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:05.750+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:05.760 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:05.755+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:05.842 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:05.835+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:06.194 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:06.187+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:06.240 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:06.234+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:06.578 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:06.568+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:06.708 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:06.696+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:06.717 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:06.708+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:06.720 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:06.715+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:06.808 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:06.800+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:07.169 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:07.162+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:07.289 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:07.276+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:07.539 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:07.532+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:07.681 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:07.674+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:07.688 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:07.681+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:07.733 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:07.726+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:07.737 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:07.732+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:07.820 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:07.811+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:08.137 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:08.129+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:08.270 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:08.262+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:08.577 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:08.561+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:08.641 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:08.635+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:08.697 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:08.690+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:08.718 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:08.706+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:08.718 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:08.708+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:08.843 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:08.836+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:09.112 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:09.105+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:09.251 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:09.244+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:09.605 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:09.599+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:09.654 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:09.648+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:09.711 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:09.699+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:09.711 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:09.702+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:09.712 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:09.700+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:09.834 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:09.827+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:10.140 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:10.130+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:10.296 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:10.288+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:10.643 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:10.637+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:10.679 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:10.672+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:10.683 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:10.678+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:10.691 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:10.683+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:10.749 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:10.743+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:10.815 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:10.807+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:11.164 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:11.152+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:11.272 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:11.265+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:11.657 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:11.651+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:11.676 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:11.668+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:11.678 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:11.671+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:11.697 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:11.690+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:11.744 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:11.737+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:11.853 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:11.846+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:12.173 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:12.164+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:12.316 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:12.309+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:12.659 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:12.653+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:12.702 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:12.691+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:12.717 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:12.707+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:12.717 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:12.710+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:12.786 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:12.780+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:12.878 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:12.871+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:13.183 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:13.177+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:13.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:13.327+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:13.667 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:13.661+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:13.676 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:13.670+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:13.756 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:13.749+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:13.760 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:13.755+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:13.835 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:13.829+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:13.917 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:13.907+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:14.229 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:14.222+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:14.327 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:14.320+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:14.720 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:14.713+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:14.722 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:14.717+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:14.743 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:14.736+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:14.748 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:14.742+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:14.820 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:14.815+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:14.876 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:14.869+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:15.227 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:15.220+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:15.342 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:15.335+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:15.726 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:15.719+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:15.761 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:15.754+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:15.765 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:15.759+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:15.765 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:15.760+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:15.863 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:15.858+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:15.928 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:15.921+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:16.247 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:16.240+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:16.367 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:16.358+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:16.691 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:16.685+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:16.753 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:16.745+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:16.813 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:16.806+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:16.817 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:16.812+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:16.906 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:16.901+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:16.924 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:16.917+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:17.249 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:17.236+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:17.339 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:17.331+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:17.674 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:17.667+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:17.751 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:17.745+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:17.824 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:17.816+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:17.825 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:17.819+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:17.911 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:17.903+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:17.922 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:17.915+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:18.267 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:18.261+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:18.390 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:18.383+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:18.667 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:18.660+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:18.756 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:18.751+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:18.798 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:18.791+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:18.802 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:18.797+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:18.899 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:18.893+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:18.907 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:18.900+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:19.246 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:19.231+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:19.381 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:19.375+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:19.691 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:19.686+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:19.718 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:19.714+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:19.816 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:19.811+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:19.818 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:19.814+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:19.884 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:19.877+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:19.915 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:19.908+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:20.250 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:20.242+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:20.385 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:20.378+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:20.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:20.671+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:20.709 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:20.700+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:20.775 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:20.768+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:20.776 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:20.771+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:20.856 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:20.850+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:20.886 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:20.880+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:21.302 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:21.294+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:21.409 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:21.400+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:21.682 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:21.675+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:21.737 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:21.730+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:21.797 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:21.786+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:21.797 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:21.790+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:21.818 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:21.811+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:21.884 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:21.879+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:22.321 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:22.314+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:22.417 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:22.410+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:22.719 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:22.715+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:22.722 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:22.717+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:22.783 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:22.775+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:22.784 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:22.778+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:22.813 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:22.807+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:22.893 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:22.888+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:23.324 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:23.316+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:23.455 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:23.446+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:23.717 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:23.711+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:23.742 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:23.735+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:23.746 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:23.741+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:23.762 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:23.757+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:23.799 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:23.792+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:23.939 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:23.934+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:24.319 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:24.312+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:24.493 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:24.487+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:24.704 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:24.695+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:24.705 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:24.696+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:24.705 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:24.700+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:24.746 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:24.740+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:24.800 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:24.793+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:24.932 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:24.926+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:25.285 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:25.276+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:25.448 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:25.442+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:25.664 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:25.660+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:25.692 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:25.684+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:25.693 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:25.688+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:25.725 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:25.720+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:25.811 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:25.804+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:25.909 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:25.904+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:26.332 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:26.325+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:26.464 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:26.457+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:26.537 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:49:26.528+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e265 v265) 2019-12-09T18:49:26.576 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:43:47.634 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:49:26.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:26.613+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:26.622 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:43:47.680 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:49:26.657 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:26.649+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:26.658 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:26.653+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:26.678 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:43:47.711 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:49:26.679 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:43:47.737 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:49:26.685 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:43:47.718 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:49:26.694 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:43:47.751 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:49:26.697 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:26.692+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:26.769 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:43:47.827 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:49:26.815 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:26.810+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:26.833 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:43:47.890 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:49:26.894 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:26.889+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:26.910 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:43:47.944 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:49:27.292 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:27.286+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:27.426 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:27.420+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:27.604 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:27.599+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:27.644 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:27.638+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:27.649 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:27.644+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:27.744 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:27.739+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:27.848 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:27.840+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:27.872 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:27.867+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:28.252 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:28.247+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:28.476 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:28.470+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:28.621 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:28.614+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:28.621 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:28.613+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:28.622 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:28.616+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:28.708 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:28.703+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:28.878 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:28.873+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:28.879 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:28.870+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:29.298 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:29.291+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:29.476 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:29.469+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:29.636 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:29.630+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:29.667 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:29.659+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:29.668 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:29.662+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:29.734 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:29.727+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:29.837 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:29.828+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:29.866 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:29.857+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:30.261 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:30.248+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:30.455 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:30.449+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:30.629 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:30.622+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:30.632 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:30.626+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:30.677 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:30.671+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:30.740 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:30.732+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:30.869 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:30.863+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:30.905 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:30.898+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:31.262 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:31.255+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:31.431 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:31.425+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:31.552 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:49:31.545+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e265 v265) 2019-12-09T18:49:31.631 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:31.623+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:31.632 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:31.626+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:31.675 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:31.670+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:31.742 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:31.736+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:31.841 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:31.835+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:31.900 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:31.894+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:32.234 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:32.227+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:32.478 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:32.468+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:32.590 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:32.582+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:32.591 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:32.585+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:32.683 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:32.677+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:32.788 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:32.783+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:32.811 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:32.802+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:32.872 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:32.863+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:33.259 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:33.252+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:33.440 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:33.433+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:33.589 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:33.582+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:33.593 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:33.587+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:33.673 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:33.657+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:33.744 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:33.738+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:33.826 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:33.820+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:33.848 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:33.841+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:34.269 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:34.262+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:34.437 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:34.430+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:34.604 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:34.596+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:34.605 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:34.600+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:34.685 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:34.680+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:34.734 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:34.728+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:34.785 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:34.780+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:34.863 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:34.856+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:35.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:35.219+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:35.417 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:35.412+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:35.602 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:35.595+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:35.602 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:35.597+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:35.686 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:35.681+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:35.706 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:35.701+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:35.778 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:35.771+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:35.882 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:35.875+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:36.239 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:36.233+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:36.413 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:36.406+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:36.567 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:49:36.560+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e265 v265) 2019-12-09T18:49:36.615 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:36.605+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:36.615 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:36.608+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:36.668 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:36.664+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:36.726 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:36.721+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:36.771 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:36.766+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:36.901 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:36.894+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:37.221 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:37.214+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:37.429 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:37.421+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:37.583 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:37.576+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:37.585 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:37.578+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:37.626 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:37.621+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:37.703 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:37.697+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:37.790 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:37.784+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:37.882 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:37.875+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:38.241 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:38.234+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:38.445 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:38.439+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:38.631 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:38.625+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:38.639 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:38.630+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:38.644 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:38.637+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:38.743 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:38.738+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:38.831 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:38.824+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:38.841 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:38.835+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:39.235 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:39.229+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:39.472 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:39.465+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:39.599 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:39.591+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:39.600 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:39.594+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:39.693 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:39.685+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:39.758 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:39.753+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:39.819 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:39.815+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:39.828 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:39.822+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:40.268 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:40.260+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:40.509 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:40.502+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:40.582 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:40.576+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:40.583 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:40.578+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:40.708 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:40.703+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:40.726 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:40.721+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:40.789 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:49:40.784+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.547027+0000 front 2019-12-09T18:48:07.532914+0000 (oldest deadline 2019-12-09T18:48:50.707390+0000) 2019-12-09T18:49:40.817 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:40.810+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:49:41.310 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:49:41.302+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:06.406177+0000 front 2019-12-09T18:48:06.791637+0000 (oldest deadline 2019-12-09T18:48:51.037783+0000) 2019-12-09T18:49:41.534 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:49:41.529+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.981519+0000 front 2019-12-09T18:48:08.976151+0000 (oldest deadline 2019-12-09T18:48:48.624617+0000) 2019-12-09T18:49:41.594 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:41.588+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:48:27.292734+0000 (oldest deadline 2019-12-09T18:49:07.292734+0000) 2019-12-09T18:49:41.596 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:49:41.592+0000 1694f700 -1 osd.6 265 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e263) 2019-12-09T18:49:41.619 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:49:41.616+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e265 v265) 2019-12-09T18:49:41.722 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:49:41.713+0000 1694f700 -1 osd.1 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.998360+0000 front 2019-12-09T18:48:08.017823+0000 (oldest deadline 2019-12-09T18:48:50.823388+0000) 2019-12-09T18:49:41.758 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:49:41.753+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:07.805060+0000 front 2019-12-09T18:48:07.794212+0000 (oldest deadline 2019-12-09T18:48:52.467163+0000) 2019-12-09T18:49:41.784 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:49:41.773+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:48:05.035507+0000 front 2019-12-09T18:48:05.031850+0000 (oldest deadline 2019-12-09T18:48:50.854863+0000) 2019-12-09T18:50:04.438 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:50:04.288+0000 21852700 -1 reset not still connected to 0x1022e370 2019-12-09T18:50:04.438 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:50:04.288+0000 21852700 -1 reset not still connected to 0x39cdedb0 2019-12-09T18:50:22.907 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:44:43.965 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:50:22.911 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:44:43.969 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:50:22.920 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:44:43.978 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:50:22.927 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:44:43.985 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:50:22.928 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:44:43.961 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:50:22.933 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:44:43.966 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:50:23.008 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:44:44.066 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:50:23.057 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:44:44.114 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:50:23.083 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:44:44.116 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:51:10.252 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:10.245+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:10.366 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:10.360+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:10.638 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:10.631+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:11.212 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:11.205+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:11.395 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:11.390+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:11.506 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:11.501+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:11.678 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:11.671+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:12.259 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:12.252+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:12.418 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:12.412+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:12.516 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:12.511+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:12.701 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:12.695+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:12.954 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:12.910+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:13.266 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:13.258+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:13.377 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:13.371+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:13.523 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:13.518+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:13.691 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:13.686+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:13.918 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:13.912+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:14.137 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:14.131+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:14.245 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:14.238+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:14.378 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:14.372+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:14.558 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:14.551+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:14.687 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:14.679+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:14.811 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:14.804+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:14.875 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:14.869+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:15.151 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:15.146+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:15.209 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:15.203+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:15.362 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:15.357+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:15.542 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:15.537+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:15.654 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:15.649+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:15.844 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:15.839+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:15.861 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:15.855+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:16.107 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:16.101+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:16.237 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:16.231+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:16.322 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:16.316+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:16.532 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:16.527+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:16.652 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:16.646+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:16.856 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:16.850+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:16.907 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:16.902+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:17.156 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:17.144+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:17.286 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:17.280+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:17.313 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:17.306+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:17.583 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:17.578+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:17.634 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:17.629+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:17.819 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:17.808+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:17.862 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:17.856+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:18.174 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:18.168+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:18.288 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:18.282+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:18.302 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:18.297+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:18.619 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:18.611+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:18.667 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:18.661+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:18.821 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:18.816+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:18.881 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:18.874+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:19.187 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:19.182+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:19.260 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:19.254+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:19.347 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:19.342+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:19.662 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:19.657+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:19.697 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:19.690+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:19.828 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:19.821+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:19.871 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:19.865+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:20.226 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:20.220+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:20.230 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:20.224+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:20.331 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:20.318+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:20.628 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:20.623+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:20.685 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:20.679+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:20.832 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:20.823+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:20.868 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:20.862+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:21.187 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:21.182+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:21.213 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:21.208+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:21.300 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:21.294+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:21.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:21.583+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:21.711 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:21.704+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:21.795 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:21.789+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:21.908 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:21.902+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:22.179 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:22.174+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:22.206 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:22.200+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:22.284 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:22.278+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:22.638 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:22.632+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:22.696 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:22.690+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:22.795 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:22.788+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:22.943 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:22.937+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:23.181 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:23.175+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:23.227 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:23.222+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:23.287 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:23.281+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:23.603 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:23.598+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:23.749 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:23.743+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:23.751 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:23.745+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:23.924 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:23.919+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:24.201 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:24.196+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:24.260 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:24.255+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:24.307 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:24.297+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:24.569 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:24.563+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:24.793 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:24.787+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:24.798 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:24.791+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:24.902 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:24.896+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:25.160 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:25.155+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:25.285 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:25.278+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:25.292 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:25.286+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:25.601 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:25.596+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:25.759 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:25.751+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:25.840 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:25.833+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:25.929 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:25.924+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:26.188 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:26.181+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:26.261 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:26.254+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:26.317 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:26.304+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:26.580 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:26.574+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:26.762 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:26.757+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:26.884 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:26.878+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:26.901 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:26.895+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:27.168 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:27.164+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:27.217 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:27.211+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:27.301 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:27.296+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:27.604 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:27.599+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:27.754 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:27.748+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:27.857 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:27.852+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:27.900 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:27.894+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:28.195 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:28.189+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:28.207 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:28.201+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:28.353 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:28.347+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:28.639 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:28.633+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:28.770 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:28.765+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:28.865 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:28.858+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:28.932 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:28.926+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:29.234 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:29.228+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:29.259 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:29.255+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:29.344 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:29.339+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:29.614 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:29.608+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:29.756 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:29.751+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:29.842 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:29.838+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:29.938 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:29.931+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:30.271 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:30.267+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:30.280 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:30.275+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:30.354 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:30.349+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:30.619 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:30.613+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:30.779 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:30.773+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:30.811 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:30.806+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:30.993 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:30.986+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:31.258 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:31.253+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:31.286 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:31.282+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:31.405 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:31.400+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:31.626 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:31.619+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:31.793 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:31.787+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:31.834 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:31.829+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:32.030 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:32.025+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:32.259 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:32.254+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:32.290 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:32.281+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:32.417 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:32.407+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:32.652 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:32.641+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:32.788 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:32.783+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:32.853 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:32.848+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:33.071 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:33.065+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:33.291 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:33.286+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:33.293 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:33.288+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:33.422 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:33.417+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:33.629 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:33.618+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:33.782 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:33.778+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:33.823 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:33.817+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:34.053 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:34.040+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:34.244 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:34.240+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:34.286 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:34.280+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:34.377 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:34.372+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:34.587 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:34.579+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:34.815 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:34.810+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:34.829 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:34.825+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:35.021 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:35.015+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:35.257 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:35.251+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:35.264 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:35.260+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:35.380 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:35.375+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:35.556 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:35.550+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:35.806 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:35.799+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:35.812 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:35.806+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:36.023 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:36.018+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:36.272 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:36.266+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:36.313 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:36.302+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:36.357 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:36.353+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:36.607 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:36.599+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:36.814 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:36.808+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:36.838 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:36.832+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:37.063 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:37.058+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:37.276 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:37.271+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:37.297 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:37.291+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:37.312 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:37.307+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:37.584 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:37.578+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:37.863 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:37.858+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:37.879 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:37.873+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:38.062 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:38.056+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:38.304 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:38.298+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:38.325 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:38.318+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:38.347 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:38.339+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:38.627 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:38.621+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:38.862 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:38.857+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:38.915 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:38.910+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:39.035 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:39.029+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:39.321 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:39.316+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:39.327 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:39.321+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:39.332 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:39.327+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:39.620 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:39.614+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:39.820 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:39.815+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:39.957 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:39.951+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:40.075 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:40.069+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:40.316 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:40.310+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:40.317 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:40.312+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:40.343 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:40.338+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:40.633 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:40.627+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:40.851 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:40.846+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:40.915 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:40.911+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:41.077 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:41.069+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:41.309 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:41.304+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:41.357 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:41.351+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:41.360 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:41.355+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:41.609 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:41.596+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:41.865 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:41.860+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:41.879 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:41.874+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:41.954 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:51:41.950+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 41sec e270 v270) 2019-12-09T18:51:42.113 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:42.106+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:42.333 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:42.327+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:42.359 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:42.354+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:42.407 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:42.401+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:42.603 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:51:42.596+0000 1694f700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.320712+0000 front 2019-12-09T18:50:26.325691+0000 (oldest deadline 2019-12-09T18:51:10.808939+0000) 2019-12-09T18:51:42.881 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:42.876+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:42.916 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:42.910+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:43.086 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:43.080+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:43.299 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:43.294+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:43.378 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:43.373+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:43.418 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:43.412+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:43.928 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:43.922+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:43.957 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:43.944+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:44.093 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:44.087+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:44.267 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:44.256+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:44.375 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:44.371+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:44.449 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:44.442+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:44.888 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:44.883+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:44.979 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:44.973+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:45.110 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:45.104+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:45.224 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:45.218+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:45.357 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:45.352+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:45.499 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:45.493+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:45.913 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:45.907+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:46.031 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:46.026+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:46.089 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:46.080+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:51:46.273 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:51:46.268+0000 1694f700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.982716+0000 front 2019-12-09T18:50:26.839335+0000 (oldest deadline 2019-12-09T18:51:10.206921+0000) 2019-12-09T18:51:46.316 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:51:46.312+0000 1694f700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:30.227933+0000 front 2019-12-09T18:50:28.751845+0000 (oldest deadline 2019-12-09T18:51:14.126504+0000) 2019-12-09T18:51:46.496 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:51:46.489+0000 1694f700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.312135+0000 front 2019-12-09T18:50:30.164623+0000 (oldest deadline 2019-12-09T18:51:09.647642+0000) 2019-12-09T18:51:46.873 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:51:46.868+0000 1694f700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.311504+0000 front 2019-12-09T18:50:28.634882+0000 (oldest deadline 2019-12-09T18:51:12.843991+0000) 2019-12-09T18:51:47.019 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:51:47.015+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 41sec e270 v270) 2019-12-09T18:51:47.051 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:51:47.045+0000 1694f700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:28.770389+0000 front 2019-12-09T18:50:30.356131+0000 (oldest deadline 2019-12-09T18:51:14.184388+0000) 2019-12-09T18:51:47.070 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:51:47.064+0000 1694f700 -1 osd.5 270 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:50:26.497996+0000 front 2019-12-09T18:50:27.199249+0000 (oldest deadline 2019-12-09T18:51:10.359639+0000) 2019-12-09T18:52:46.284 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:46.278+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:46.364 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:46.360+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:47.317 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:47.309+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:47.339 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:47.334+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:47.368 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:47.361+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:47.378 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:47.370+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:48.113 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:52:48.108+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:52:48.284 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:48.277+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:48.348 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:48.343+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:48.374 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:48.368+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:48.408 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:48.401+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:49.156 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:52:49.151+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:52:49.297 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:49.291+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:49.309 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:49.303+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:49.403 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:52:49.395+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:52:49.415 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:49.408+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:49.419 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:49.414+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:50.116 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:52:50.111+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:52:50.286 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:50.278+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:50.350 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:50.344+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:50.374 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:50.369+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:50.384 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:50.377+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:50.427 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:52:50.420+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:52:51.100 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:52:51.095+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:52:51.323 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:51.314+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:51.357 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:51.350+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:51.369 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:51.362+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:51.389 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:52:51.382+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:52:51.394 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:51.388+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:52.131 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:52:52.125+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:52:52.288 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:52.281+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:52.352 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:52:52.345+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:52:52.371 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:52.364+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:52.378 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:52.373+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:52.397 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:52.392+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:53.125 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:52:53.119+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:52:53.291 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:53.284+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:53.367 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:53.361+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:53.369 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:53.364+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:53.406 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:52:53.399+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:52:53.412 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:53.406+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:53.613 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:52:53.608+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:52:54.096 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:52:54.090+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:52:54.302 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:54.292+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:54.389 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:52:54.379+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:52:54.390 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:54.384+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:54.395 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:54.389+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:54.402 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:54.397+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:54.601 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:52:54.595+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:52:55.074 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:52:55.069+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:52:55.330 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:55.320+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:55.356 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:55.350+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:55.400 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:52:55.392+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:52:55.415 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:55.401+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:55.437 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:55.430+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:55.594 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:52:55.588+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:52:56.074 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:52:56.068+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:52:56.328 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:56.320+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:56.331 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:56.326+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:56.421 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:56.416+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:56.440 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:52:56.434+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:52:56.460 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:56.446+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:56.600 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:52:56.593+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:52:57.033 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:52:57.029+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:52:57.304 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:57.300+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:57.337 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:57.331+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:57.378 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:57.370+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:57.440 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:52:57.433+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:52:57.473 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:57.468+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:57.589 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:52:57.584+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:52:57.993 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:52:57.987+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:52:58.339 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:58.333+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:58.363 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:58.355+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:58.387 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:58.379+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:58.435 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:58.429+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:58.438 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:52:58.432+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:52:58.609 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:52:58.603+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:52:59.047 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:52:59.041+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:52:59.342 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:52:59.334+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:52:59.370 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:52:59.364+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:52:59.391 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:52:59.385+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:52:59.430 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:52:59.425+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:52:59.460 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:52:59.453+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:52:59.581 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:52:59.574+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:00.085 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:00.080+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:00.317 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:00.310+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:00.423 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:00.400+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:00.440 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:00.435+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:00.470 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:00.465+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:00.490 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:00.482+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:00.546 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:00.538+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:00.547 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:00.542+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:01.121 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:01.116+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:01.331 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:01.324+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:01.375 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:01.368+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:01.431 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:01.425+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:01.453 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:01.447+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:01.496 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:01.488+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:01.511 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:01.504+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:01.512 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:01.507+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:02.134 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:02.129+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:02.317 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:02.311+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:02.355 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:02.349+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:02.412 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:02.407+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:02.479 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:02.474+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:02.512 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:02.506+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:02.514 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:02.510+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:02.522 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:02.516+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:03.128 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:03.122+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:03.342 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:03.331+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:03.345 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:03.338+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:03.438 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:03.432+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:03.474 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:03.468+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:03.522 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:03.515+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:03.538 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:03.531+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:03.541 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:03.536+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:04.092 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:04.087+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:04.323 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:04.316+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:04.386 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:04.379+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:04.463 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:04.456+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:04.512 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:04.506+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:04.519 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:04.511+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:04.520 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:04.514+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:04.562 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:04.554+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:05.145 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:05.139+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:05.344 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:05.333+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:05.356 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:05.348+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:05.471 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:05.466+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:05.516 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:05.507+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:05.517 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:05.511+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:05.536 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:05.531+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:05.582 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:05.574+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:06.187 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:06.183+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:06.303 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:06.295+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:06.370 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:06.363+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:06.445 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:06.439+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:06.523 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:06.517+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:06.565 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:06.557+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:06.568 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:06.560+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:06.606 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:06.598+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:07.231 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:07.227+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:07.302 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:07.290+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:07.416 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:07.412+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:07.425 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:07.419+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:07.532 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:07.526+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:07.603 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:07.596+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:07.604 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:07.599+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:07.611 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:07.603+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:08.251 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:08.245+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:08.310 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:08.303+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:08.388 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:08.381+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:08.396 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:08.390+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:08.522 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:08.516+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:08.562 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:08.554+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:08.563 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:08.558+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:08.630 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:08.622+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:09.281 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:09.273+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:09.286 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:09.279+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:09.350 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:09.344+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:09.407 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:09.400+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:09.488 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:09.482+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:09.518 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:09.510+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:09.519 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:09.514+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:09.657 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:09.650+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:10.252 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:10.245+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:10.278 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:10.271+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:10.379 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:10.372+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:10.402 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:10.395+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:10.465 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:10.458+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:10.539 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:10.531+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:10.539 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:10.534+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:10.658 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:10.652+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:11.256 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:11.249+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:11.277 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:11.270+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:11.386 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:11.379+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:11.397 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:11.390+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:11.488 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:11.482+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:11.559 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:11.551+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:11.560 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:11.554+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:11.706 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:11.698+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:12.218 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:12.211+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:12.319 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:12.313+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:12.346 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:12.341+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:12.417 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:12.412+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:12.454 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:12.448+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:12.604 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:12.597+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:12.605 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:12.600+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:12.669 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:12.662+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:13.173 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:13.167+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:13.339 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:13.330+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:13.378 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:13.373+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:13.382 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:13.377+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:13.460 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:13.453+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:13.612 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:13.605+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:13.613 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:13.608+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:13.665 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:13.659+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:14.216 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:14.210+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:14.312 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:14.305+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:14.387 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:14.376+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:14.417 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:14.411+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:14.453 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:14.446+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:14.644 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:14.639+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:14.645 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:14.640+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:14.661 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:14.654+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:15.190 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:15.184+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:15.313 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:15.305+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:15.366 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:15.360+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:15.394 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:15.389+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:15.461 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:15.453+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:15.651 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:15.643+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:15.695 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:15.686+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:15.696 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:15.689+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:16.188 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:16.180+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:16.286 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:16.279+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:16.360 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:16.355+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:16.415 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:16.409+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:16.417 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:16.411+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:16.636 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:16.629+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:16.711 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:16.703+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:16.712 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:16.706+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:17.171 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:17.165+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:17.296 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:17.289+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:17.357 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:17.351+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:17.401 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:17.396+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:17.454 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:17.447+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:17.693 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:17.686+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:17.754 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:17.747+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:17.756 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:17.751+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:18.212 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:18.205+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:18.319 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:18.312+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:18.356 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:18.349+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:18.365 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:18.359+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:18.487 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:18.480+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:18.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:18.713+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:18.801 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:18.794+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:18.804 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:18.799+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:19.262 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:19.256+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:19.287 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:19.281+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:19.341 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:19.334+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:19.401 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:19.394+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:19.534 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:19.528+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:19.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:19.713+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:19.766 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:19.758+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:19.767 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:19.761+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:20.280 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:20.274+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:20.288 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:20.280+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:20.361 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:20.354+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:20.398 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:20.393+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:20.580 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:20.572+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:20.741 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:20.733+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:20.794 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:20.788+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:20.798 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:20.793+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:21.293 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:21.286+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:21.300 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:21.293+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:21.350 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:21.340+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:21.368 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:21.363+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:21.571 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:21.564+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:21.779 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:21.772+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:21.790 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:21.783+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:21.794 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:21.789+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:22.287 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:22.281+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:22.309 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:22.302+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:22.343 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:22.335+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:22.351 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:53:22.346+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e276 v276) 2019-12-09T18:53:22.380 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:22.374+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:22.544 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:22.536+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:22.750 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:22.743+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:22.813 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:22.805+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:22.815 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:22.809+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:23.260 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:23.253+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:23.324 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:23.318+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:23.328 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:23.321+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:23.350 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:23.345+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:23.566 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:23.560+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:23.774 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:23.766+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:23.814 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:23.808+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:23.817 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:23.812+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:24.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:24.257+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:24.358 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:24.351+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:24.366 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:24.360+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:24.378 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:24.372+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:24.605 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:24.597+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:24.820 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:24.814+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:24.820 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:24.812+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:24.823 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:24.818+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:25.229 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:25.224+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:25.358 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:25.351+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:25.388 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:25.382+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:25.423 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:25.416+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:25.607 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:25.601+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:25.822 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:25.815+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:25.866 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:25.858+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:25.867 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:25.861+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:26.211 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:26.205+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:26.385 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:26.380+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:26.397 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:26.390+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:26.429 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:26.424+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:26.581 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:26.575+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:26.827 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:26.818+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:26.899 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:26.892+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:26.903 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:26.898+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:27.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:27.257+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:27.367 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:53:27.361+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e276 v276) 2019-12-09T18:53:27.405 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:27.400+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:27.429 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:27.416+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:27.445 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:27.439+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:27.575 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:27.569+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:27.857 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:27.851+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:27.896 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:27.889+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:27.897 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:27.891+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:28.298 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:28.290+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:28.423 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:28.416+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:28.423 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:28.417+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:28.436 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:28.430+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:28.592 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:28.585+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:28.848 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:28.841+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:28.907 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:28.900+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:28.908 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:28.903+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:29.292 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:29.284+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:29.392 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:29.384+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:29.399 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:29.394+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:29.419 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:29.412+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:29.578 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:29.571+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:29.843 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:29.837+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:29.884 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:29.877+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:29.884 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:29.879+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:30.280 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:30.272+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:30.371 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:30.364+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:30.447 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:30.442+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:30.463 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:30.457+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:30.597 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:30.591+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:30.820 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:30.814+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:30.923 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:30.917+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:30.926 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:30.921+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:31.259 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:31.253+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:31.345 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:31.338+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:31.444 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:31.437+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:31.465 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:31.458+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:31.618 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:31.610+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:53:31.860 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:53:31.853+0000 1694f700 -1 osd.5 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.088705+0000 front 2019-12-09T18:52:02.711595+0000 (oldest deadline 2019-12-09T18:52:48.579973+0000) 2019-12-09T18:53:31.990 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:31.977+0000 1694f700 -1 osd.6 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:52:20.450034+0000 (oldest deadline 2019-12-09T18:53:00.450034+0000) 2019-12-09T18:53:31.991 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:53:31.981+0000 1694f700 -1 osd.6 276 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:109058 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e274) 2019-12-09T18:53:32.233 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:53:32.226+0000 1694f700 -1 osd.3 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.391916+0000 front 2019-12-09T18:52:02.183338+0000 (oldest deadline 2019-12-09T18:52:47.324327+0000) 2019-12-09T18:53:32.364 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:53:32.358+0000 1694f700 -1 osd.2 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.359051+0000 front 2019-12-09T18:52:00.357418+0000 (oldest deadline 2019-12-09T18:52:46.242700+0000) 2019-12-09T18:53:32.420 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:53:32.415+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e276 v276) 2019-12-09T18:53:32.438 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:53:32.434+0000 1694f700 -1 osd.1 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:03.085367+0000 front 2019-12-09T18:52:02.451008+0000 (oldest deadline 2019-12-09T18:52:46.515525+0000) 2019-12-09T18:53:32.461 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:53:32.444+0000 1694f700 -1 osd.4 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:00.766201+0000 front 2019-12-09T18:52:00.897643+0000 (oldest deadline 2019-12-09T18:52:45.320351+0000) 2019-12-09T18:53:32.617 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:53:32.612+0000 1694f700 -1 osd.7 276 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:52:02.405135+0000 front 2019-12-09T18:52:02.566744+0000 (oldest deadline 2019-12-09T18:52:46.851094+0000) 2019-12-09T18:54:24.443 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:48:45.500 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:54:24.452 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:48:45.509 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:54:24.455 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:48:45.513 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:54:24.461 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:48:45.519 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:54:24.474 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:48:45.508 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:54:24.481 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:48:45.515 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:54:24.709 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:48:45.766 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:54:24.751 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:48:45.785 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:54:24.762 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:48:45.819 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:01.652 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:01.636+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:02.664 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:02.653+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:02.837 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:02.832+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:03.019 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:03.015+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:03.610 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:03.605+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:03.667 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:03.661+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:03.837 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:03.831+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:03.984 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:03.979+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:04.575 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:04.570+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:04.695 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:04.689+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:04.873 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:04.867+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:05.020 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:05.015+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:05.601 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:05.597+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:05.649 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:05.644+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:05.673 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:05.666+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:05.924 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:05.918+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:05.990 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:05.984+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:06.599 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:06.595+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:06.668 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:06.663+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:06.678 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:06.673+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:06.688 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:06.683+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:06.835 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:06.831+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:06.946 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:06.935+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:07.018 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:07.013+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:07.581 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:07.576+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:07.656 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:07.649+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:07.699 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:07.694+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:07.716 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:07.712+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:07.853 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:07.847+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:07.953 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:07.947+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:07.992 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:07.987+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:08.605 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:08.599+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:08.698 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:08.690+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:08.746 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:08.739+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:08.748 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:08.743+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:08.819 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:08.815+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:08.963 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:08.957+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:08.993 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:08.979+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:09.619 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:09.614+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:09.712 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:09.708+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:09.722 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:09.717+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:09.739 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:09.733+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:09.874 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:09.869+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:09.940 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:09.936+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:09.959 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:09.954+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:10.587 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:10.581+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:10.694 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:10.688+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:10.703 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:10.698+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:10.732 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:10.726+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:10.911 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:10.904+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:10.915 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:10.908+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:10.981 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:10.975+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:11.573 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:11.568+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:11.707 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:11.701+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:11.714 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:11.709+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:11.737 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:11.731+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:11.871 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:11.865+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:11.912 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:11.905+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:11.948 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:11.943+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:12.622 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:12.617+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:12.671 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:12.666+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:12.753 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:12.749+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:12.755 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:12.750+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:12.904 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:12.899+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:12.916 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:12.910+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:12.979 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:12.973+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:13.653 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:13.648+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:13.677 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:13.670+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:13.791 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:13.786+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:13.809 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:13.803+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:13.877 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:13.872+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:13.922 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:13.917+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:13.941 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:13.936+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:14.635 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:14.630+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:14.712 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:14.706+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:14.772 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:14.767+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:14.775 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:14.769+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:14.918 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:14.913+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:14.954 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:14.950+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:14.993 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:14.979+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:15.684 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:15.679+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:15.687 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:15.682+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:15.792 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:15.784+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:15.814 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:15.808+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:15.891 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:15.885+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:15.964 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:15.958+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:16.030 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:16.020+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:16.652 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:16.646+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:16.665 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:16.659+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:16.806 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:16.800+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:16.830 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:16.823+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:16.844 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:16.840+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:16.990 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:16.985+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:17.080 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:17.073+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:17.644 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:17.638+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:17.694 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:17.689+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:17.775 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:17.769+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:17.857 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:17.851+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:17.871 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:17.865+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:18.040 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:18.033+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:18.120 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:18.115+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:18.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:18.622+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:18.745 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:18.737+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:18.816 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:18.810+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:18.837 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:18.831+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:18.872 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:18.867+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:19.079 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:19.073+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:19.132 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:19.127+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:19.611 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:19.604+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:19.749 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:19.744+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:19.821 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:19.816+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:19.828 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:19.823+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:19.830 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:19.824+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:20.084 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:20.077+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:20.108 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:20.095+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:20.586 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:20.581+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:20.741 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:20.734+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:20.788 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:20.782+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:20.849 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:20.844+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:20.849 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:20.843+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:21.062 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:21.057+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:21.065 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:21.059+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:21.553 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:21.547+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:21.736 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:21.730+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:21.761 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:21.756+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:21.837 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:21.830+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:21.879 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:21.873+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:22.017 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:22.011+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:22.109 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:22.103+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:22.551 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:22.545+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:22.698 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:22.693+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:22.776 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:22.771+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:22.858 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:22.853+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:22.866 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:22.861+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:23.037 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:23.030+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:23.099 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:23.092+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:23.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:23.562+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:23.682 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:23.677+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:23.827 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:23.822+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:23.849 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:23.843+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:23.899 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:23.894+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:24.029 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:24.023+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:24.107 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:24.101+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:24.612 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:24.607+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:24.724 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:24.719+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:24.804 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:24.798+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:24.884 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:24.878+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:24.900 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:24.894+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:25.052 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:25.047+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:25.115 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:25.108+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:25.584 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:25.579+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:25.707 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:25.698+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:25.801 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:25.795+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:25.864 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:25.858+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:25.888 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:25.881+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:26.093 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:26.088+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:26.104 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:26.099+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:26.635 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:26.629+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:26.715 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:26.707+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:26.829 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:26.823+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:26.842 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:26.832+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:26.898 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:26.892+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:27.065 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:27.060+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:27.132 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:27.126+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:27.651 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:27.645+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:27.736 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:27.730+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:27.797 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:27.792+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:27.831 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:27.824+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:27.937 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:27.932+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:28.098 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:28.091+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:28.135 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:28.125+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:28.691 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:28.685+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:28.724 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:28.717+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:28.782 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:28.777+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:28.818 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:28.812+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:28.975 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:28.969+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:29.123 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:29.114+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:29.150 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:29.144+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:29.715 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:29.709+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:29.740 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:29.734+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:29.818 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:29.813+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:29.844 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:29.835+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:29.958 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:29.952+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:30.148 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:30.142+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:30.174 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:30.168+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:30.740 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:30.734+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:30.748 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:30.741+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:30.807 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:30.802+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:30.893 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:30.887+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:30.941 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:30.936+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:31.107 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:31.101+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:31.193 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:31.187+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:31.752 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:31.746+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:31.793 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:31.787+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:31.833 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:31.827+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:31.924 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:31.918+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:31.943 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:31.937+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:32.095 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:32.089+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:32.177 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:32.171+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:32.759 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:32.753+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:32.834 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:32.829+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:32.841 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:32.835+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:32.849 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:55:32.842+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 45sec e282 v282) 2019-12-09T18:55:32.892 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:49:53.949 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:32.909 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:49:53.966 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:32.925 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:49:53.982 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:32.930 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:49:53.988 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:32.937 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:49:53.971 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:32.941 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:49:53.974 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:32.959 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:49:54.017 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:32.960 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:32.955+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:32.975 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:32.969+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:32.984 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:49:54.042 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:33.008 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:49:54.042 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:33.097 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:33.092+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:33.165 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:33.159+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:33.809 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:33.805+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:33.819 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:33.814+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:33.868 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:33.863+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:34.003 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:33.997+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:34.026 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:34.020+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:34.132 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:34.127+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:34.211 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:34.204+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:34.776 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:34.771+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:34.829 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:34.824+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:34.911 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:34.906+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:35.033 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:35.028+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:35.054 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:35.048+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:35.166 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:35.159+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:35.256 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:35.250+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:35.820 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:35.814+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:35.869 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:35.863+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:35.888 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:35.882+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:36.008 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:36.001+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:36.070 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:36.064+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:36.169 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:36.163+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:36.228 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:36.223+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:36.790 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:36.784+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:36.884 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:36.877+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:36.909 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:36.903+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:36.977 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:36.971+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:37.110 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:37.104+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:37.123 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:37.118+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:37.190 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:37.185+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:37.799 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:37.793+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:37.865 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:55:37.860+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 45sec e282 v282) 2019-12-09T18:55:37.866 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:37.859+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:37.949 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:37.943+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:37.969 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:37.964+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:38.148 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:38.142+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:38.152 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:38.146+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:38.240 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:38.234+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:38.847 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:38.842+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:38.866 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:38.861+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:38.917 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:38.912+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:39.012 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:39.007+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:39.157 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:39.149+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:39.191 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:39.185+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:39.225 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:39.219+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:39.875 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:39.870+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:39.886 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:39.880+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:39.900 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:39.895+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:40.044 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:40.040+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:40.171 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:40.167+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:40.181 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:40.176+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:40.229 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:40.225+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:40.874 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:40.868+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:40.902 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:40.896+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:40.945 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:40.934+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:41.067 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:41.062+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:41.194 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:41.189+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:41.225 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:41.219+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:41.281 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:41.277+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:41.895 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:41.889+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:41.900 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:41.895+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:41.940 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:41.934+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:42.098 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:42.093+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:42.232 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:42.226+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:42.244 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:42.235+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:42.330 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:42.325+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:42.875 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:42.870+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:42.881 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:55:42.877+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 45sec e282 v282) 2019-12-09T18:55:42.939 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:42.934+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:42.956 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:42.951+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:43.081 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:43.077+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:43.215 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:43.210+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:43.264 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:43.258+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:43.359 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:43.354+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:43.861 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:43.855+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:43.927 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:43.921+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:43.933 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:43.928+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:44.051 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:44.046+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:44.217 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:44.211+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:44.296 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:44.290+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:44.360 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:44.355+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:44.857 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:44.852+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:44.908 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:44.899+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:44.949 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:44.944+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:45.061 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:45.057+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:45.247 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:45.242+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:45.311 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:45.305+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:45.377 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:45.372+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:45.861 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:45.855+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:45.948 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:45.937+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:45.950 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:45.945+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:46.049 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:46.044+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:46.282 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:46.276+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:46.331 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:46.325+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:46.359 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:46.353+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:46.823 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:46.817+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:46.904 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:46.897+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:47.001 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:46.996+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:47.041 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:47.035+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:47.327 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:47.321+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:55:47.331 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:55:47.326+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.002539+0000 front 2019-12-09T18:54:19.015066+0000 (oldest deadline 2019-12-09T18:55:02.635083+0000) 2019-12-09T18:55:47.391 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:55:47.386+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.024051+0000 front 2019-12-09T18:54:22.175921+0000 (oldest deadline 2019-12-09T18:55:02.054065+0000) 2019-12-09T18:55:47.826 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:55:47.820+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.978823+0000 front 2019-12-09T18:54:19.922121+0000 (oldest deadline 2019-12-09T18:55:05.208106+0000) 2019-12-09T18:55:47.945 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:55:47.938+0000 1694f700 -1 osd.5 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:17.310801+0000 front 2019-12-09T18:54:24.223267+0000 (oldest deadline 2019-12-09T18:55:01.311597+0000) 2019-12-09T18:55:47.968 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:55:47.963+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 45sec e282 v282) 2019-12-09T18:55:48.000 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:55:47.996+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:19.659163+0000 front 2019-12-09T18:54:24.202382+0000 (oldest deadline 2019-12-09T18:55:02.993398+0000) 2019-12-09T18:55:48.006 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:55:48.001+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:25.006355+0000 front 2019-12-09T18:54:24.905339+0000 (oldest deadline 2019-12-09T18:55:06.418755+0000) 2019-12-09T18:55:48.307 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:55:48.303+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:54:26.330386+0000 front 2019-12-09T18:54:26.332964+0000 (oldest deadline 2019-12-09T18:55:06.432800+0000) 2019-12-09T18:56:17.372 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:17.274+0000 34f8d700 -1 osd.7 286 build_incremental_map_msg missing incremental map 286 2019-12-09T18:56:17.378 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:17.285+0000 34f8d700 -1 osd.7 286 build_incremental_map_msg missing incremental map 286 2019-12-09T18:56:17.449 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:17.305+0000 36790700 -1 osd.7 286 build_incremental_map_msg missing incremental map 286 2019-12-09T18:56:17.579 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:17.417+0000 37792700 -1 osd.7 286 build_incremental_map_msg missing incremental map 286 2019-12-09T18:56:17.599 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:17.443+0000 37792700 -1 osd.7 286 build_incremental_map_msg missing incremental map 286 2019-12-09T18:56:17.786 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:17.535+0000 36f91700 -1 osd.7 286 build_incremental_map_msg missing incremental map 286 2019-12-09T18:56:18.350 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:18.343+0000 32f89700 -1 osd.7 287 build_incremental_map_msg missing incremental map 286 2019-12-09T18:56:18.629 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:18.498+0000 31f87700 -1 osd.6 287 build_incremental_map_msg missing incremental map 287 2019-12-09T18:56:18.747 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:18.721+0000 31786700 -1 osd.6 287 build_incremental_map_msg missing incremental map 287 2019-12-09T18:56:18.753 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:18.724+0000 31786700 -1 osd.6 287 build_incremental_map_msg missing incremental map 287 2019-12-09T18:56:18.769 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:18.735+0000 31786700 -1 osd.6 287 build_incremental_map_msg missing incremental map 287 2019-12-09T18:56:47.360 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:47.350+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:47.472 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:47.464+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:48.348 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:48.341+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:48.478 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:48.474+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:48.880 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:56:48.876+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:56:48.918 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:48.909+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:56:49.333 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:56:49.326+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:56:49.382 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:49.376+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:56:49.395 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:49.388+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:49.529 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:49.525+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:49.851 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:56:49.845+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:56:49.968 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:49.961+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:56:50.324 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:56:50.317+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:56:50.374 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:50.369+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:50.409 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:50.401+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:56:50.548 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:50.544+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:50.808 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:56:50.801+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:56:50.990 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:50.980+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:56:51.326 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:56:51.318+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:56:51.335 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:51.328+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:51.435 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:51.430+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:56:51.505 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:51.500+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:51.766 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:56:51.761+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:56:51.971 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:51.963+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:56:52.334 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:52.327+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:52.351 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:56:52.343+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:56:52.393 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:52.388+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:56:52.536 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:52.528+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:52.740 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:56:52.735+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:56:52.974 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:52.967+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:56:53.292 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:53.286+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:53.331 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:56:53.325+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:56:53.385 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:53.380+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:56:53.539 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:53.534+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:53.781 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:56:53.770+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:56:53.978 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:53.971+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:56:54.313 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:54.306+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:54.349 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:54.343+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:56:54.375 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:56:54.368+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:56:54.563 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:54.559+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:54.776 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:56:54.771+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:56:54.933 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:54.926+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:56:55.341 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:55.333+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:56:55.341 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:55.335+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:55.342 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:55.336+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:56:55.412 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:56:55.405+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:56:55.549 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:55.539+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:55.820 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:56:55.814+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:56:55.920 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:55.913+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:56:56.358 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:56.350+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:56.382 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:56.373+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:56:56.383 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:56.377+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:56:56.440 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:56:56.432+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:56:56.538 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:56.532+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:56.789 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:56:56.783+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:56:56.946 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:56.939+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:56:57.343 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:57.334+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:57.404 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:56:57.397+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:56:57.422 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:57.416+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:56:57.426 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:57.422+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:56:57.507 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:57.502+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:57.833 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:56:57.828+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:56:57.974 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:57.967+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:56:58.335 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:58.328+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:58.397 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:58.378+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:56:58.397 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:58.381+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:56:58.436 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:56:58.429+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:56:58.461 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:58.456+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:58.829 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:56:58.824+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:56:58.946 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:58.938+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:56:59.370 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:56:59.363+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:56:59.382 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:59.374+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:56:59.382 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:56:59.377+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:56:59.453 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:56:59.448+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:56:59.471 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:56:59.458+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:56:59.813 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:56:59.804+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:56:59.954 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:56:59.947+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:00.334 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:00.328+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:00.361 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:00.355+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:00.362 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:00.357+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:00.428 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:00.419+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:00.475 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:00.470+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:00.817 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:00.811+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:00.946 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:00.939+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:01.297 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:01.290+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:01.371 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:01.364+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:01.372 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:01.367+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:01.443 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:01.436+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:01.527 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:01.518+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:01.865 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:01.861+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:01.936 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:01.929+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:02.302 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:02.295+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:02.362 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:02.354+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:02.365 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:02.359+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:02.465 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:02.457+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:02.486 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:02.482+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:02.919 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:02.913+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:02.990 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:02.983+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:03.281 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:03.271+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:03.348 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:03.340+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:03.349 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:03.343+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:03.368 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:03.361+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:03.470 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:03.463+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:03.537 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:03.531+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:03.888 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:03.877+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:04.010 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:04.003+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:04.312 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:04.305+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:04.346 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:04.338+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:04.347 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:04.341+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:04.413 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:04.409+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:04.448 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:04.437+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:04.566 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:04.562+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:04.934 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:04.927+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:05.029 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:05.021+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:05.332 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:05.324+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:05.348 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:05.341+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:05.350 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:05.344+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:05.379 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:05.375+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:05.479 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:05.471+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:05.563 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:05.552+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:05.949 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:05.943+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:06.009 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:06.001+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:06.346 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:06.339+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:06.347 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:06.339+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:06.349 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:06.342+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:06.385 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:06.377+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:06.475 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:06.468+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:06.544 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:06.539+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:06.923 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:06.917+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:07.009 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:07.002+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:07.376 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:07.369+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:07.377 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:07.372+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:07.401 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:07.395+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:07.407 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:07.402+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:07.451 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:07.444+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:07.551 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:07.542+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:07.883 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:07.878+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:08.029 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:08.021+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:08.345 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:08.337+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:08.347 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:08.340+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:08.420 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:08.412+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:08.440 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:08.436+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:08.456 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:08.447+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:08.569 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:08.564+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:08.927 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:08.920+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:09.034 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:09.027+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:09.341 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:09.327+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:09.342 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:09.329+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:09.412 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:09.407+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:09.432 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:09.424+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:09.451 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:09.443+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:09.594 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:09.590+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:09.908 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:09.903+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:09.994 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:09.987+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:10.307 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:10.299+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:10.308 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:10.303+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:10.386 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:10.379+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:10.434 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:10.430+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:10.473 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:10.467+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:10.563 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:10.557+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:10.905 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:10.900+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:10.993 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:10.985+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:11.329 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:11.320+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:11.332 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:11.326+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:11.423 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:11.415+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:11.435 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:11.427+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:11.491 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:11.483+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:11.600 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:11.595+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:11.882 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:11.877+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:12.040 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:12.033+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:12.288 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:12.280+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:12.289 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:12.283+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:12.391 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:12.382+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:12.468 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:12.460+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:12.472 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:12.467+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:12.568 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:12.563+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:12.918 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:12.912+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:13.077 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:13.070+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:13.327 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:13.319+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:13.328 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:13.323+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:13.368 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:13.361+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:13.466 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:13.459+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:13.501 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:13.495+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:13.523 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:13.518+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:13.897 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:13.890+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:14.073 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:14.067+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:14.341 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:14.333+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:14.342 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:14.336+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:14.382 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:14.375+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:14.456 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:14.450+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:14.494 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:14.486+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:14.533 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:14.527+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:14.922 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:14.916+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:15.084 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:15.076+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:15.302 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:15.294+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:15.303 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:15.297+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:15.364 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:15.357+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:15.488 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:15.481+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:15.498 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:15.493+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:15.564 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:15.559+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:15.970 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:15.964+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:16.078 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:16.072+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:16.271 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:16.261+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:16.272 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:16.265+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:16.347 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:16.340+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:16.461 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:16.455+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:16.486 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:16.481+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:16.614 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:16.609+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:16.995 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:16.990+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:17.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:17.049+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:17.310 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:17.303+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:17.313 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:17.305+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:17.354 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:17.347+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:17.419 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:17.412+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:17.507 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:17.502+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:17.653 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:17.649+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:17.996 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:17.990+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:18.023 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:18.016+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:18.207 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:57:18.199+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e288 v288) 2019-12-09T18:57:18.327 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:18.319+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:18.328 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:18.322+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:18.365 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:18.358+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:18.417 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:18.411+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:18.471 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:18.465+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:18.651 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:18.646+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:18.956 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:18.950+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:19.026 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:19.019+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:19.353 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:19.348+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:19.354 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:19.349+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:19.379 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:19.372+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:19.387 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:19.380+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:19.467 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:19.463+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:19.696 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:19.690+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:19.918 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:19.913+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:20.026 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:20.020+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:20.329 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:20.323+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:20.332 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:20.327+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:20.343 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:20.336+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:20.380 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:20.373+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:20.429 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:20.424+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:20.652 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:20.648+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:20.959 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:20.954+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:21.066 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:21.059+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:21.336 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:21.330+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:21.376 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:21.369+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:21.379 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:21.373+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:21.383 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:21.377+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:21.383 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:21.379+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:21.699 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:21.695+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:21.958 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:21.951+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:22.073 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:22.066+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:22.356 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:22.350+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:22.369 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:22.363+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:22.388 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:22.381+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:22.398 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:22.388+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:22.398 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:22.392+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:22.667 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:22.662+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:22.937 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:22.932+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:23.047 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:23.041+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:23.221 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:57:23.216+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e288 v288) 2019-12-09T18:57:23.328 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:23.324+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:23.389 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:23.382+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:23.399 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:23.392+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:23.400 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:23.394+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:23.413 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:23.406+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:23.620 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:23.616+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:23.951 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:23.944+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:24.055 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:24.048+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:24.304 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:24.299+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:24.372 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:24.364+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:24.375 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:24.368+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:24.391 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:24.385+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:24.438 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:24.430+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:24.601 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:24.596+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:25.000 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:24.995+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:25.099 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:25.092+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:25.276 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:25.271+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:25.362 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:25.356+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:25.363 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:25.358+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:25.398 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:25.392+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:25.429 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:25.422+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:25.594 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:25.588+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:25.957 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:25.950+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:26.124 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:26.110+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:26.280 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:26.273+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:26.356 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:26.349+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:26.360 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:26.346+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:26.364 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:26.355+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:26.473 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:26.467+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:26.635 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:26.628+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:26.984 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:26.979+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:27.075 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:27.068+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:27.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:27.266+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:27.313 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:27.306+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:27.397 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:27.390+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:27.401 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:27.396+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:27.506 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:27.499+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:27.614 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:57:27.608+0000 1694f700 -1 osd.3 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:02.940130+0000 front 2019-12-09T18:56:03.099956+0000 (oldest deadline 2019-12-09T18:57:02.900182+0000) 2019-12-09T18:57:27.952 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:57:27.943+0000 1694f700 -1 osd.1 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.650994+0000 front 2019-12-09T18:56:04.778818+0000 (oldest deadline 2019-12-09T18:56:48.031564+0000) 2019-12-09T18:57:28.099 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:57:28.092+0000 1694f700 -1 osd.7 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.947321+0000 front 2019-12-09T18:56:04.960409+0000 (oldest deadline 2019-12-09T18:56:48.824954+0000) 2019-12-09T18:57:28.298 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:57:28.289+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e288 v288) 2019-12-09T18:57:28.303 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:57:28.297+0000 1694f700 -1 osd.2 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:04.779135+0000 front 2019-12-09T18:56:04.961034+0000 (oldest deadline 2019-12-09T18:56:46.684523+0000) 2019-12-09T18:57:28.330 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:57:28.320+0000 1694f700 -1 osd.4 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.429476+0000 front 2019-12-09T18:56:03.329394+0000 (oldest deadline 2019-12-09T18:56:48.586494+0000) 2019-12-09T18:57:28.374 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:28.366+0000 1694f700 -1 osd.6 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T18:56:14.423776+0000 (oldest deadline 2019-12-09T18:56:54.423776+0000) 2019-12-09T18:57:28.375 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:28.369+0000 1694f700 -1 osd.6 288 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e286) 2019-12-09T18:57:28.486 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:57:28.480+0000 1694f700 -1 osd.5 288 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:56:03.091790+0000 front 2019-12-09T18:56:02.899745+0000 (oldest deadline 2019-12-09T18:56:46.970007+0000) 2019-12-09T18:57:29.177 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T18:57:29.161+0000 34f8d700 -1 osd.6 289 build_incremental_map_msg missing incremental map 287 2019-12-09T18:58:18.661 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:52:39.719 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:58:18.669 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:52:39.726 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:58:18.677 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:52:39.710 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:58:18.682 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:52:39.716 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:58:18.691 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:52:39.749 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:58:18.697 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:52:39.755 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:58:18.870 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:52:39.904 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T18:58:18.881 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:52:39.939 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T18:58:18.915 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:52:39.963 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T18:58:36.214 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:58:36.204+0000 1694f700 -1 osd.0 294 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:112790 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 385731248 gen 48] snapc 0=[] ondisk+write+known_if_redirected e292) 2019-12-09T18:59:05.614 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:05.609+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:06.258 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:06.254+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:06.609 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:06.598+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:06.969 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:06.963+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:07.300 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:07.296+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:07.615 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:07.610+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:07.953 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:07.948+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:08.276 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:08.268+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:08.286 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:08.278+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:08.571 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:08.567+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:08.919 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:08.913+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:09.203 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:09.198+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:09.299 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:09.292+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:09.333 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:09.328+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:09.554 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:09.549+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:09.590 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:09.584+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:09.887 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:09.882+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:10.176 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:10.171+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:10.327 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:10.322+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:10.335 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:10.331+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:10.569 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:10.564+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:10.625 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:10.618+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:10.922 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:10.913+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:11.145 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:11.139+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:11.205 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:11.199+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:11.297 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:11.292+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:11.365 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:11.360+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:11.602 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:11.597+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:11.617 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:11.612+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:11.956 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:11.949+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:12.160 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:12.155+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:12.225 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:12.220+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:12.341 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:12.335+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:12.405 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:12.401+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:12.591 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:12.587+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:12.635 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:12.629+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:12.984 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:12.979+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:13.146 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:13.141+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:13.215 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:13.211+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:13.391 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:13.385+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:13.417 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:13.411+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:13.633 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:13.628+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:13.660 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:13.654+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:13.939 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:13.934+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:14.137 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:14.132+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:14.260 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:14.256+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:14.347 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:14.342+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:14.419 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:14.415+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:14.592 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:14.588+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:14.706 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:14.702+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:14.924 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:14.919+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:15.166 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:15.160+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:15.215 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:15.211+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:15.309 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:15.304+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:15.437 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:15.432+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:15.585 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:15.581+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:15.724 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:15.716+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:15.952 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:15.945+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:16.205 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:16.195+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:16.269 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:16.261+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:16.347 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:16.342+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:16.486 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:16.481+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:16.564 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:16.559+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:16.717 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:16.712+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:16.930 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:16.924+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:17.186 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:17.180+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:17.254 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:17.250+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:17.395 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:17.389+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:17.450 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:17.445+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:17.545 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:17.540+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:17.694 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:17.690+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:17.890 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:17.884+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:18.157 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:18.151+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:18.282 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:18.278+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:18.413 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:18.407+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:18.462 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:18.458+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:18.513 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:18.509+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:18.659 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:18.654+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:18.917 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:18.910+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:19.161 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:19.156+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:19.317 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:19.313+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:19.399 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:19.393+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:19.438 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:19.433+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:19.538 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:19.533+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:19.656 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:19.651+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:19.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:19.964+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:20.178 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:20.172+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:20.280 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:20.275+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:20.388 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:20.381+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:20.454 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:20.450+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:20.583 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:20.578+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:20.664 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:20.659+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:20.944 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:20.938+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:21.167 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:21.161+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:21.313 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:21.306+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:21.400 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:21.393+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:21.501 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:21.496+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:21.550 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:21.545+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:21.640 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:21.635+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:21.967 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:21.960+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:22.139 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:22.134+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:22.295 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:22.290+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:22.436 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:22.430+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:22.536 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:22.531+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:22.550 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:22.546+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:22.669 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:22.664+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:22.991 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:22.986+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:23.149 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:23.143+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:23.267 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:23.262+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:23.468 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:23.460+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:23.545 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:23.540+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:23.587 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:23.582+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:23.712 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:23.707+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:24.005 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:23.999+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:24.148 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:24.142+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:24.286 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:24.281+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:24.456 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:24.445+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:24.522 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:24.518+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:24.598 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:24.593+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:24.721 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:24.713+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:24.973 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:24.968+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:25.144 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:25.137+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:25.296 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:25.290+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:25.422 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:25.416+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:25.550 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:25.540+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:25.588 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:25.582+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:25.730 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:25.726+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:25.986 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:25.980+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:26.125 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:26.115+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:26.322 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:26.318+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:26.425 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:26.414+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:26.549 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:26.545+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:26.558 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:26.550+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:26.769 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:26.764+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:26.958 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:26.952+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:27.120 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:27.114+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:27.299 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:27.294+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:27.390 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:27.384+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:27.557 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:27.551+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:27.573 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:27.560+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:27.763 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:27.758+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:27.928 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:27.923+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:28.129 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:28.116+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:28.324 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:28.318+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:28.410 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:28.405+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:28.560 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:28.556+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:28.591 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:28.579+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:28.781 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:28.776+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:28.923 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:28.918+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:29.171 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:29.165+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:29.348 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:29.343+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:29.386 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:29.380+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:29.522 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:29.517+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:29.629 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:29.622+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:29.828 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:29.825+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:29.924 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:29.918+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:30.207 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:30.201+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:30.348 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:30.337+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:30.409 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:30.403+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:30.536 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:30.531+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:30.582 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:30.578+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:30.829 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:30.822+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:30.956 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:30.942+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:31.175 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:31.170+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:31.315 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:31.310+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:31.395 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:31.388+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:31.553 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:31.547+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:31.565 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:31.561+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:31.846 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:31.841+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:31.969 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:31.963+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:32.217 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:32.211+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:32.313 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:32.309+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:32.371 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:32.366+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:32.546 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:32.541+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:32.609 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:32.605+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:32.850 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:32.845+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:32.951 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:32.945+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:33.185 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:33.179+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:33.354 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:33.349+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:33.388 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:33.383+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:33.555 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:33.550+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:33.640 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:33.636+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:33.819 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:33.814+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:33.928 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:33.923+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:34.229 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:34.215+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:34.339 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:34.334+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:34.442 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:34.436+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:34.513 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:34.504+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:34.674 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:34.669+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:34.796 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:34.791+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:34.921 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:34.915+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:35.218 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:35.209+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:35.372 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:35.366+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:35.462 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:35.456+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:35.551 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:35.545+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:35.681 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:35.674+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:35.773 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:35.765+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:35.896 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:35.891+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:36.213 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:36.207+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:36.381 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:36.374+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:36.451 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:36.445+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:36.505 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:36.500+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:36.640 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:36.635+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:36.788 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:36.782+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:36.879 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:36.872+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:37.249 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:37.241+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:37.341 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:37.334+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:37.454 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:37.449+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:37.509 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:37.503+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:37.650 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:37.643+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:37.779 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:37.773+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:37.902 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:37.896+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:38.205 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:38.200+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:38.382 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:38.376+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:38.409 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:38.404+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:38.496 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:38.491+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:38.652 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:38.647+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:38.777 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:59:38.773+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 40sec e294 v294) 2019-12-09T18:59:38.833 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:38.827+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:38.918 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:38.913+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:39.175 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:39.168+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:39.392 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:39.386+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:39.425 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:39.407+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:39.492 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:39.485+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:39.702 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:39.696+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:39.855 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:39.849+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:39.921 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:39.916+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:40.223 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:40.217+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:40.399 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:40.394+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:40.423 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:40.417+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:40.493 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:40.488+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:40.668 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:40.657+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:40.829 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:40.823+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:40.880 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:40.875+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:41.264 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:41.259+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:41.382 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:41.376+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:41.447 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:41.440+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:41.481 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:41.469+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:41.682 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:41.676+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:41.843 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:41.838+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:41.877 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:41.872+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:42.277 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:42.268+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:42.417 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:42.412+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:42.447 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:42.442+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:42.474 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:42.468+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:42.684 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:42.678+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:42.810 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:42.804+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:42.935 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:42.925+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T18:59:43.275 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T18:59:43.268+0000 1694f700 -1 osd.4 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:26.173711+0000 front 2019-12-09T18:58:26.183173+0000 (oldest deadline 2019-12-09T18:59:10.646684+0000) 2019-12-09T18:59:43.408 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T18:59:43.401+0000 1694f700 -1 osd.0 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.694833+0000 front 2019-12-09T18:58:25.309309+0000 (oldest deadline 2019-12-09T18:59:08.239259+0000) 2019-12-09T18:59:43.453 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T18:59:43.446+0000 1694f700 -1 osd.5 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.308803+0000 front 2019-12-09T18:58:25.694678+0000 (oldest deadline 2019-12-09T18:59:07.567298+0000) 2019-12-09T18:59:43.458 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T18:59:43.453+0000 1694f700 -1 osd.1 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:18.851721+0000 front 2019-12-09T18:58:20.535790+0000 (oldest deadline 2019-12-09T18:59:06.158961+0000) 2019-12-09T18:59:43.725 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T18:59:43.718+0000 1694f700 -1 osd.3 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:24.937248+0000 front 2019-12-09T18:58:26.303880+0000 (oldest deadline 2019-12-09T18:59:05.319604+0000) 2019-12-09T18:59:43.861 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T18:59:43.856+0000 1694f700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.550289+0000 front 2019-12-09T18:58:23.729696+0000 (oldest deadline 2019-12-09T18:59:08.778454+0000) 2019-12-09T18:59:43.868 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T18:59:43.856+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 40sec e294 v294) 2019-12-09T18:59:43.919 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T18:59:43.914+0000 1694f700 -1 osd.7 294 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T18:58:25.549532+0000 front 2019-12-09T18:58:22.581816+0000 (oldest deadline 2019-12-09T18:59:06.060215+0000) 2019-12-09T19:00:23.421 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:23.404+0000 3578e700 -1 osd.6 299 build_incremental_map_msg missing incremental map 299 2019-12-09T19:00:23.638 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:23.583+0000 36790700 -1 osd.6 299 build_incremental_map_msg missing incremental map 299 2019-12-09T19:00:23.737 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:23.680+0000 35f8f700 -1 osd.6 299 build_incremental_map_msg missing incremental map 299 2019-12-09T19:00:23.789 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:23.717+0000 36790700 -1 osd.6 299 build_incremental_map_msg missing incremental map 299 2019-12-09T19:00:23.795 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:23.733+0000 36f91700 -1 osd.6 299 build_incremental_map_msg missing incremental map 299 2019-12-09T19:00:23.812 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:23.754+0000 3478c700 -1 osd.6 299 build_incremental_map_msg missing incremental map 299 2019-12-09T19:00:42.833 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:42.826+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:42.960 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:42.954+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:43.869 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:43.862+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:43.940 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:43.934+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:44.163 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:44.158+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:44.853 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:44.846+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:44.944 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:44.939+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:45.163 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:45.158+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:45.818 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:45.810+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:45.984 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:45.977+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:46.206 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:46.198+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:46.236 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:46.230+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:46.357 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:46.343+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:46.680 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:46.672+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:46.781 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:46.774+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:46.971 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:46.963+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:47.231 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:47.224+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:47.238 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:47.231+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:47.376 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:47.370+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:47.653 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:47.647+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:47.778 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:47.771+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:48.017 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:48.011+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:48.269 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:48.264+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:48.288 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:48.278+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:48.346 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:48.339+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:48.657 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:48.651+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:48.784 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:48.776+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:49.021 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:49.014+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:49.308 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:49.302+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:49.322 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:49.308+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:49.376 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:49.370+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:49.624 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:49.619+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:49.772 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:49.764+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:50.060 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:50.053+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:50.329 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:50.323+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:50.342 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:50.335+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:50.351 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:50.344+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:50.593 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:50.585+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:50.816 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:50.808+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:51.082 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:51.077+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:51.324 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:51.316+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:51.329 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:51.323+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:51.360 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:51.340+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:51.573 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:51.567+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:51.839 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:51.832+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:52.117 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:52.111+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:52.336 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:52.328+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:52.345 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:52.338+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:52.361 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:52.353+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:52.565 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:52.559+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:52.877 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:52.865+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:53.130 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:53.123+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:53.337 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:53.331+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:53.396 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:53.387+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:53.399 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:53.392+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:53.525 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:53.518+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:53.820 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:53.814+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:00:53.866 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:53.860+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:54.150 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:54.144+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:54.295 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:54.288+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:54.378 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:54.371+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:54.386 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:54.380+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:54.575 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:54.567+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:54.794 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:54.788+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:00:54.836 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:54.817+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:55.128 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:55.122+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:55.310 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:55.305+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:55.408 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:55.402+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:55.433 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:55.419+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:55.574 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:55.568+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:55.799 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:55.795+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:00:55.831 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:55.826+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:56.101 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:56.095+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:56.343 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:56.336+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:56.377 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:56.369+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:56.398 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:56.388+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:56.550 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:56.543+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:56.768 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:56.763+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:00:56.845 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:56.838+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:57.063 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:57.058+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:57.319 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:57.313+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:57.365 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:57.358+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:57.429 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:57.422+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:57.560 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:57.554+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:57.777 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:57.773+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:00:57.867 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:57.860+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:58.092 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:58.085+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:58.316 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:58.309+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:58.324 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:58.317+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:58.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:58.448+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:58.558 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:58.552+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:58.776 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:58.768+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:00:58.837 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:58.821+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:00:59.129 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:00:59.124+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:00:59.295 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:00:59.288+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:00:59.327 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:00:59.318+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:00:59.453 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:00:59.446+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:00:59.579 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:00:59.573+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:00:59.757 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:59.751+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:00:59.768 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:00:59.756+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:00:59.821 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:00:59.814+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:00.087 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:00.078+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:00.263 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:00.255+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:00.332 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:00.326+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:00.414 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:00.407+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:00.597 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:00.591+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:00.775 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:00.769+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:00.779 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:00.774+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:00.798 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:00.791+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:01.068 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:01.062+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:01.279 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:01.271+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:01.327 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:01.321+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:01.385 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:01.369+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:01.553 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:01.549+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:01.828 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:01.821+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:01.828 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:01.823+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:01.841 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:01.835+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:02.104 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:02.098+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:02.283 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:02.276+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:02.360 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:02.353+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:02.404 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:02.395+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:02.574 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:02.569+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:02.804 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:02.796+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:02.806 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:02.800+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:02.884 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:02.877+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:03.103 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:03.098+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:03.274 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:03.266+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:03.342 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:03.337+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:03.407 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:03.401+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:03.600 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:03.590+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:03.828 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:03.820+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:03.829 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:03.824+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:03.875 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:03.867+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:04.105 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:04.101+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:04.298 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:04.290+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:04.349 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:04.344+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:04.426 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:04.420+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:04.626 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:04.614+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:04.830 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:04.822+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:04.831 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:04.826+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:04.906 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:04.900+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:05.090 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:05.082+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:05.332 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:05.327+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:05.337 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:05.329+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:05.432 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:05.424+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:05.615 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:05.610+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:05.865 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:05.857+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:05.866 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:05.860+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:05.897 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:05.887+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:06.142 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:06.136+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:06.319 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:06.309+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:06.377 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:06.356+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:06.440 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:06.430+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:06.621 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:06.615+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:06.847 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:06.840+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:06.848 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:06.843+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:06.943 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:06.936+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:07.138 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:07.133+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:07.301 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:07.295+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:07.403 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:07.396+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:07.429 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:07.422+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:07.613 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:07.607+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:07.874 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:07.866+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:07.875 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:07.869+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:07.995 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:07.986+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:08.131 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:08.123+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:08.287 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:08.281+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:08.409 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:08.402+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:08.427 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:08.417+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:08.581 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:08.574+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:08.922 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:08.913+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:08.922 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:08.916+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:09.001 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:08.994+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:09.131 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:09.125+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:09.325 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:09.315+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:09.390 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:09.383+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:09.476 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:09.468+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:09.585 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:09.580+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:09.905 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:09.897+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:09.906 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:09.900+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:10.000 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:09.991+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:10.092 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:10.085+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:10.345 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:10.331+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:10.417 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:10.406+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:10.529 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:10.519+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:10.602 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:10.595+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:10.935 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:10.927+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:10.940 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:10.933+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:10.994 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:10.984+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:11.092 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:11.087+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:11.369 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:11.364+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:11.385 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:11.380+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:11.532 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:11.521+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:11.562 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:11.557+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:11.984 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:11.976+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:11.988 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:11.979+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:11.990 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:11.985+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:12.095 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:12.089+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:12.333 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:12.325+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:12.438 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:12.431+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:12.499 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:12.490+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:12.565 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:12.560+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:12.984 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:12.977+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:13.023 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:13.005+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:13.023 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:13.015+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:13.143 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:13.138+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:13.293 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:13.281+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:13.440 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:13.434+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:13.497 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:13.482+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:13.579 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:13.573+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:13.995 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:13.985+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:13.996 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:13.991+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:14.014 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:14.006+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:14.186 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:14.182+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:14.309 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:14.301+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:14.414 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:14.409+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:14.513 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:14.504+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:14.546 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:14.540+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:15.021 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:15.012+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:15.037 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:15.025+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:15.038 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:15.028+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:15.173 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:15.168+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:15.288 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:15.279+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:15.418 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:15.413+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:15.514 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:15.507+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:15.567 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:15.558+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:15.979 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:15.971+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:16.042 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:16.033+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:16.043 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:16.037+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:16.187 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:16.181+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:16.335 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:16.329+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:16.457 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:16.452+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:16.544 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:16.540+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:16.567 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:16.560+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:16.968 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:16.961+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:17.002 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:16.993+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:17.004 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:16.996+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:17.209 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:17.203+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:17.378 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:17.371+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:17.472 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:17.466+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:17.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:17.569+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:17.595 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:17.590+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:17.933 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:17.923+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:17.967 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:17.958+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:17.967 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:17.961+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:18.210 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:18.204+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:18.433 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:18.421+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:18.513 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:18.506+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:18.550 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:18.543+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:18.586 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:18.580+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:18.947 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:18.938+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:19.010 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:19.002+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:19.011 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:19.005+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:19.121 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:01:19.114+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 48sec e299 v299) 2019-12-09T19:01:19.248 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:19.243+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:19.482 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:19.475+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:19.502 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:19.495+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:19.593 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:19.584+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:19.600 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:19.595+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:19.989 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:19.978+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:19.989 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:19.981+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:19.991 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:19.984+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:20.268 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:20.261+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:20.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:20.457+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:20.498 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:20.493+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:20.609 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:20.603+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:20.638 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:20.628+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:20.965 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:20.957+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:20.965 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:20.959+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:21.010 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:21.004+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:21.267 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:21.261+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:21.449 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:21.443+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:21.545 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:21.540+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:21.585 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:21.579+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:21.668 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:21.661+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:21.930 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:21.922+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:21.931 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:21.925+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:22.047 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:22.041+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:22.286 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:22.281+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:22.476 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:22.468+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:22.555 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:22.550+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:22.574 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:22.567+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:22.708 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:22.699+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:22.932 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:22.926+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:22.937 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:22.931+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:23.095 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:23.088+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:23.242 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:23.237+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:23.505 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:23.497+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:23.548 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:23.540+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:23.588 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:23.581+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:23.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:23.713+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:23.967 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:23.959+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:23.968 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:23.963+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:24.107 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:24.100+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:24.136 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:01:24.130+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 48sec e299 v299) 2019-12-09T19:01:24.275 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:24.270+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:24.524 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:24.516+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:24.527 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:24.522+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:24.639 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:24.633+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:24.764 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:24.757+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:24.926 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:24.917+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:24.927 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:24.921+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:25.129 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:25.121+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:25.264 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:25.259+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:25.513 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:25.509+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:25.531 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:25.523+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:25.639 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:25.632+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:25.811 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:25.804+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:25.949 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:25.942+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:25.952 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:25.948+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:26.150 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:26.143+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:26.256 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:26.250+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:26.532 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:26.527+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:26.557 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:26.551+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:26.681 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:26.674+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:26.870 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:26.860+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:26.938 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:26.932+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:26.938 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:26.934+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:27.183 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:27.177+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:27.222 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:27.217+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:27.514 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:27.505+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:27.550 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:27.543+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:27.644 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:27.639+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:27.914 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:27.908+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:27.991 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:27.984+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:27.991 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:27.986+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:28.203 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:28.198+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:28.221 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:28.214+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:28.501 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:28.493+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:28.524 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:28.518+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:28.626 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:28.621+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:28.887 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:28.880+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:29.038 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:29.031+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:29.042 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:29.037+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:29.146 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:01:29.141+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 48sec e299 v299) 2019-12-09T19:01:29.195 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:29.189+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:29.237 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:29.232+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:29.531 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:29.527+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:29.543 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:29.535+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:29.667 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:29.663+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:29.843 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:29.837+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:30.015 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:30.009+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:30.020 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:30.014+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:30.185 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:30.178+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:30.281 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:30.272+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:30.520 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:30.515+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:30.593 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:30.587+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:30.639 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:30.634+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:30.881 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:30.871+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:30.994 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:30.986+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:30.995 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:30.989+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:31.244 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:31.232+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:31.280 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:31.271+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:31.521 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:31.508+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:31.598 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:31.592+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:31.630 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:31.623+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:31.835 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:31.828+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:32.016 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:32.010+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:32.020 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:32.016+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:32.237 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:32.230+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:32.255 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:32.250+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:32.488 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:32.482+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:32.595 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:32.590+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:32.614 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:32.608+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:32.867 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:32.860+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:33.000 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:32.993+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:33.001 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:32.996+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:33.201 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:33.194+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:33.262 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:33.257+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:33.460 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:01:33.454+0000 1694f700 -1 osd.3 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:59.507461+0000 front 2019-12-09T18:59:59.741327+0000 (oldest deadline 2019-12-09T19:00:44.146456+0000) 2019-12-09T19:01:33.601 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:01:33.596+0000 1694f700 -1 osd.1 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821976+0000 front 2019-12-09T19:00:00.522959+0000 (oldest deadline 2019-12-09T19:00:46.367838+0000) 2019-12-09T19:01:33.665 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:01:33.655+0000 1694f700 -1 osd.7 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.821935+0000 front 2019-12-09T19:00:00.823097+0000 (oldest deadline 2019-12-09T19:00:45.475000+0000) 2019-12-09T19:01:33.845 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:01:33.833+0000 1694f700 -1 osd.5 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:00:00.857140+0000 front 2019-12-09T19:00:01.029196+0000 (oldest deadline 2019-12-09T19:00:45.538182+0000) 2019-12-09T19:01:34.012 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:34.006+0000 1694f700 -1 osd.6 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:00:19.170907+0000 (oldest deadline 2019-12-09T19:00:59.170907+0000) 2019-12-09T19:01:34.016 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:34.011+0000 1694f700 -1 osd.6 299 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e298) 2019-12-09T19:01:34.161 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:01:34.154+0000 1694f700 -1 osd.4 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.386262+0000 front 2019-12-09T18:59:57.388294+0000 (oldest deadline 2019-12-09T19:00:42.282654+0000) 2019-12-09T19:01:34.216 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:01:34.207+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 48sec e299 v299) 2019-12-09T19:01:34.260 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:01:34.253+0000 1694f700 -1 osd.2 299 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T18:59:57.548965+0000 front 2019-12-09T18:59:57.547750+0000 (oldest deadline 2019-12-09T19:00:42.760215+0000) 2019-12-09T19:01:35.027 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:01:34.921+0000 34f8d700 -1 osd.6 300 build_incremental_map_msg missing incremental map 299 2019-12-09T19:01:52.918 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:01:52.803+0000 21852700 -1 reset not still connected to 0x1cf1d170 2019-12-09T19:01:54.624 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:01:54.426+0000 1694f700 -1 osd.0 302 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4376.0:113024 5.3 5.31099063 (undecoded) ondisk+write+known_if_redirected e298) 2019-12-09T19:02:09.847 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:56:30.905 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:09.850 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:56:30.908 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:09.865 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:56:30.923 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:09.871 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:56:30.929 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:09.883 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:56:30.916 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:09.888 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:56:30.922 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:10.093 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:56:31.150 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:10.186 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:56:31.219 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:10.242 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:56:31.297 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:14.731 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:56:35.788 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:14.739 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:56:35.796 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:14.774 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:56:35.832 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:14.779 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:56:35.837 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:14.800 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:56:35.828 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:14.800 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:56:35.858 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:14.825 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:56:35.883 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:14.830 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:56:35.862 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:14.853 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:56:35.886 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:02:58.305 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:02:58.299+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:02:59.272 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:02:59.267+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:02:59.768 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:02:59.762+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:00.247 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:00.241+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:00.293 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:00.287+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:00.583 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:00.577+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:00.800 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:00.794+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:00.909 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:00.902+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:01.243 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:01.237+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:01.314 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:01.307+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:01.505 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:01.499+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:01.637 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:01.630+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:01.799 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:01.792+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:01.923 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:01.917+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:02.246 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:02.241+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:02.331 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:02.325+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:02.487 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:02.481+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:02.648 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:02.643+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:02.796 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:02.789+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:02.950 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:02.945+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:03.258 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:03.252+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:03.375 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:03.368+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:03.493 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:03.487+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:03.649 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:03.642+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:03.843 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:03.838+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:03.900 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:03.894+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:03.968 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:03.962+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:04.225 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:04.221+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:04.404 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:04.399+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:04.537 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:04.528+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:04.682 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:04.667+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:04.896 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:04.890+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:04.950 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:04.944+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:05.006 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:05.000+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:05.225 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:05.220+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:05.383 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:05.378+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:05.493 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:05.487+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:05.728 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:05.722+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:05.939 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:05.932+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:05.948 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:05.943+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:06.039 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:06.034+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:06.243 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:06.236+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:06.435 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:06.429+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:06.486 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:06.480+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:06.691 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:06.685+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:06.897 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:06.892+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:06.905 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:06.898+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:07.074 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:07.068+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:07.256 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:07.249+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:07.438 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:07.432+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:07.469 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:07.464+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:07.680 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:07.674+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:07.886 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:07.881+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:07.926 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:07.920+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:08.066 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:08.060+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:08.229 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:08.223+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:08.429 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:08.424+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:08.506 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:08.500+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:08.715 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:08.701+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:08.882 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:08.876+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:08.927 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:08.921+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:09.101 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:09.095+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:09.211 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:09.205+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:09.418 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:09.411+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:09.473 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:09.467+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:09.733 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:09.726+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:09.871 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:09.866+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:09.892 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:09.887+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:10.095 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:10.086+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:10.202 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:10.197+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:10.409 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:10.404+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:10.529 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:10.524+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:10.686 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:10.681+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:10.855 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:10.850+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:10.905 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:10.900+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:11.112 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:11.107+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:11.202 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:11.197+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:11.466 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:11.459+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:11.493 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:11.487+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:11.665 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:11.650+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:11.820 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:11.815+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:11.903 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:11.898+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:12.102 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:12.097+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:12.229 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:12.219+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:12.467 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:12.461+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:12.484 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:12.478+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:12.627 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:12.621+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:12.823 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:12.819+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:12.900 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:12.896+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:13.091 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:13.086+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:13.206 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:13.201+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:13.472 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:13.467+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:13.490 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:13.485+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:13.614 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:13.609+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:13.794 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:13.788+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:13.885 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:13.880+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:14.099 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:14.094+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:14.171 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:14.167+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:14.434 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:14.428+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:14.525 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:14.519+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:14.648 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:14.643+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:14.839 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:14.834+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:14.909 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:14.905+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:15.119 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:15.113+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:15.195 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:15.191+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:15.440 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:15.434+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:15.518 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:15.512+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:15.673 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:15.668+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:15.821 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:15.816+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:15.872 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:15.867+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:16.166 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:16.161+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:16.167 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:16.160+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:16.434 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:16.428+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:16.547 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:16.541+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:16.633 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:16.628+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:16.781 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:03:16.775+0000 1694f700 -1 osd.0 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.759326+0000 front 2019-12-09T19:02:15.839397+0000 (oldest deadline 2019-12-09T19:02:59.745616+0000) 2019-12-09T19:03:16.883 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:16.878+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:17.154 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:17.149+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:17.190 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:17.185+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:17.409 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:17.401+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:17.522 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:17.516+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:17.675 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:17.670+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:17.884 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:17.879+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:18.160 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:18.155+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:18.227 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:18.221+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:18.432 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:18.425+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:18.565 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:18.560+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:18.668 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:18.663+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:18.912 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:18.908+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:19.200 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:19.195+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:19.209 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:19.204+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:19.478 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:19.468+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:19.571 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:19.565+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:19.682 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:19.677+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:19.879 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:19.875+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:20.221 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:20.214+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:20.225 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:20.220+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:20.429 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:20.425+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:20.600 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:20.595+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:20.647 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:20.642+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:20.865 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:20.861+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:21.207 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:21.203+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:21.279 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:21.273+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:21.413 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:21.402+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:21.606 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:21.600+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:21.681 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:21.676+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:21.866 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:21.861+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:22.222 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:22.217+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:22.312 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:22.307+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:22.455 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:22.449+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:22.622 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:22.615+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:22.733 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:22.729+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:22.831 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:22.825+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:23.178 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:23.174+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:23.284 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:23.279+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:23.446 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:23.440+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:23.601 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:23.594+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:23.724 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:23.719+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:23.852 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:23.847+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:24.214 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:24.210+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:24.313 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:24.307+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:24.443 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:24.436+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:24.627 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:24.622+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:24.727 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:24.722+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:24.864 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:24.860+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:25.213 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:25.208+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:25.289 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:25.284+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:25.422 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:25.417+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:25.672 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:25.667+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:25.688 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:25.683+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:25.890 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:25.885+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:26.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:26.247+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:26.257 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:26.252+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:26.389 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:26.383+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:26.722 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:26.717+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:26.729 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:26.725+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:26.888 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:26.884+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:27.302 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:27.296+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:27.316 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:27.308+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:27.348 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:27.342+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:27.757 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:27.751+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:27.774 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:27.769+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:27.873 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:27.860+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:28.291 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:28.287+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:28.344 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:28.338+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:28.402 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:28.395+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:28.769 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:28.763+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:28.820 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:28.816+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:28.829 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:28.826+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:29.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:29.301+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:29.342 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:29.338+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:29.383 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:29.374+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:29.762 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:03:29.756+0000 1694f700 -1 osd.5 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.831300+0000 front 2019-12-09T19:02:15.830428+0000 (oldest deadline 2019-12-09T19:02:57.961212+0000) 2019-12-09T19:03:29.810 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:29.805+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:29.867 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:29.863+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:30.275 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:30.270+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:30.305 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:30.299+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:30.395 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:30.390+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:30.812 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:30.806+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:30.911 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:30.907+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:31.267 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:31.262+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:31.273 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:31.268+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:31.366 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:31.360+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:31.804 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:31.799+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:31.936 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:31.931+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:32.234 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:32.230+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:32.283 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:32.277+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:32.332 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:32.326+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:32.804 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:32.799+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:32.989 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:32.984+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:33.247 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:33.242+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:33.308 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:33.303+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:33.371 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:33.366+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:33.833 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:33.827+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:34.016 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:34.011+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:34.293 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:03:34.285+0000 1694f700 -1 osd.1 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.648479+0000 front 2019-12-09T19:02:15.342937+0000 (oldest deadline 2019-12-09T19:02:59.947726+0000) 2019-12-09T19:03:34.310 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:03:34.297+0000 1694f700 -1 osd.7 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.183519+0000 front 2019-12-09T19:02:17.589596+0000 (oldest deadline 2019-12-09T19:02:59.962861+0000) 2019-12-09T19:03:34.396 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:03:34.389+0000 1694f700 -1 osd.4 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:16.186802+0000 front 2019-12-09T19:02:16.109142+0000 (oldest deadline 2019-12-09T19:03:01.282419+0000) 2019-12-09T19:03:34.826 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:03:34.822+0000 1694f700 -1 osd.3 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:17.905179+0000 front 2019-12-09T19:02:17.421669+0000 (oldest deadline 2019-12-09T19:03:03.287078+0000) 2019-12-09T19:03:34.907 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:03:34.904+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e305 v305) 2019-12-09T19:03:34.999 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:03:34.993+0000 1694f700 -1 osd.2 305 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:02:15.125526+0000 front 2019-12-09T19:02:15.127683+0000 (oldest deadline 2019-12-09T19:02:59.807921+0000) 2019-12-09T19:03:55.116 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:58:16.173 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:03:55.147 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:58:16.203 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:03:55.165 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:58:16.223 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:03:55.175 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:58:16.233 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:03:55.199 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:58:16.232 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:03:55.213 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:58:16.247 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:03:55.219 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:07:58:16.276 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:03:55.286 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:07:58:16.339 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:03:55.373 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:07:58:16.407 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:12.377 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:12.294+0000 31786700 -1 osd.6 311 build_incremental_map_msg missing incremental map 311 2019-12-09T19:04:12.439 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:12.340+0000 3378a700 -1 osd.6 311 build_incremental_map_msg missing incremental map 311 2019-12-09T19:04:12.461 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:12.370+0000 31f87700 -1 osd.6 311 build_incremental_map_msg missing incremental map 311 2019-12-09T19:04:12.506 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:12.395+0000 33f8b700 -1 osd.6 311 build_incremental_map_msg missing incremental map 311 2019-12-09T19:04:13.286 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:13.266+0000 124b0700 -1 osd.6 311 build_incremental_map_msg missing incremental map 311 2019-12-09T19:04:33.105 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:33.100+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:34.103 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:34.097+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:34.493 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:34.487+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:35.114 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:35.110+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:35.295 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:35.288+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:35.470 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:35.463+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:35.500 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:35.495+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:36.087 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:36.075+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:36.124 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:36.118+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:36.315 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:36.309+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:36.488 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:36.483+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:36.523 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:36.518+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:36.948 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:36.941+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:37.080 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:37.073+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:37.158 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:37.154+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:37.308 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:37.301+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:37.452 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:37.447+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:37.525 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:37.518+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:37.916 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:37.908+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:38.129 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:38.122+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:38.142 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:38.137+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:38.345 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:38.337+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:38.470 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:38.465+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:38.559 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:38.554+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:38.907 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:38.900+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:39.129 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:39.122+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:39.186 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:39.180+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:39.350 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:39.343+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:39.444 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:39.438+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:39.581 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:39.575+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:39.890 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:39.884+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:40.132 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:40.125+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:40.165 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:40.160+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:40.394 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:40.387+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:40.402 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:40.396+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:40.580 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:40.573+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:40.931 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:40.922+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:41.014 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:41.009+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:41.131 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:41.124+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:41.134 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:41.129+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:41.362 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:41.355+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:41.425 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:41.421+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:41.565 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:41.560+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:41.918 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:41.912+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:42.065 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:42.060+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:42.112 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:42.106+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:42.169 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:42.161+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:42.338 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:42.331+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:42.424 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:42.419+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:42.589 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:42.584+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:42.883 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:42.876+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:43.059 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:43.054+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:43.078 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:43.073+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:43.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:43.202+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:43.321 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:43.315+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:43.420 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:43.415+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:43.610 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:43.605+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:43.908 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:43.900+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:44.030 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:44.025+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:44.064 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:44.057+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:44.241 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:44.234+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:44.326 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:44.320+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:44.378 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:44.373+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:44.577 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:44.571+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:44.865 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:44.858+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:45.012 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:45.007+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:45.071 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:45.065+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:45.224 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:45.215+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:45.325 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:45.317+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:45.424 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:45.418+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:45.629 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:45.620+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:45.904 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:45.898+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:46.031 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:46.025+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:46.053 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:46.045+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:46.227 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:46.220+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:46.296 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:46.288+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:46.380 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:46.375+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:46.657 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:46.651+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:46.898 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:46.882+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:47.027 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:47.018+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:47.040 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:47.034+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:47.223 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:47.216+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:47.349 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:47.343+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:47.426 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:47.420+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:47.655 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:47.649+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:47.915 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:47.906+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:48.001 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:47.997+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:48.003 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:47.996+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:04:48.006 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:48.001+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:48.267 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:48.259+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:48.332 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:48.326+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:48.455 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:48.451+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:48.689 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:48.683+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:48.965 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:48.957+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:49.030 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:49.024+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:04:49.037 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:49.029+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:49.045 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:49.034+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:49.258 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:49.251+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:49.303 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:49.297+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:49.419 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:49.414+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:49.699 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:49.694+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:49.920 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:49.913+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:50.034 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:50.023+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:04:50.035 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:50.027+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:50.069 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:50.065+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:50.258 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:50.251+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:50.298 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:04:50.264+0000 1694f700 -1 osd.7 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.738519+0000 front 2019-12-09T19:03:49.689728+0000 (oldest deadline 2019-12-09T19:04:34.341808+0000) 2019-12-09T19:04:50.468 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:50.461+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:50.739 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:50.734+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:50.895 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:50.888+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:51.012 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:51.005+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:04:51.013 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:51.008+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:51.065 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:51.061+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:51.271 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:51.265+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:51.482 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:51.476+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:51.722 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:51.717+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:51.853 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:51.847+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:51.979 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:51.971+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:04:51.982 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:51.976+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:52.112 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:52.106+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:52.306 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:52.299+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:52.457 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:52.449+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:52.768 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:52.761+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:52.901 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:52.893+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:52.961 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:52.953+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:04:52.962 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:52.957+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:53.104 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:53.099+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:53.280 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:53.272+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:53.501 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:53.495+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:53.791 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:53.785+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:53.855 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:53.849+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:53.949 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:53.943+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:04:53.953 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:53.948+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:54.157 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:54.150+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:54.328 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:54.321+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:54.488 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:54.481+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:54.822 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:54.817+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:54.864 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:54.856+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:54.976 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:54.969+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:04:54.977 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:54.972+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:55.117 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:55.111+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:55.341 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:55.335+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:55.472 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:55.467+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:55.812 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:55.807+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:55.903 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:55.896+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:56.022 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:56.015+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:04:56.024 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:56.018+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:56.146 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:56.140+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:56.305 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:56.298+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:56.471 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:56.466+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:56.784 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:56.777+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:56.933 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:56.926+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:57.071 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:57.064+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:04:57.073 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:57.067+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:57.101 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:57.094+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:57.297 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:57.289+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:57.443 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:57.435+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:57.802 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:57.795+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:57.946 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:57.938+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:58.070 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:58.064+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:58.125 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:58.117+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:04:58.126 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:58.120+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:58.267 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:58.259+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:58.434 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:58.428+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:58.763 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:58.758+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:58.968 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:58.960+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:04:59.095 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:59.087+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:04:59.096 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:04:59.090+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:04:59.122 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:04:59.115+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:04:59.304 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:04:59.298+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:04:59.443 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:04:59.435+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:04:59.773 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:04:59.766+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:04:59.938 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:04:59.927+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:00.117 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:00.109+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:00.118 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:00.112+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:00.158 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:00.151+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:00.264 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:00.256+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:00.478 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:00.471+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:00.743 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:00.736+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:00.970 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:00.964+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:01.151 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:01.145+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:01.162 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:01.154+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:01.163 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:01.157+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:01.231 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:01.223+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:01.478 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:01.472+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:01.768 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:01.761+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:01.933 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:01.923+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:02.144 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:02.138+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:02.193 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:02.187+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:02.197 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:02.192+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:02.279 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:02.272+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:02.520 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:02.513+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:02.749 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:02.744+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:02.980 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:02.973+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:03.193 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:03.187+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:03.222 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:03.216+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:03.225 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:03.221+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:03.264 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:03.256+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:03.564 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:03.557+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:03.736 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:03.730+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:03.974 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:03.963+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:04.216 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:04.211+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:04.220 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:04.213+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:04.222 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:04.216+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:04.295 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:04.286+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:04.590 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:04.583+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:04.790 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:04.782+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:04.980 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:04.972+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:05.176 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:05.169+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:05.225 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:05.217+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:05.226 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:05.220+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:05.307 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:05.300+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:05.585 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:05.577+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:05.810 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:05.803+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:06.023 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:06.016+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:06.138 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:06.133+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:06.256 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:06.247+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:06.257 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:06.250+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:06.349 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:06.341+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:06.607 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:06.598+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:06.797 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:06.786+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:07.021 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:07.014+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:07.157 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:07.150+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:07.249 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:07.242+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:07.253 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:07.248+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:07.331 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:07.321+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:07.615 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:07.608+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:07.838 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:07.831+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:08.016 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:08.009+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:08.117 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:08.110+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:08.293 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:08.286+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:08.294 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:08.289+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:08.362 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:08.354+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:08.571 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:08.563+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:08.825 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:08.820+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:09.031 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:09.024+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:09.161 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:09.155+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:09.337 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:09.331+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:09.341 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:09.336+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:09.350 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:09.343+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:09.547 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:09.541+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:09.860 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:09.855+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:10.051 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:10.042+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:10.129 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:10.123+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:10.318 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:05:10.305+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e312 v312) 2019-12-09T19:05:10.324 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:10.316+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:10.355 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:10.347+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:10.356 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:10.349+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:10.580 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:10.574+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:10.827 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:10.822+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:11.058 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:11.050+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:11.086 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:11.081+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:11.319 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:11.311+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:11.320 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:11.315+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:11.346 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:11.337+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:11.572 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:11.565+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:11.847 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:11.840+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:12.052 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:12.046+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:12.056 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:12.050+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:12.328 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:12.321+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:12.332 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:12.327+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:12.337 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:12.330+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:12.603 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:12.596+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:12.819 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:12.814+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:13.033 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:13.022+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:13.085 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:13.078+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:13.316 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:13.310+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:13.321 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:13.316+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:13.329 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:13.321+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:13.590 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:13.584+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:13.831 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:13.825+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:13.993 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:13.986+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:14.128 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:14.121+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:14.320 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:14.313+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:14.342 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:14.335+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:14.343 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:14.338+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:14.558 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:14.553+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:14.845 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:14.839+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:15.025 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:15.018+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:15.170 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:15.157+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:15.303 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:15.296+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:15.329 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:05:15.325+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e312 v312) 2019-12-09T19:05:15.362 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:15.355+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:15.363 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:15.358+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:15.533 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:15.526+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:15.814 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:15.808+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:16.026 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:16.018+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:16.202 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:16.196+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:16.289 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:16.283+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:16.338 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:16.330+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:16.341 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:16.333+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:16.558 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:16.551+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:16.823 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:16.816+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:17.073 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:17.065+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:17.245 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:17.238+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:17.313 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:17.306+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:17.380 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:17.373+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:17.383 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:17.379+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:17.520 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:17.513+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:17.810 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:17.804+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:18.043 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:18.036+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:18.293 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:18.280+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:18.297 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:18.290+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:18.393 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:18.385+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:18.393 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:18.388+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:18.478 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:18.468+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:18.840 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:18.828+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:19.011 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:19.004+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:19.288 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:19.281+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:19.300 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:19.294+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:19.431 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:19.424+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:19.431 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:19.427+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:19.483 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:19.477+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:19.802 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:05:19.797+0000 1694f700 -1 osd.3 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.184523+0000 front 2019-12-09T19:03:51.576243+0000 (oldest deadline 2019-12-09T19:04:34.597123+0000) 2019-12-09T19:05:20.020 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:05:20.013+0000 1694f700 -1 osd.4 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.643628+0000 front 2019-12-09T19:03:50.645827+0000 (oldest deadline 2019-12-09T19:04:36.499596+0000) 2019-12-09T19:05:20.265 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:05:20.260+0000 1694f700 -1 osd.1 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:49.344166+0000 front 2019-12-09T19:03:48.892299+0000 (oldest deadline 2019-12-09T19:04:32.155502+0000) 2019-12-09T19:05:20.309 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:05:20.302+0000 1694f700 -1 osd.5 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:50.804591+0000 front 2019-12-09T19:03:50.896411+0000 (oldest deadline 2019-12-09T19:04:36.067211+0000) 2019-12-09T19:05:20.394 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:05:20.388+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e312 v312) 2019-12-09T19:05:20.416 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:20.410+0000 1694f700 -1 osd.6 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:04:07.691768+0000 (oldest deadline 2019-12-09T19:04:47.691768+0000) 2019-12-09T19:05:20.420 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:20.415+0000 1694f700 -1 osd.6 312 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e309) 2019-12-09T19:05:20.525 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:05:20.519+0000 1694f700 -1 osd.2 312 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:03:51.068009+0000 front 2019-12-09T19:03:51.154654+0000 (oldest deadline 2019-12-09T19:04:33.813454+0000) 2019-12-09T19:05:21.299 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:21.277+0000 38f95700 -1 osd.6 313 build_incremental_map_msg missing incremental map 311 2019-12-09T19:05:52.365 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:52.311+0000 31786700 -1 osd.6 316 build_incremental_map_msg missing incremental map 316 2019-12-09T19:05:52.485 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:52.351+0000 3578e700 -1 osd.6 316 build_incremental_map_msg missing incremental map 316 2019-12-09T19:05:52.664 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:52.439+0000 36f91700 -1 osd.6 316 build_incremental_map_msg missing incremental map 316 2019-12-09T19:05:52.715 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:52.506+0000 3378a700 -1 osd.6 316 build_incremental_map_msg missing incremental map 316 2019-12-09T19:05:52.721 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:52.539+0000 31f87700 -1 osd.6 316 build_incremental_map_msg missing incremental map 316 2019-12-09T19:05:52.727 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:05:52.573+0000 3378a700 -1 osd.6 316 build_incremental_map_msg missing incremental map 316 2019-12-09T19:06:04.801 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:00:25.858 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:06:04.807 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:00:25.864 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:06:04.821 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:00:25.879 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:06:04.825 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:00:25.883 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:06:04.834 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:00:25.868 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:06:04.841 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:00:25.875 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:06:04.961 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:00:26.010 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:06:04.980 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:00:26.037 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:06:05.007 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:00:26.041 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:06:52.987 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:06:52.981+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:06:53.078 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:06:53.074+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:06:53.123 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:06:53.117+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:06:53.949 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:06:53.941+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:06:54.089 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:06:54.085+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:06:54.091 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:06:54.086+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:06:54.551 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:06:54.547+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:06:54.931 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:06:54.925+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:06:55.056 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:06:55.052+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:06:55.142 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:06:55.138+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:06:55.529 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:06:55.525+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:06:55.907 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:06:55.901+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:06:56.010 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:06:56.006+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:06:56.132 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:06:56.127+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:06:56.424 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:06:56.420+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:06:56.574 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:06:56.570+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:06:56.736 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:06:56.731+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:06:56.903 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:06:56.898+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:06:57.037 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:06:57.033+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:06:57.097 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:06:57.092+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:06:57.457 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:06:57.449+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:06:57.550 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:06:57.545+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:06:57.745 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:06:57.740+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:06:57.937 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:06:57.931+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:06:58.053 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:06:58.049+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:06:58.091 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:06:58.085+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:06:58.408 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:06:58.403+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:06:58.455 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:06:58.450+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:06:58.525 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:06:58.520+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:06:58.701 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:06:58.697+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:06:58.924 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:06:58.918+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:06:59.070 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:06:59.058+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:06:59.100 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:06:59.096+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:06:59.378 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:06:59.373+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:06:59.427 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:06:59.422+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:06:59.569 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:06:59.565+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:06:59.724 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:06:59.716+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:06:59.946 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:06:59.942+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:00.044 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:00.040+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:00.082 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:00.077+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:00.413 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:00.406+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:00.428 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:00.424+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:00.594 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:00.589+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:00.754 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:00.748+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:00.967 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:00.956+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:01.028 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:01.024+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:01.066 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:01.062+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:01.371 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:01.366+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:01.414 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:01.409+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:01.566 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:01.561+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:01.759 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:01.755+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:01.992 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:01.985+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:02.056 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:02.051+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:02.064 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:02.059+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:02.377 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:02.371+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:02.414 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:02.409+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:02.595 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:02.590+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:02.748 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:02.740+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:02.970 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:02.965+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:03.030 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:03.026+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:03.036 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:03.032+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:03.427 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:03.422+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:03.445 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:03.434+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:03.566 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:03.562+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:03.734 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:03.729+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:03.983 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:03.978+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:03.984 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:03.979+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:04.089 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:04.084+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:04.430 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:04.423+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:04.446 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:04.439+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:04.619 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:04.612+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:04.724 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:04.718+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:04.994 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:04.988+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:04.997 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:04.991+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:05.055 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:05.050+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:05.409 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:05.403+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:05.429 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:05.424+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:05.644 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:05.638+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:05.728 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:05.723+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:05.998 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:05.993+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:06.043 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:06.037+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:06.091 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:06.084+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:06.394 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:06.389+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:06.485 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:06.480+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:06.649 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:06.643+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:06.735 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:06.730+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:07.017 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:07.011+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:07.077 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:07.072+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:07.143 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:07.137+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:07.421 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:07.411+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:07.521 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:07.514+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:07.647 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:07.641+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:07.695 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:07.690+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:07.999 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:07.994+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:08.093 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:08.085+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:08.137 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:08.130+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:08.453 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:08.447+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:08.491 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:08.486+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:08.625 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:08.619+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:08.734 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:08.729+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:09.006 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:09.000+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:09.077 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:09.071+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:09.120 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:09.115+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:09.462 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:09.457+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:09.472 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:09.465+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:09.629 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:09.624+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:09.761 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:09.754+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:10.048 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:10.036+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:10.081 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:10.072+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:10.091 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:10.085+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:10.488 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:10.482+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:10.511 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:10.506+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:10.664 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:10.658+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:10.746 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:10.741+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:11.033 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:11.029+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:11.062 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:11.057+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:11.109 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:11.103+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:11.480 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:11.474+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:11.524 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:11.519+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:11.640 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:11.634+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:11.780 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:11.774+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:12.045 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:12.035+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:12.086 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:12.081+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:12.087 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:12.080+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:12.533 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:12.528+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:12.568 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:12.562+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:12.664 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:12.658+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:12.806 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:12.800+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:13.059 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:13.054+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:13.095 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:13.089+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:13.125 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:13.117+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:13.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:13.570+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:13.600 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:13.595+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:13.698 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:13.692+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:13.846 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:13.840+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:14.082 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:14.077+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:14.090 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:14.084+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:14.109 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:14.103+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:14.583 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:14.577+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:14.613 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:14.608+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:14.695 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:14.687+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:14.884 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:14.879+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:15.043 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:15.037+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:15.102 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:15.097+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:15.161 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:15.156+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:15.579 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:15.573+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:15.631 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:15.626+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:15.719 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:15.714+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:15.910 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:15.905+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:15.998 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:15.992+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:16.107 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:16.101+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:16.164 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:16.158+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:16.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:16.623+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:16.647 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:16.642+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:16.703 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:16.698+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:16.873 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:16.867+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:16.992 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:16.986+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:17.098 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:17.093+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:17.180 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:17.174+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:17.621 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:17.616+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:17.672 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:17.666+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:17.706 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:17.699+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:17.901 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:17.895+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:18.000 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:17.994+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:18.108 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:18.102+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:18.203 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:18.197+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:18.671 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:18.666+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:18.699 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:18.694+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:18.715 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:18.709+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:18.869 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:18.862+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:18.979 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:18.972+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:19.109 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:19.103+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:19.202 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:19.194+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:19.692 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:19.686+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:19.692 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:19.686+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:19.721 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:19.716+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:19.855 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:19.849+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:19.975 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:19.970+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:20.091 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:20.085+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:20.215 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:20.210+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:20.649 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:20.643+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:20.719 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:20.713+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:20.729 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:20.724+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:20.904 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:20.899+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:21.005 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:21.000+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:21.082 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:21.077+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:21.189 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:21.184+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:21.700 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:21.695+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:21.724 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:21.717+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:21.742 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:21.736+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:21.934 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:21.928+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:21.994 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:21.988+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:22.099 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:22.093+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:22.203 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:22.198+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:22.716 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:22.703+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:22.738 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:22.727+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:22.778 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:22.773+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:22.891 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:22.886+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:23.008 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:23.004+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:23.108 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:23.102+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:23.211 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:23.204+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:23.670 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:23.664+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:23.701 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:23.696+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:23.747 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:23.741+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:23.935 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:23.929+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:24.034 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:24.028+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:24.064 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:24.059+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:24.214 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:24.208+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:24.676 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:24.671+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:24.691 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:24.686+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:24.751 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:24.745+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:24.983 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:24.978+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:25.043 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:25.038+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:25.045 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:25.040+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:25.237 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:25.232+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:25.637 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:25.631+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:25.657 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:25.652+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:25.708 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:25.702+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:25.847 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:07:25.841+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 45sec e317 v317) 2019-12-09T19:07:26.012 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:26.007+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:26.068 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:26.062+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:26.075 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:26.069+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:26.220 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:26.214+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:26.672 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:26.667+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:26.676 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:26.671+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:26.677 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:26.672+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:27.045 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:27.041+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:27.047 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:27.043+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:27.081 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:27.076+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:27.270 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:27.265+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:27.651 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:27.646+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:27.653 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:27.648+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:27.660 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:27.654+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:28.041 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:28.036+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:28.071 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:28.067+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:28.093 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:28.087+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:28.303 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:28.289+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:28.628 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:28.623+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:28.683 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:28.676+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:28.695 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:28.691+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:29.036 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:29.032+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:29.104 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:29.100+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:29.122 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:29.119+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:29.262 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:29.258+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:29.646 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:29.640+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:29.657 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:29.652+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:29.722 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:29.716+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:30.008 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:07:30.004+0000 1694f700 -1 osd.3 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.096199+0000 front 2019-12-09T19:06:08.982243+0000 (oldest deadline 2019-12-09T19:06:52.747363+0000) 2019-12-09T19:07:30.079 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:07:30.075+0000 1694f700 -1 osd.2 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.388439+0000 front 2019-12-09T19:06:09.389860+0000 (oldest deadline 2019-12-09T19:06:52.344715+0000) 2019-12-09T19:07:30.115 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:07:30.111+0000 1694f700 -1 osd.0 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:10.375351+0000 front 2019-12-09T19:06:10.344171+0000 (oldest deadline 2019-12-09T19:06:55.995128+0000) 2019-12-09T19:07:30.249 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:07:30.243+0000 1694f700 -1 osd.4 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.042815+0000 front 2019-12-09T19:06:10.050886+0000 (oldest deadline 2019-12-09T19:06:52.021806+0000) 2019-12-09T19:07:30.627 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:07:30.622+0000 1694f700 -1 osd.7 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:11.304845+0000 front 2019-12-09T19:06:12.005179+0000 (oldest deadline 2019-12-09T19:06:56.253019+0000) 2019-12-09T19:07:30.681 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:07:30.675+0000 1694f700 -1 osd.1 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:09.656168+0000 front 2019-12-09T19:06:09.957179+0000 (oldest deadline 2019-12-09T19:06:53.987475+0000) 2019-12-09T19:07:30.740 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:07:30.734+0000 1694f700 -1 osd.5 317 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:06:12.027929+0000 front 2019-12-09T19:06:13.101896+0000 (oldest deadline 2019-12-09T19:06:57.484855+0000) 2019-12-09T19:07:30.918 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:07:30.910+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 45sec e317 v317) 2019-12-09T19:08:06.901 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:06.869+0000 38794700 -1 osd.6 322 build_incremental_map_msg missing incremental map 322 2019-12-09T19:08:07.147 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:07.137+0000 3578e700 -1 osd.6 322 build_incremental_map_msg missing incremental map 322 2019-12-09T19:08:07.401 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:07.391+0000 38f95700 -1 osd.6 322 build_incremental_map_msg missing incremental map 322 2019-12-09T19:08:29.403 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:29.396+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:30.358 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:30.353+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:30.379 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:30.372+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:30.753 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:30.731+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:31.149 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:31.143+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:31.363 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:31.357+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:31.390 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:31.383+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:31.519 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:31.511+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:31.720 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:31.716+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:32.170 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:32.163+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:32.325 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:32.319+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:32.385 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:32.376+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:32.541 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:32.535+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:32.716 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:32.710+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:33.180 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:33.173+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:33.193 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:33.186+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:33.345 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:33.341+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:33.423 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:33.415+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:33.578 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:33.571+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:33.691 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:33.686+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:34.195 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:34.190+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:34.204 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:34.197+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:34.353 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:34.349+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:34.477 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:34.470+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:34.545 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:34.539+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:34.698 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:34.693+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:35.218 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:35.213+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:35.255 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:35.247+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:35.391 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:35.386+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:35.451 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:35.444+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:35.584 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:35.576+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:35.690 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:35.683+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:36.227 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:36.222+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:36.265 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:36.255+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:36.411 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:36.406+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:36.450 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:36.442+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:36.624 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:36.600+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:36.682 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:36.674+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:37.202 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:37.197+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:37.241 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:37.234+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:37.453 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:37.445+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:37.497 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:37.490+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:37.656 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:37.649+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:37.695 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:37.688+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:37.746 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:37.741+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:38.192 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:38.185+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:38.262 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:38.256+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:38.457 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:38.450+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:38.468 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:38.464+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:38.648 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:38.643+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:38.656 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:38.650+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:38.729 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:38.725+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:39.201 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:39.197+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:39.255 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:39.249+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:39.437 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:39.432+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:39.510 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:39.504+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:39.675 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:39.669+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:39.685 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:39.679+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:39.707 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:39.701+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:40.171 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:40.167+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:40.267 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:40.261+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:40.492 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:40.487+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:40.539 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:40.532+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:40.644 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:40.638+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:40.696 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:40.691+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:40.728 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:40.720+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:41.215 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:41.210+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:41.312 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:41.305+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:41.533 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:41.527+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:41.545 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:41.540+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:41.697 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:41.690+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:41.748 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:41.744+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:41.757 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:41.752+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:42.214 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:42.207+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:42.325 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:42.318+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:42.569 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:42.564+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:42.577 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:42.571+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:42.684 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:42.677+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:42.723 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:42.710+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:42.723 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:42.716+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:42.744 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:42.739+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:43.254 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:43.249+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:43.343 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:43.336+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:43.558 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:43.551+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:43.581 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:43.575+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:43.705 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:43.699+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:43.714 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:43.707+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:43.757 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:43.749+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:43.758 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:43.752+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:44.273 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:44.267+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:44.356 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:44.350+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:44.546 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:44.539+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:44.564 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:44.559+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:44.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:44.662+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:44.698 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:44.694+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:44.800 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:44.792+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:44.802 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:44.795+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:45.275 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:45.271+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:45.314 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:45.308+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:45.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:45.497+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:45.590 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:45.585+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:45.714 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:45.707+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:45.715 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:45.709+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:45.767 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:45.759+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:45.772 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:45.767+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:46.257 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:46.252+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:46.274 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:46.268+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:46.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:46.490+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:46.608 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:46.602+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:46.682 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:46.678+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:46.707 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:46.701+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:46.824 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:46.814+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:46.827 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:46.820+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:47.233 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:47.227+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:47.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:47.260+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:47.515 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:47.508+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:47.627 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:47.620+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:47.728 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:47.720+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:47.732 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:47.727+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:47.861 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:47.854+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:47.862 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:47.857+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:48.242 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:48.234+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:48.266 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:48.259+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:48.564 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:48.556+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:48.580 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:48.575+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:48.698 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:48.692+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:48.705 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:48.701+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:48.852 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:48.845+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:48.857 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:48.848+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:49.241 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:49.235+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:49.244 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:49.236+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:49.545 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:49.538+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:49.612 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:49.608+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:49.678 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:49.672+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:49.710 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:49.704+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:49.816 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:49.809+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:49.817 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:49.812+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:50.218 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:50.213+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:50.259 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:50.252+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:50.506 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:50.499+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:50.601 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:50.595+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:50.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:50.658+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:50.681 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:50.673+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:50.854 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:50.848+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:50.856 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:50.852+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:51.248 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:51.240+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:51.251 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:51.244+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:51.489 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:51.482+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:51.609 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:51.604+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:51.649 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:51.642+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:51.682 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:51.676+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:51.842 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:51.834+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:51.843 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:51.837+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:52.218 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:52.211+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:52.228 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:52.221+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:52.537 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:52.527+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:52.622 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:52.617+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:52.651 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:52.641+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:52.652 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:52.644+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:52.891 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:52.884+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:52.892 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:52.887+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:53.197 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:53.192+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:53.249 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:53.242+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:53.548 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:53.541+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:53.605 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:53.600+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:53.632 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:53.626+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:53.674 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:53.669+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:53.944 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:53.936+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:53.944 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:53.939+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:54.234 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:54.228+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:54.242 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:54.237+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:54.530 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:54.523+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:54.587 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:54.583+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:54.618 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:54.609+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:54.673 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:54.669+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:54.918 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:54.911+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:54.919 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:54.914+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:55.205 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:55.197+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:55.220 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:55.213+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:55.549 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:55.542+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:55.558 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:55.547+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:55.637 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:55.631+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:55.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:55.670+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:55.941 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:55.933+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:55.941 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:55.936+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:56.213 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:56.207+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:56.253 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:56.244+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:56.520 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:56.514+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:56.537 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:56.532+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:56.611 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:56.605+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:56.665 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:56.659+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:56.985 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:56.977+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:56.986 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:56.980+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:57.169 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:57.163+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:57.237 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:57.230+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:57.495 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:57.487+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:57.512 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:57.504+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:57.631 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:57.624+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:57.657 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:57.650+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:57.992 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:57.987+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:57.994 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:57.990+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:58.133 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:58.128+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:58.284 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:58.277+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:58.465 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:58.459+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:58.524 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:58.517+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:58.632 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:58.627+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:08:58.637 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:58.628+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:59.033 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:59.025+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:08:59.034 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:08:59.028+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:08:59.099 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:08:59.092+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:08:59.305 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:08:59.298+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:08:59.448 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:08:59.443+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:08:59.546 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:08:59.540+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:08:59.649 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:08:59.642+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:08:59.667 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:08:59.662+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:00.082 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:00.074+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:00.083 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:00.077+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:00.125 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:00.120+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:00.357 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:00.349+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:00.484 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:00.479+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:00.570 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:00.562+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:00.648 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:09:00.641+0000 1694f700 -1 osd.4 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.140429+0000 front 2019-12-09T19:07:48.489560+0000 (oldest deadline 2019-12-09T19:08:30.984230+0000) 2019-12-09T19:09:00.696 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:00.691+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:01.080 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:01.072+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:01.081 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:01.075+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:01.144 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:01.140+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:01.185 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:09:01.180+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e323 v323) 2019-12-09T19:09:01.347 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:01.341+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:01.513 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:01.507+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:01.579 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:01.569+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:01.749 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:01.743+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:02.046 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:02.040+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:02.049 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:02.045+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:02.144 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:02.130+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:02.399 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:02.391+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:02.482 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:02.477+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:02.582 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:02.575+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:02.733 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:02.728+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:03.020 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:03.013+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:03.021 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:03.016+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:03.153 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:03.140+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:03.364 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:03.357+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:03.533 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:03.527+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:03.558 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:03.552+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:03.692 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:03.686+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:04.051 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:04.037+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:04.051 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:04.040+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:04.122 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:04.117+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:04.401 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:04.394+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:04.569 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:04.564+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:04.599 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:04.592+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:04.683 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:04.675+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:05.096 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:05.089+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:05.098 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:05.092+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:05.173 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:05.168+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:05.440 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:05.432+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:05.576 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:05.569+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:05.579 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:05.574+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:05.692 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:05.687+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:06.118 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:06.110+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:06.119 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:06.113+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:06.197 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:09:06.194+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e323 v323) 2019-12-09T19:09:06.223 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:06.218+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:06.402 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:06.395+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:06.571 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:06.563+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:06.623 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:06.616+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:06.675 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:06.668+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:07.148 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:07.140+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:07.149 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:07.144+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:07.259 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:07.250+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:07.413 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:07.406+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:07.572 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:07.564+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:07.631 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:07.626+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:07.637 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:07.633+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:08.104 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:08.095+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:08.104 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:08.099+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:08.237 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:08.231+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:08.462 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:08.455+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:08.622 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:08.616+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:08.651 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:08.647+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:08.665 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:08.660+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:09.091 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:09.083+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:09.092 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:09.085+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:09.222 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:09.216+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:09.495 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:09.487+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:09.588 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:09.579+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:09.626 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:09.618+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:09.662 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:09.655+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:10.143 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:10.136+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:10.153 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:10.141+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:10.180 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:10.174+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:10.520 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:10.512+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:10.572 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:10.564+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:10.609 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:10.602+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:10.650 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:10.646+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:11.142 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:11.135+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:11.143 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:11.138+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:11.178 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:11.173+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:11.220 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:09:11.206+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e323 v323) 2019-12-09T19:09:11.560 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:11.554+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:11.572 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:11.565+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:11.622 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:11.616+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:11.681 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:11.672+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:12.138 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:12.132+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:12.142 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:12.137+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:12.199 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:12.194+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:12.534 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:12.528+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:12.540 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:12.534+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:12.588 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:12.583+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:12.696 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:12.690+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:13.127 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:13.118+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:13.129 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:13.122+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:13.182 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:13.176+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:13.552 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:13.545+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:13.579 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:13.573+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:13.590 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:13.583+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:13.717 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:13.710+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:14.093 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:14.085+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:14.094 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:14.089+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:14.181 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:14.171+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:14.520 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:14.514+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:14.576 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:14.570+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:14.581 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:14.571+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:14.746 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:14.740+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:15.105 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:15.096+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:15.106 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:15.099+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:15.153 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:15.147+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:15.550 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:09:15.543+0000 1694f700 -1 osd.5 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:48.912742+0000 front 2019-12-09T19:07:48.916132+0000 (oldest deadline 2019-12-09T19:08:30.938444+0000) 2019-12-09T19:09:15.570 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:09:15.564+0000 1694f700 -1 osd.2 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.435184+0000 front 2019-12-09T19:07:47.518520+0000 (oldest deadline 2019-12-09T19:08:30.314693+0000) 2019-12-09T19:09:15.627 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:09:15.620+0000 1694f700 -1 osd.7 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.667627+0000 front 2019-12-09T19:07:47.660126+0000 (oldest deadline 2019-12-09T19:08:29.211932+0000) 2019-12-09T19:09:15.709 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:09:15.702+0000 1694f700 -1 osd.1 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.115971+0000 front 2019-12-09T19:07:47.074444+0000 (oldest deadline 2019-12-09T19:08:29.880098+0000) 2019-12-09T19:09:16.153 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:16.145+0000 1694f700 -1 osd.6 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:08:02.584589+0000 (oldest deadline 2019-12-09T19:08:42.584589+0000) 2019-12-09T19:09:16.154 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:09:16.149+0000 1694f700 -1 osd.6 323 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e321) 2019-12-09T19:09:16.196 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:09:16.190+0000 1694f700 -1 osd.3 323 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:07:47.758393+0000 front 2019-12-09T19:07:47.751579+0000 (oldest deadline 2019-12-09T19:08:32.251673+0000) 2019-12-09T19:09:16.267 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:09:16.259+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e323 v323) 2019-12-09T19:09:57.657 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:04:18.715 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:09:57.663 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:04:18.721 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:09:57.679 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:04:18.737 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:09:57.683 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:04:18.717 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:09:57.688 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:04:18.746 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:09:57.709 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:04:18.743 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:09:57.910 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:04:18.968 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:09:57.969 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:04:19.027 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:09:58.022 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:04:19.056 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:10:48.015 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:10:48.008+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:10:48.768 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:10:48.764+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:10:48.997 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:10:48.990+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:10:49.665 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:10:49.660+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:10:49.788 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:10:49.783+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:10:49.995 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:10:49.988+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:10:50.230 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:10:50.223+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:10:50.498 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:10:50.493+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:10:50.682 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:10:50.676+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:10:50.841 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:10:50.836+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:10:51.021 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:10:51.011+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:10:51.033 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:10:51.028+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:10:51.232 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:10:51.227+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:10:51.300 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:10:51.288+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:10:51.513 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:10:51.508+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:10:51.639 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:10:51.634+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:10:51.832 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:10:51.827+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:10:52.048 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:10:52.043+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:10:52.073 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:10:52.067+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:10:52.232 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:10:52.226+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:10:52.293 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:10:52.284+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:10:52.524 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:10:52.520+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:10:52.621 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:10:52.606+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:10:52.793 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:10:52.788+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:10:53.015 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:10:53.009+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:10:53.094 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:10:53.089+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:10:53.271 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:10:53.265+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:10:53.296 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:10:53.290+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:10:53.504 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:10:53.499+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:10:53.660 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:10:53.654+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:10:53.819 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:10:53.815+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:10:53.986 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:10:53.979+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:10:54.069 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:10:54.064+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:10:54.314 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:10:54.308+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:10:54.334 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:10:54.329+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:10:54.541 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:10:54.537+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:10:54.653 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:10:54.648+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:10:54.870 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:10:54.866+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:10:55.004 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:10:54.997+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:10:55.083 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:10:55.077+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:10:55.274 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:10:55.268+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:10:55.343 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:10:55.339+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:10:55.541 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:10:55.522+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:10:55.683 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:10:55.678+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:10:55.891 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:10:55.886+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:10:56.037 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:10:56.032+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:10:56.041 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:10:56.035+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:10:56.292 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:10:56.281+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:10:56.326 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:10:56.322+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:10:56.536 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:10:56.531+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:10:56.642 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:10:56.639+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:10:56.867 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:10:56.863+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:10:57.013 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:10:57.007+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:10:57.072 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:10:57.066+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:10:57.246 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:10:57.241+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:10:57.380 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:10:57.375+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:10:57.501 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:10:57.497+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:10:57.652 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:10:57.648+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:10:57.889 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:10:57.884+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:10:58.047 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:10:58.037+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:10:58.047 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:10:58.038+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:10:58.233 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:10:58.222+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:10:58.374 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:10:58.369+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:10:58.513 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:10:58.507+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:10:58.680 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:10:58.675+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:10:58.907 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:10:58.900+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:10:59.021 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:10:59.016+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:10:59.065 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:10:59.059+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:10:59.231 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:10:59.225+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:10:59.395 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:10:59.391+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:10:59.537 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:10:59.533+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:10:59.701 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:10:59.697+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:10:59.869 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:10:59.865+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:00.026 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:00.021+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:00.114 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:00.108+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:00.286 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:00.281+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:00.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:00.420+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:00.513 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:00.509+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:00.712 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:00.705+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:00.897 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:00.892+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:00.984 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:00.979+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:01.080 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:01.075+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:01.303 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:01.285+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:01.384 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:01.379+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:01.484 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:01.477+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:01.740 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:01.736+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:01.851 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:01.847+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:01.942 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:01.936+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:02.120 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:02.115+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:02.331 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:02.325+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:02.400 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:02.396+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:02.521 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:02.516+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:02.704 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:02.699+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:02.853 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:02.848+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:02.968 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:02.964+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:03.129 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:03.122+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:03.319 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:03.314+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:03.441 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:03.432+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:03.485 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:03.481+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:03.712 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:03.706+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:03.849 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:03.841+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:03.987 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:03.982+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:04.167 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:04.161+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:04.374 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:04.368+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:04.475 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:04.469+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:04.497 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:04.492+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:04.757 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:04.749+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:04.811 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:04.805+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:05.043 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:05.037+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:05.176 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:05.170+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:05.342 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:05.336+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:05.470 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:05.466+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:05.519 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:05.515+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:05.793 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:05.789+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:05.794 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:05.789+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:06.078 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:06.072+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:06.193 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:06.187+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:06.376 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:06.370+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:06.433 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:06.428+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:06.569 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:06.564+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:06.774 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:06.770+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:06.790 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:06.781+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:07.068 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:07.057+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:07.180 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:07.170+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:07.383 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:07.377+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:07.399 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:07.393+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:07.549 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:07.544+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:07.773 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:07.769+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:07.782 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:07.777+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:08.078 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:08.073+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:08.162 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:08.156+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:08.411 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:08.407+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:08.433 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:08.428+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:08.508 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:08.504+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:08.751 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:08.746+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:08.753 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:08.749+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:09.103 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:09.098+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:09.140 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:09.132+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:09.397 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:09.391+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:09.409 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:09.405+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:09.514 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:09.504+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:09.708 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:09.704+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:09.738 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:09.734+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:10.095 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:10.090+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:10.107 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:10.102+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:10.393 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:10.388+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:10.430 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:10.425+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:10.531 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:10.527+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:10.670 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:10.663+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:10.778 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:10.773+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:11.065 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:11.060+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:11.128 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:11.122+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:11.360 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:11.354+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:11.396 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:11.392+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:11.550 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:11.545+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:11.710 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:11.705+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:11.829 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:11.824+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:12.097 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:12.092+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:12.161 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:12.156+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:12.341 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:12.334+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:12.360 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:12.355+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:12.601 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:12.597+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:12.754 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:12.749+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:12.865 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:12.860+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:13.081 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:13.076+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:13.202 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:13.197+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:13.295 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:13.289+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:13.327 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:13.322+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:13.640 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:13.636+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:13.756 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:13.751+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:13.906 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:13.901+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:14.107 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:14.102+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:14.245 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:14.235+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:14.292 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:14.284+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:14.373 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:14.367+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:14.674 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:14.669+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:14.715 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:14.709+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:14.882 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:14.876+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:15.123 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:15.117+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:15.244 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:15.239+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:15.327 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:15.321+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:15.386 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:15.381+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:15.685 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:15.676+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:15.693 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:15.688+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:15.861 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:15.857+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:16.167 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:16.161+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:16.267 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:16.261+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:16.300 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:16.295+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:16.366 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:16.361+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:16.656 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:16.647+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:16.699 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:16.695+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:16.868 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:16.862+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:17.169 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:17.164+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:17.291 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:17.285+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:17.316 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:17.310+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:17.392 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:17.388+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:17.662 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:17.656+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:17.706 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:17.701+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:17.847 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:17.843+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:18.194 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:18.189+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:18.271 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:18.266+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:18.289 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:18.284+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:18.426 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:18.421+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:18.711 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:18.705+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:18.762 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:18.753+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:18.805 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:18.802+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:19.244 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:19.239+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:19.247 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:19.242+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:19.318 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:19.313+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:19.436 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:19.432+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:19.734 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:19.730+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:19.761 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:19.757+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:19.832 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:19.827+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:20.276 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:20.269+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:20.281 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:20.272+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:20.291 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:20.284+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:20.436 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:20.430+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:20.776 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:20.770+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:20.815 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:20.811+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:20.830 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:20.823+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:21.264 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:21.259+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:21.273 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:21.267+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:21.306 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:21.301+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:21.483 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:21.477+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:21.620 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:11:21.613+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e328 v328) 2019-12-09T19:11:21.808 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:21.802+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:21.828 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:21.820+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:21.854 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:21.849+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:22.242 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:22.235+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:22.287 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:22.281+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:22.300 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:22.294+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:22.489 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:22.484+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:22.792 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:22.786+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:22.823 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:22.817+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:22.878 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:22.873+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:23.281 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:23.275+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:23.305 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:23.300+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:23.314 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:23.308+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:23.529 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:23.524+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:23.782 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:23.776+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:23.811 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:23.805+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:23.835 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:23.829+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:24.282 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:24.276+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:24.285 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:24.280+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:24.351 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:24.346+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:24.503 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:24.498+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:24.788 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:24.782+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:24.813 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:24.807+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:24.817 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:24.812+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:25.261 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:25.255+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:25.304 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:25.298+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:25.314 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:25.309+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:25.487 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:25.481+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:25.764 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:25.759+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:25.847 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:25.841+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:11:25.869 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:11:25.864+0000 1694f700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.973633+0000 front 2019-12-09T19:10:07.107695+0000 (oldest deadline 2019-12-09T19:10:51.194561+0000) 2019-12-09T19:11:26.271 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:11:26.266+0000 1694f700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:08.791638+0000 front 2019-12-09T19:10:08.762625+0000 (oldest deadline 2019-12-09T19:10:49.567490+0000) 2019-12-09T19:11:26.313 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:11:26.307+0000 1694f700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:06.183631+0000 front 2019-12-09T19:10:06.525875+0000 (oldest deadline 2019-12-09T19:10:50.656818+0000) 2019-12-09T19:11:26.317 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:11:26.311+0000 1694f700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.879194+0000 front 2019-12-09T19:10:07.971273+0000 (oldest deadline 2019-12-09T19:10:47.070763+0000) 2019-12-09T19:11:26.524 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:11:26.518+0000 1694f700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:07.644346+0000 front 2019-12-09T19:10:06.468668+0000 (oldest deadline 2019-12-09T19:10:49.975390+0000) 2019-12-09T19:11:26.708 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:11:26.702+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e328 v328) 2019-12-09T19:11:26.766 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:11:26.760+0000 1694f700 -1 osd.3 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:04.770968+0000 front 2019-12-09T19:10:07.661468+0000 (oldest deadline 2019-12-09T19:10:49.610165+0000) 2019-12-09T19:11:26.893 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:11:26.888+0000 1694f700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:10:09.584107+0000 front 2019-12-09T19:10:09.583197+0000 (oldest deadline 2019-12-09T19:10:48.072020+0000) 2019-12-09T19:12:03.740 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:03.736+0000 21452700 -1 reset not still connected to 0x156d6e00 2019-12-09T19:12:22.029 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:06:43.079 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:12:22.058 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:06:43.115 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:12:22.073 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:06:43.131 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:12:22.099 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:06:43.157 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:12:22.119 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:06:43.153 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:12:22.124 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:06:43.158 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:12:22.202 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:06:43.260 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:12:22.216 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:06:43.274 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:12:22.282 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:06:43.316 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:12:23.870 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:23.859+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:24.755 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:24.748+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:24.883 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:24.876+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:25.755 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:25.749+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:25.873 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:25.866+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:25.988 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:25.981+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:26.339 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:26.333+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:26.724 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:26.716+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:26.782 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:26.777+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:26.852 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:26.845+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:27.012 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:27.006+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:27.316 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:27.308+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:27.695 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:27.688+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:27.768 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:27.761+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:27.853 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:27.846+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:28.037 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:28.030+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:28.311 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:28.304+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:28.665 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:28.658+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:28.788 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:28.781+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:28.837 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:28.830+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:29.022 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:29.017+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:29.267 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:29.261+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:29.656 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:29.650+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:29.665 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:29.660+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:29.777 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:29.763+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:29.843 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:29.836+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:30.014 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:30.005+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:30.274 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:30.264+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:30.624 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:30.617+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:30.727 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:30.711+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:30.757 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:30.752+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:30.879 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:30.872+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:30.976 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:30.971+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:31.301 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:31.295+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:31.677 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:31.670+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:31.768 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:31.761+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:31.796 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:31.787+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:31.887 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:31.880+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:32.020 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:32.014+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:32.314 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:32.309+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:32.684 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:32.677+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:32.776 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:32.771+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:32.803 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:32.796+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:32.910 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:32.903+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:32.992 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:32.984+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:33.340 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:33.334+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:33.708 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:33.701+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:33.742 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:33.736+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:33.804 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:33.797+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:33.944 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:33.937+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:34.003 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:33.998+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:34.372 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:34.366+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:34.685 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:34.679+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:34.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:34.701+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:34.813 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:34.806+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:34.964 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:34.959+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:34.972 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:34.967+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:34.981 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:34.974+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:35.412 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:35.405+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:35.711 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:35.704+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:35.740 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:35.734+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:35.812 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:35.805+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:35.963 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:35.955+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:35.993 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:35.982+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:35.999 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:35.994+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:36.410 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:36.404+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:36.704 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:36.698+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:36.748 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:36.741+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:36.862 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:36.854+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:36.918 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:36.912+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:37.037 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:37.032+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:37.055 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:37.049+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:37.407 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:37.402+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:37.667 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:37.662+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:37.789 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:37.779+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:37.915 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:37.910+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:37.919 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:37.914+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:38.016 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:38.010+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:38.017 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:38.012+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:38.369 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:38.363+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:38.633 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:38.624+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:38.837 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:38.831+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:38.907 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:38.899+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:38.950 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:38.944+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:38.987 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:38.978+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:39.041 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:39.025+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:39.381 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:39.374+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:39.685 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:39.678+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:39.861 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:39.855+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:39.866 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:39.859+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:40.002 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:39.995+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:40.016 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:40.009+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:40.035 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:40.030+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:40.356 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:40.348+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:40.666 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:40.662+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:40.854 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:40.848+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:40.865 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:40.859+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:40.990 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:40.983+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:41.020 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:41.013+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:41.070 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:41.063+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:41.074 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:41.069+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:41.330 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:41.323+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:41.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:41.700+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:41.849 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:41.842+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:41.869 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:41.863+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:41.981 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:41.974+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:42.050 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:42.040+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:42.051 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:42.046+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:42.066 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:42.060+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:42.378 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:42.372+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:42.751 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:42.745+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:42.843 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:42.837+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:42.878 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:42.871+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:42.985 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:42.978+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:43.036 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:43.028+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:43.037 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:43.032+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:43.095 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:43.087+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:43.358 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:43.352+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:43.727 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:43.721+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:43.854 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:43.847+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:43.891 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:43.884+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:43.964 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:43.957+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:44.053 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:44.046+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:44.055 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:44.049+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:44.075 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:44.069+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:44.403 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:44.397+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:44.702 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:44.695+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:44.861 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:44.855+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:44.935 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:44.923+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:44.942 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:44.936+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:45.061 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:45.056+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:45.095 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:45.090+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:45.099 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:45.094+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:45.409 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:45.403+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:45.660 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:45.655+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:45.913 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:45.907+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:45.946 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:45.940+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:45.979 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:45.973+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:46.087 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:46.081+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:46.140 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:46.132+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:46.141 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:46.135+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:46.420 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:46.413+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:46.627 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:46.620+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:46.886 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:46.879+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:46.912 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:46.905+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:47.011 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:47.004+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:47.113 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:47.107+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:47.180 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:47.175+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:47.184 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:47.179+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:47.402 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:47.396+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:47.608 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:47.602+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:47.875 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:47.870+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:47.948 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:47.941+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:47.972 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:47.965+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:48.161 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:48.153+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:48.162 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:48.157+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:48.168 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:48.161+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:48.409 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:48.403+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:48.580 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:48.572+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:48.914 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:48.908+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:48.953 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:48.946+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:48.971 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:48.963+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:49.124 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:49.115+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:49.132 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:49.126+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:49.169 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:49.161+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:49.415 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:49.411+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:49.586 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:49.579+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:49.891 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:49.883+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:49.913 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:49.906+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:49.934 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:49.928+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:50.172 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:50.164+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:50.173 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:50.168+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:50.215 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:50.209+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:50.468 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:50.462+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:50.633 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:50.628+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:50.855 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:50.851+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:50.923 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:50.916+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:50.930 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:50.924+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:51.224 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:51.217+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:51.225 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:51.220+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:51.260 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:51.254+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:51.493 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:51.489+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:51.588 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:51.583+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:51.847 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:51.843+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:51.902 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:51.896+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:51.944 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:51.938+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:52.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:52.219+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:52.247 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:52.240+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:52.249 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:52.243+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:52.523 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:52.518+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:52.582 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:52.578+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:52.835 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:52.830+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:52.892 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:52.886+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:52.983 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:52.977+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:53.182 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:53.177+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:53.294 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:53.284+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:53.294 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:53.287+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:53.493 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:53.488+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:53.598 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:53.590+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:53.853 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:53.848+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:53.894 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:53.888+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:53.997 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:53.990+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:54.232 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:54.224+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:54.320 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:54.312+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:54.321 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:54.316+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:54.533 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:54.529+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:54.626 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:54.618+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:54.862 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:54.853+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:54.873 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:54.866+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:55.050 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:55.043+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:55.186 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:55.179+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:55.359 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:55.351+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:55.360 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:55.354+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:55.563 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:55.558+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:55.629 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:55.623+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:55.869 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:55.862+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:55.910 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:55.905+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:56.062 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:56.053+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:56.235 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:56.228+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:56.340 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:56.333+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:56.343 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:56.339+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:56.529 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:56.522+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:56.623 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:56.618+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:56.866 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:56.860+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:56.902 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:56.896+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:57.092 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:57.084+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:57.101 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:12:57.096+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e334 v334) 2019-12-09T19:12:57.211 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:57.205+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:57.379 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:57.373+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:57.383 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:57.378+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:57.537 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:57.532+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:57.677 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:57.671+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:57.898 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:57.891+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:57.935 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:57.929+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:58.117 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:58.109+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:58.168 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:58.162+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:58.378 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:58.371+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:58.380 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:58.374+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:58.577 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:58.563+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:58.663 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:58.659+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:58.898 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:58.893+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:58.935 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:58.918+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:12:59.104 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:12:59.098+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:12:59.176 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:12:59.169+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:12:59.378 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:59.371+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:12:59.379 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:12:59.374+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:12:59.599 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:12:59.594+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:12:59.688 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:12:59.682+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:12:59.866 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:12:59.861+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:12:59.944 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:12:59.937+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:00.126 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:00.114+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:00.138 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:00.131+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:00.379 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:00.372+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:00.382 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:00.377+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:00.625 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:00.619+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:00.676 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:00.671+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:00.847 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:00.841+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:00.904 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:00.896+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:01.143 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:01.136+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:01.151 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:01.144+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:01.379 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:01.372+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:01.380 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:01.375+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:01.622 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:01.617+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:01.723 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:01.719+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:01.854 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:01.847+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:01.858 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:01.852+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:02.115 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:13:02.110+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e334 v334) 2019-12-09T19:13:02.140 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:02.134+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:02.176 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:02.170+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:02.353 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:02.345+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:02.354 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:02.349+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:02.646 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:02.640+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:02.709 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:02.704+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:02.829 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:02.823+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:02.878 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:02.871+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:03.150 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:03.142+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:03.165 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:03.158+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:03.394 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:03.388+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:03.399 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:03.394+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:03.623 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:03.618+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:03.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:03.702+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:03.857 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:03.853+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:03.891 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:03.884+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:04.124 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:04.117+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:04.195 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:04.189+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:04.374 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:04.367+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:04.378 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:04.373+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:04.617 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:04.611+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:04.713 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:04.708+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:04.826 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:04.820+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:04.894 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:04.883+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:05.116 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:05.109+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:05.203 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:05.197+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:05.400 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:05.392+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:05.401 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:05.395+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:05.657 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:05.652+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:05.676 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:05.671+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:05.809 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:05.803+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:05.894 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:05.887+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:06.130 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:06.123+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:06.235 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:06.228+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:06.398 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:06.391+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:06.400 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:06.394+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:06.628 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:06.622+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:06.695 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:06.690+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:06.798 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:06.793+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:06.886 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:06.880+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:07.143 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:13:07.137+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e334 v334) 2019-12-09T19:13:07.159 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:07.151+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:07.256 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:07.250+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:07.440 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:07.432+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:07.441 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:07.436+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:07.668 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:07.663+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:07.674 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:07.669+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:07.847 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:07.841+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:07.854 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:07.846+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:08.120 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:08.113+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:08.245 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:08.236+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:08.412 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:08.404+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:08.415 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:08.410+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:08.652 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:08.648+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:08.690 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:08.683+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:08.817 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:08.810+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:08.836 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:08.830+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:09.166 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:09.160+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:09.266 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:09.259+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:09.397 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:09.391+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:09.401 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:09.396+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:09.649 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:09.643+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:09.730 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:09.726+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:09.782 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:09.778+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:09.825 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:09.818+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:10.168 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:10.161+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:10.238 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:10.232+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:10.384 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:10.377+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:10.384 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:10.380+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:10.625 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:10.620+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:10.745 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:10.740+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:10.785 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:10.774+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:10.818 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:10.811+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:11.185 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:11.179+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:11.205 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:11.188+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:11.384 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:11.376+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:11.385 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:11.380+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:11.629 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:11.624+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:11.756 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:11.751+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:11.758 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:11.752+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:11.840 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:11.828+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:12.151 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:12.144+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:12.165 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:13:12.160+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e334 v334) 2019-12-09T19:13:12.214 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:12.207+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:12.425 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:12.418+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:12.426 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:12.421+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:12.660 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:12.656+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:12.748 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:12.743+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:12.800 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:12.795+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:12.823 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:12.817+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:13.190 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:13.183+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:13.197 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:13.191+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:13.480 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:13.472+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:13.481 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:13.476+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:13.632 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:13.626+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:13.716 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:13.710+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:13.783 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:13.777+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:13.848 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:13.841+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:14.184 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:14.177+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:14.225 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:14.219+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:14.478 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:14.471+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:14.479 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:14.474+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:14.609 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:14.604+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:14.685 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:14.679+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:14.771 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:14.766+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:14.888 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:14.876+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:15.185 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:15.180+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:15.238 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:15.232+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:15.462 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:15.455+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:15.463 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:15.458+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:15.623 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:15.617+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:15.707 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:15.700+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:15.774 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:15.768+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:15.878 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:15.871+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:16.198 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:16.191+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:16.228 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:16.221+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:16.517 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:16.505+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:12:00.836380+0000 (oldest deadline 2019-12-09T19:12:40.836380+0000) 2019-12-09T19:13:16.517 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:13:16.508+0000 1694f700 -1 osd.6 334 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e332) 2019-12-09T19:13:16.602 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:13:16.597+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:40.242890+0000 front 2019-12-09T19:11:40.932350+0000 (oldest deadline 2019-12-09T19:12:26.030743+0000) 2019-12-09T19:13:16.713 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:16.707+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:16.755 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:13:16.750+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.494028+0000 front 2019-12-09T19:11:41.492624+0000 (oldest deadline 2019-12-09T19:12:25.257343+0000) 2019-12-09T19:13:16.877 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:13:16.870+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.212553+0000 front 2019-12-09T19:11:41.220876+0000 (oldest deadline 2019-12-09T19:12:23.953807+0000) 2019-12-09T19:13:17.214 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:13:17.203+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e334 v334) 2019-12-09T19:13:17.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:13:17.219+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:43.134171+0000 front 2019-12-09T19:11:42.902225+0000 (oldest deadline 2019-12-09T19:12:28.764197+0000) 2019-12-09T19:13:17.228 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:13:17.221+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:39.128338+0000 front 2019-12-09T19:11:39.024993+0000 (oldest deadline 2019-12-09T19:12:23.792465+0000) 2019-12-09T19:13:17.720 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:13:17.716+0000 1694f700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:11:41.632466+0000 front 2019-12-09T19:11:41.422005+0000 (oldest deadline 2019-12-09T19:12:25.443524+0000) 2019-12-09T19:13:55.194 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:08:16.252 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:13:55.200 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:08:16.258 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:13:55.211 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:08:16.269 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:13:55.213 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:08:16.247 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:13:55.216 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:08:16.274 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:13:55.219 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:08:16.253 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:13:55.372 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:08:16.430 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:13:55.392 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:08:16.450 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:13:55.400 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:08:16.431 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:14:44.379 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:44.373+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:45.337 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:45.332+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:45.579 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:45.571+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:46.128 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:46.122+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:46.331 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:46.322+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:46.395 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:46.389+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:46.517 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:46.507+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:46.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:46.612+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:47.159 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:47.154+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:47.349 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:47.342+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:47.431 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:47.424+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:47.489 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:47.485+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:47.603 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:47.591+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:47.741 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:47.736+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:14:48.128 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:48.122+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:48.333 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:48.323+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:48.421 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:48.415+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:48.451 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:48.445+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:48.556 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:48.550+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:48.631 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:14:48.626+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:14:48.783 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:48.778+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:14:49.104 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:49.098+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:49.287 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:49.282+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:49.455 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:49.448+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:49.472 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:49.467+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:49.560 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:49.555+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:49.627 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:14:49.622+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:14:49.804 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:49.799+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:14:50.114 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:50.109+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:50.266 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:50.261+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:50.507 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:50.499+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:50.508 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:50.500+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:50.554 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:50.548+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:50.613 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:14:50.608+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:14:50.823 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:50.817+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:14:51.108 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:51.102+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:51.304 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:51.298+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:51.525 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:51.519+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:51.535 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:51.529+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:51.556 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:51.551+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:51.632 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:14:51.627+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:14:51.798 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:51.792+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:14:52.141 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:52.134+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:52.273 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:52.269+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:52.485 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:52.479+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:52.501 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:52.495+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:52.570 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:52.565+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:52.677 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:14:52.671+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:14:52.851 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:52.845+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:14:53.188 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:53.164+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:53.304 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:53.293+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:53.449 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:53.443+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:53.458 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:53.449+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:53.560 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:53.554+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:53.658 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:14:53.653+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:14:53.842 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:53.836+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:14:54.185 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:54.179+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:54.305 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:54.299+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:54.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:54.419+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:54.460 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:54.455+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:54.557 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:54.551+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:54.622 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:14:54.616+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:14:54.907 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:54.899+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:14:55.210 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:55.205+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:55.352 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:55.344+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:55.445 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:55.439+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:55.459 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:55.453+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:55.532 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:55.526+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:55.640 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:14:55.635+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:14:55.929 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:55.924+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:14:56.190 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:56.184+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:56.352 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:56.344+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:56.427 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:56.421+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:56.499 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:56.494+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:56.552 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:56.546+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:56.613 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:14:56.608+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:14:56.920 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:56.914+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:14:57.204 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:57.199+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:57.338 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:57.332+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:57.432 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:57.427+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:57.460 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:57.456+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:57.580 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:57.574+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:57.663 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:14:57.659+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:14:57.964 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:57.953+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:14:58.189 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:58.184+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:58.381 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:58.374+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:58.441 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:58.438+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:58.452 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:58.446+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:58.621 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:58.615+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:58.654 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:14:58.649+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:14:58.976 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:58.970+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:14:59.143 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:14:59.139+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:14:59.354 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:14:59.332+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:14:59.475 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:14:59.471+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:14:59.483 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:14:59.479+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:14:59.643 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:14:59.638+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:14:59.651 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:14:59.645+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:14:59.945 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:14:59.940+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:00.171 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:00.165+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:00.352 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:00.346+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:00.504 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:00.499+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:00.526 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:00.522+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:00.640 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:00.635+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:00.641 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:00.635+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:00.986 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:00.980+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:01.218 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:01.213+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:01.308 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:01.302+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:01.498 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:01.494+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:01.534 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:01.530+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:01.608 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:01.604+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:01.631 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:01.626+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:02.029 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:02.023+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:02.237 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:02.232+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:02.283 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:02.278+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:02.537 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:02.533+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:02.551 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:02.548+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:02.610 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:02.604+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:02.647 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:02.643+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:03.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:03.062+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:03.272 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:03.266+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:03.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:03.267+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:03.528 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:03.522+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:03.603 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:03.599+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:03.638 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:03.633+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:03.649 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:03.644+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:04.114 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:04.108+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:04.259 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:04.254+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:04.305 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:04.301+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:04.559 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:04.555+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:04.588 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:04.583+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:04.623 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:04.618+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:04.649 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:04.645+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:05.128 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:05.122+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:05.279 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:05.273+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:05.309 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:05.303+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:05.562 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:05.557+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:05.578 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:05.573+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:05.648 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:05.643+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:05.672 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:05.668+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:06.151 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:06.145+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:06.285 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:06.279+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:06.314 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:06.310+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:06.571 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:06.565+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:06.605 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:06.600+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:06.624 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:06.619+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:06.681 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:06.676+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:07.200 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:07.190+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:07.269 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:07.264+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:07.353 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:07.349+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:07.595 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:07.590+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:07.604 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:07.599+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:07.640 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:07.635+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:07.660 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:07.656+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:08.175 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:08.168+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:08.248 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:08.243+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:08.310 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:08.306+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:08.582 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:08.578+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:08.589 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:08.585+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:08.640 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:08.635+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:08.691 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:08.687+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:09.221 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:09.212+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:09.244 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:09.237+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:09.331 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:09.328+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:09.598 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:09.593+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:09.625 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:09.619+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:09.633 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:09.629+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:09.743 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:09.738+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:10.171 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:10.166+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:10.250 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:10.244+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:10.384 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:10.379+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:10.611 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:10.607+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:10.661 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:10.655+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:10.661 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:10.652+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:10.749 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:10.743+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:11.205 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:11.199+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:11.211 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:11.206+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:11.383 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:11.379+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:11.593 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:11.589+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:11.626 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:11.622+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:11.642 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:11.636+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:11.709 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:11.704+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:12.211 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:12.205+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:12.255 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:12.250+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:12.367 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:12.362+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:12.614 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:12.610+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:12.620 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:12.617+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:12.663 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:12.659+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:12.693 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:12.689+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:13.246 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:13.237+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:13.299 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:13.294+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:13.409 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:13.404+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:13.607 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:13.602+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:13.618 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:13.613+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:13.684 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:13.673+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:13.708 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:13.702+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:14.263 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:14.257+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:14.338 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:14.333+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:14.391 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:14.387+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:14.586 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:14.582+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:14.645 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:14.641+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:14.667 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:14.663+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:14.726 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:14.721+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:15.313 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:15.291+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:15.345 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:15.340+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:15.428 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:15.424+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:15.630 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:15.625+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:15.698 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:15.693+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:15.716 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:15.711+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:15.722 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:15.716+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:16.336 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:16.331+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:16.387 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:16.381+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:16.419 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:16.413+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:16.589 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:16.585+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:16.660 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:16.653+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:16.696 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:16.690+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:16.735 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:16.730+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:17.349 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:17.344+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:17.410 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:17.404+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:17.415 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:17.411+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:17.508 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:15:17.504+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e339 v339) 2019-12-09T19:15:17.604 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:17.600+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:17.651 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:17.645+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:17.693 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:17.689+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:17.746 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:17.742+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:18.376 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:18.370+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:18.462 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:18.459+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:18.463 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:18.457+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:18.585 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:18.580+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:18.661 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:18.655+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:18.742 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:18.737+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:18.752 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:18.747+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:19.383 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:19.377+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:19.441 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:19.436+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:19.469 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:19.464+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:19.591 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:19.585+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:19.633 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:19.627+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:19.744 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:19.739+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:19.783 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:19.778+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:20.395 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:20.391+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:20.411 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:20.395+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:20.516 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:20.510+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:20.587 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:20.582+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:20.654 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:20.648+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:20.757 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:20.751+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:20.781 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:20.776+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:21.376 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:21.371+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:21.425 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:21.420+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:21.533 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:21.528+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:21.609 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:21.604+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:21.679 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:21.657+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:21.754 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:15:21.750+0000 1694f700 -1 osd.0 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:03.186466+0000 front 2019-12-09T19:14:05.417899+0000 (oldest deadline 2019-12-09T19:14:48.146703+0000) 2019-12-09T19:15:21.783 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:15:21.778+0000 1694f700 -1 osd.3 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:04.217675+0000 front 2019-12-09T19:14:05.185563+0000 (oldest deadline 2019-12-09T19:14:45.673626+0000) 2019-12-09T19:15:22.366 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:15:22.360+0000 1694f700 -1 osd.7 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.394079+0000 front 2019-12-09T19:14:05.437144+0000 (oldest deadline 2019-12-09T19:14:47.070794+0000) 2019-12-09T19:15:22.454 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:15:22.449+0000 1694f700 -1 osd.2 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.202971+0000 front 2019-12-09T19:14:04.233108+0000 (oldest deadline 2019-12-09T19:14:45.681789+0000) 2019-12-09T19:15:22.571 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:15:22.566+0000 1694f700 -1 osd.5 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:02.568762+0000 front 2019-12-09T19:14:02.698524+0000 (oldest deadline 2019-12-09T19:14:43.683470+0000) 2019-12-09T19:15:22.584 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:15:22.580+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e339 v339) 2019-12-09T19:15:22.584 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:15:22.580+0000 1694f700 -1 osd.1 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.417163+0000 front 2019-12-09T19:14:00.411405+0000 (oldest deadline 2019-12-09T19:14:45.000919+0000) 2019-12-09T19:15:22.652 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:15:22.647+0000 1694f700 -1 osd.4 339 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:14:05.184399+0000 front 2019-12-09T19:14:04.030035+0000 (oldest deadline 2019-12-09T19:14:46.229146+0000) 2019-12-09T19:15:57.962 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:10:19.020 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:57.967 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:10:19.025 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:58.014 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:10:19.072 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:58.033 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:10:19.084 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:58.079 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:10:19.112 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:58.086 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:10:19.119 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:58.133 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:10:19.191 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:58.159 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:10:19.215 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:58.265 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:10:19.299 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:16:00.653 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:00.627+0000 32788700 -1 osd.6 344 build_incremental_map_msg missing incremental map 344 2019-12-09T19:16:00.655 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:00.630+0000 32788700 -1 osd.6 344 build_incremental_map_msg missing incremental map 344 2019-12-09T19:16:00.700 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:00.634+0000 32788700 -1 osd.6 344 build_incremental_map_msg missing incremental map 344 2019-12-09T19:16:00.714 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:00.645+0000 35f8f700 -1 osd.6 344 build_incremental_map_msg missing incremental map 344 2019-12-09T19:16:00.863 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:00.742+0000 32788700 -1 osd.6 344 build_incremental_map_msg missing incremental map 344 2019-12-09T19:16:21.333 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:21.328+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:21.440 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:21.426+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:22.291 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:22.287+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:22.475 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:22.471+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:23.016 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:23.008+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:23.294 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:23.290+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:23.507 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:23.502+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:23.977 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:23.970+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:24.253 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:24.246+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:24.531 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:24.525+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:24.636 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:24.629+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:24.737 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:24.729+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:24.938 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:24.931+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:25.222 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:25.217+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:25.531 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:25.526+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:25.632 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:25.625+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:25.718 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:25.711+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:25.820 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:25.813+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:25.914 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:25.910+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:26.249 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:26.244+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:26.507 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:26.502+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:26.593 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:26.582+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:26.717 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:26.710+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:26.847 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:26.840+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:26.949 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:26.944+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:27.244 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:27.240+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:27.512 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:27.502+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:27.578 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:27.570+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:27.730 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:27.723+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:27.837 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:27.830+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:27.923 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:27.917+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:28.272 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:28.254+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:28.507 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:28.502+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:28.592 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:28.584+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:28.754 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:28.748+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:28.891 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:28.882+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:28.921 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:28.916+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:29.260 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:29.254+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:29.515 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:29.511+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:29.648 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:29.635+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:29.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:29.713+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:29.776 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:29.772+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:29.852 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:29.846+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:29.946 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:29.942+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:30.258 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:30.253+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:30.546 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:30.541+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:30.638 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:30.631+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:30.765 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:30.758+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:30.805 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:30.799+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:30.842 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:30.835+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:30.909 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:30.904+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:31.227 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:31.222+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:31.509 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:31.505+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:31.611 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:31.594+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:31.794 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:31.787+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:31.848 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:31.836+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:31.887 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:31.880+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:31.942 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:31.935+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:32.186 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:32.181+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:32.529 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:32.523+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:32.600 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:32.594+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:32.784 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:32.779+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:32.858 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:32.854+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:32.907 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:32.902+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:32.911 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:32.907+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:33.179 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:33.172+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:33.551 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:33.546+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:33.613 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:33.606+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:33.771 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:33.765+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:33.836 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:33.831+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:33.883 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:33.876+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:33.956 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:33.951+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:34.184 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:34.179+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:34.518 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:34.513+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:34.622 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:34.614+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:34.753 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:34.746+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:34.846 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:34.841+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:34.934 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:34.926+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:34.955 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:34.950+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:35.219 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:35.214+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:35.506 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:35.501+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:35.593 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:35.586+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:35.757 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:35.751+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:35.849 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:35.843+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:35.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:35.849+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:35.963 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:35.952+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:35.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:35.963+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:36.192 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:36.186+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:36.516 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:36.511+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:36.566 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:36.559+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:36.727 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:36.720+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:36.869 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:36.863+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:36.872 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:36.868+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:36.965 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:36.959+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:36.971 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:36.967+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:37.183 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:37.179+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:37.527 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:37.522+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:37.527 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:37.518+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:37.701 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:37.695+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:37.893 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:37.881+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:37.946 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:37.887+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:37.962 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:37.954+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:37.965 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:37.960+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:38.190 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:38.186+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:38.498 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:38.494+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:38.501 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:38.494+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:38.736 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:38.727+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:38.913 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:38.902+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:38.914 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:38.905+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:38.938 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:38.932+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:38.939 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:38.934+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:39.161 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:39.156+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:39.489 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:39.482+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:39.526 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:39.521+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:39.732 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:39.725+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:39.892 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:39.888+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:39.924 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:39.913+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:39.924 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:39.919+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:39.941 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:39.934+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:40.205 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:40.201+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:40.452 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:40.445+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:40.576 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:40.571+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:40.768 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:40.761+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:40.926 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:40.922+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:40.927 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:40.919+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:40.928 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:40.923+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:40.937 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:40.930+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:41.209 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:41.205+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:41.494 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:41.486+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:41.578 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:41.574+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:41.807 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:41.800+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:41.931 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:41.925+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:41.959 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:41.952+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:41.960 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:41.955+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:41.963 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:41.958+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:42.246 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:42.240+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:42.517 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:42.510+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:42.581 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:42.575+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:42.808 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:42.802+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:42.965 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:42.957+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:42.965 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:42.961+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:42.967 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:42.960+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:42.972 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:42.966+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:43.211 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:43.205+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:43.514 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:43.506+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:43.550 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:43.543+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:43.848 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:43.842+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:43.949 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:43.942+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:43.965 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:43.959+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:43.978 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:43.970+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:43.979 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:43.974+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:44.260 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:44.253+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:44.485 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:44.476+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:44.513 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:44.508+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:44.905 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:44.895+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:44.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:44.959+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:44.985 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:44.980+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:45.024 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:45.017+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:45.027 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:45.022+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:45.237 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:45.231+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:45.470 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:45.463+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:45.481 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:45.475+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:45.939 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:45.932+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:45.969 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:45.962+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:46.015 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:46.009+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:46.020 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:46.014+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:46.024 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:46.019+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:46.281 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:46.275+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:46.467 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:46.460+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:46.507 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:46.500+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:46.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:46.919+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:46.929 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:46.924+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:46.980 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:46.973+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:46.982 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:46.976+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:47.059 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:47.053+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:47.235 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:47.229+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:47.426 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:47.419+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:47.491 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:47.485+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:47.917 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:47.909+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:47.939 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:47.933+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:47.979 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:47.972+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:47.980 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:47.975+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:48.053 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:48.046+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:48.254 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:48.247+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:48.424 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:48.419+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:48.547 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:48.540+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:48.906 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:48.901+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:48.908 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:48.903+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:48.944 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:48.937+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:48.945 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:48.940+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:49.072 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:49.067+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:49.290 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:49.284+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:49.449 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:49.444+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:49.579 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:49.572+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:49.863 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:49.856+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:49.922 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:49.915+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:49.929 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:49.922+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:49.930 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:49.925+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:50.081 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:50.074+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:50.281 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:50.275+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:50.436 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:50.430+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:50.596 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:50.589+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:50.824 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:50.817+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:50.888 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:50.881+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:50.955 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:50.947+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:50.956 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:50.950+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:51.093 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:51.086+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:51.319 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:51.311+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:51.442 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:51.436+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:51.600 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:51.593+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:51.794 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:51.788+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:51.866 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:51.860+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:52.005 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:51.998+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:52.006 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:52.001+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:52.066 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:52.059+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:52.305 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:52.296+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:52.410 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:52.404+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:52.653 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:52.632+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:52.769 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:52.762+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:52.860 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:52.854+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:53.035 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:53.029+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:53.057 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:53.050+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:53.059 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:53.053+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:53.188 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:16:53.182+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e344 v344) 2019-12-09T19:16:53.292 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:53.287+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:53.380 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:53.375+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:53.611 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:53.603+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:53.739 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:53.733+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:53.829 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:53.822+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:54.032 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:54.025+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:54.043 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:54.036+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:54.054 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:54.042+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:54.267 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:54.262+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:54.342 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:54.334+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:54.643 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:54.636+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:54.759 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:54.753+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:54.852 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:54.845+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:55.020 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:55.014+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:55.063 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:55.056+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:55.064 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:55.059+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:55.270 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:55.264+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:55.372 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:55.366+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:55.609 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:55.602+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:55.780 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:55.775+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:55.841 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:55.834+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:55.978 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:55.971+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:56.024 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:56.014+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:56.040 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:56.025+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:56.260 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:56.253+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:56.420 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:56.414+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:56.633 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:56.623+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:56.768 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:56.761+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:56.796 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:56.788+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:56.998 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:56.992+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:57.010 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:57.000+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:57.010 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:57.003+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:57.256 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:57.250+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:57.469 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:57.462+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:57.649 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:57.643+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:57.749 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:57.742+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:57.820 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:57.814+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:58.017 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:58.004+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:58.017 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:58.008+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:58.045 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:58.038+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:58.199 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:16:58.194+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e344 v344) 2019-12-09T19:16:58.242 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:58.236+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:58.493 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:58.486+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:58.628 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:58.622+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:58.750 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:58.743+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:58.855 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:58.849+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:16:59.013 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:16:59.006+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:16:59.050 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:59.043+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:16:59.053 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:16:59.048+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:16:59.223 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:16:59.218+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:16:59.503 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:16:59.497+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:16:59.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:16:59.662+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:16:59.793 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:16:59.787+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:16:59.900 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:16:59.893+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:17:00.019 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:17:00.014+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:17:00.040 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:00.032+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:17:00.040 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:00.035+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:17:00.253 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:17:00.246+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:17:00.501 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:17:00.495+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:17:00.682 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:17:00.675+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:17:00.819 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:17:00.813+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:17:00.916 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:00.909+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:17:01.024 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:17:01.018+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:17:01.048 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:01.041+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:17:01.050 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:01.046+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:17:01.233 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:17:01.227+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:17:01.457 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:17:01.452+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:17:01.713 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:17:01.706+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:17:01.841 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:17:01.834+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:17:01.875 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:01.868+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:17:02.023 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:17:02.017+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:17:02.030 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:02.023+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:17:02.032 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:02.026+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:17:02.209 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:17:02.204+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:17:02.473 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:17:02.466+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:17:02.699 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:17:02.693+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:17:02.831 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:17:02.824+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:17:02.875 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:02.868+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:17:03.003 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:02.997+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:17:03.008 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:03.003+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:17:03.038 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:17:03.027+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:17:03.216 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:17:03.209+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e344 v344) 2019-12-09T19:17:03.250 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:17:03.244+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:17:03.485 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:17:03.478+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:17:03.689 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:17:03.683+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:17:03.832 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:03.825+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:17:03.869 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:17:03.863+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:17:04.012 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:04.005+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:17:04.012 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:04.008+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:17:04.036 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:17:04.030+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:17:04.300 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:17:04.294+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:17:04.447 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:17:04.441+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:17:04.721 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:17:04.716+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:17:04.788 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:04.783+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:17:04.879 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:17:04.873+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:17:05.041 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:17:05.034+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:17:05.055 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:05.048+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:17:05.060 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:05.055+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:17:05.303 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:17:05.298+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:17:05.483 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:17:05.479+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:17:05.736 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:17:05.730+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:17:05.818 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:05.812+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:17:05.910 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:17:05.903+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:17:06.087 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:17:06.083+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:17:06.103 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:06.096+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:17:06.106 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:06.102+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:17:06.346 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:17:06.341+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:17:06.487 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:17:06.482+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:17:06.695 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:17:06.687+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:17:06.773 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:06.766+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:17:06.937 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:17:06.930+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:17:07.061 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:17:07.057+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:17:07.159 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:07.151+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:17:07.160 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:07.154+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:17:07.364 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:17:07.359+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:17:07.493 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:17:07.482+0000 1694f700 -1 osd.3 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.357533+0000 front 2019-12-09T19:15:39.162844+0000 (oldest deadline 2019-12-09T19:16:21.411754+0000) 2019-12-09T19:17:07.716 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:17:07.708+0000 1694f700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.984640+0000 front 2019-12-09T19:15:37.978464+0000 (oldest deadline 2019-12-09T19:16:23.852332+0000) 2019-12-09T19:17:07.822 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:07.814+0000 1694f700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.972104+0000 front 2019-12-09T19:15:39.758135+0000 (oldest deadline 2019-12-09T19:16:25.030267+0000) 2019-12-09T19:17:07.949 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:17:07.942+0000 1694f700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:39.146641+0000 front 2019-12-09T19:15:39.128573+0000 (oldest deadline 2019-12-09T19:16:24.410996+0000) 2019-12-09T19:17:08.060 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:17:08.055+0000 1694f700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:38.142915+0000 front 2019-12-09T19:15:38.318649+0000 (oldest deadline 2019-12-09T19:16:22.227887+0000) 2019-12-09T19:17:08.188 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:08.180+0000 1694f700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:15:55.816776+0000 (oldest deadline 2019-12-09T19:16:35.816776+0000) 2019-12-09T19:17:08.189 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:08.182+0000 1694f700 -1 osd.6 344 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e343) 2019-12-09T19:17:08.266 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:17:08.261+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e344 v344) 2019-12-09T19:17:08.355 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:17:08.350+0000 1694f700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:15:37.657964+0000 front 2019-12-09T19:15:37.676914+0000 (oldest deadline 2019-12-09T19:16:20.511521+0000) 2019-12-09T19:17:09.078 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:17:09.025+0000 34f8d700 -1 osd.6 345 build_incremental_map_msg missing incremental map 344 2019-12-09T19:17:36.858 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:36.849+0000 34f8d700 -1 osd.7 348 build_incremental_map_msg missing incremental map 348 2019-12-09T19:17:36.923 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:36.850+0000 34f8d700 -1 osd.7 348 build_incremental_map_msg missing incremental map 348 2019-12-09T19:17:37.053 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:36.947+0000 35f8f700 -1 osd.7 348 build_incremental_map_msg missing incremental map 348 2019-12-09T19:17:37.053 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:36.954+0000 34f8d700 -1 osd.7 348 build_incremental_map_msg missing incremental map 348 2019-12-09T19:17:37.592 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:37.450+0000 3578e700 -1 osd.7 348 build_incremental_map_msg missing incremental map 348 2019-12-09T19:17:37.637 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:17:37.483+0000 37f93700 -1 osd.7 348 build_incremental_map_msg missing incremental map 348 2019-12-09T19:17:39.239 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:17:39.214+0000 31786700 -1 osd.0 350 build_incremental_map_msg missing incremental map 350 2019-12-09T19:17:39.240 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:17:39.220+0000 31786700 -1 osd.0 350 build_incremental_map_msg missing incremental map 350 2019-12-09T19:17:39.248 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:17:39.242+0000 36790700 -1 osd.0 350 build_incremental_map_msg missing incremental map 350 2019-12-09T19:17:39.284 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:17:39.255+0000 36790700 -1 osd.0 350 build_incremental_map_msg missing incremental map 350 2019-12-09T19:17:39.306 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:17:39.260+0000 31f87700 -1 osd.0 350 build_incremental_map_msg missing incremental map 350 2019-12-09T19:17:39.310 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:17:39.270+0000 31786700 -1 osd.0 350 build_incremental_map_msg missing incremental map 350 2019-12-09T19:17:39.615 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:17:39.534+0000 34f8d700 -1 osd.0 350 build_incremental_map_msg missing incremental map 350 2019-12-09T19:17:41.347 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:17:41.257+0000 36f91700 -1 osd.0 350 build_incremental_map_msg missing incremental map 350 2019-12-09T19:17:55.193 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:12:16.251 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:55.200 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:12:16.258 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:55.212 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:12:16.245 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:55.218 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:12:16.249 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:55.221 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:12:16.279 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:55.233 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:12:16.288 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:55.341 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:12:16.398 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:55.370 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:12:16.428 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:55.379 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:12:16.413 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:18:39.041 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:39.036+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:39.801 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:39.797+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:40.005 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:40.001+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:40.039 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:40.032+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:40.504 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:40.499+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:40.615 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:40.610+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:40.793 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:40.787+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:41.013 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:41.004+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:41.064 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:41.056+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:41.313 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:41.309+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:41.462 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:41.457+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:41.588 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:41.584+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:41.775 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:41.770+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:42.032 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:42.027+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:42.078 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:42.072+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:42.342 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:42.338+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:42.501 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:42.495+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:42.636 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:42.631+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:42.804 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:42.797+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:42.812 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:42.807+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:43.030 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:43.024+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:43.073 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:43.068+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:43.333 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:43.328+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:43.506 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:43.500+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:43.684 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:43.680+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:43.783 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:43.776+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:43.806 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:43.800+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:44.005 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:43.999+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:44.121 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:44.115+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:44.335 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:44.330+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:44.476 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:44.472+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:44.709 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:44.704+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:44.768 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:44.763+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:44.795 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:44.790+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:45.036 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:45.032+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:45.076 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:45.071+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:45.377 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:45.372+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:45.472 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:45.465+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:45.745 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:45.742+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:45.802 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:45.797+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:45.826 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:45.819+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:46.026 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:46.021+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:46.114 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:46.109+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:46.357 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:46.353+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:46.474 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:46.470+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:46.770 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:46.762+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:46.846 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:46.840+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:46.846 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:46.842+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:47.057 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:47.051+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:47.092 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:47.085+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:47.350 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:47.347+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:47.525 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:47.520+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:47.781 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:47.775+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:47.808 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:47.802+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:47.870 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:47.865+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:48.057 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:48.051+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:48.076 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:48.072+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:48.399 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:48.391+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:48.527 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:48.521+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:48.829 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:48.824+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:48.861 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:48.850+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:48.874 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:48.868+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:49.057 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:49.054+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:49.110 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:49.098+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:49.382 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:49.377+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:49.513 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:49.508+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:49.869 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:49.863+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:49.881 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:49.876+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:49.885 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:49.879+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:50.057 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:50.053+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:50.134 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:50.127+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:50.337 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:50.332+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:50.534 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:50.530+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:50.834 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:50.829+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:50.851 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:50.844+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:50.905 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:50.899+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:51.033 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:51.028+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:51.103 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:51.096+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:51.343 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:51.339+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:51.494 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:51.488+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:51.875 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:51.871+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:51.885 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:51.879+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:51.933 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:51.928+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:52.058 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:52.053+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:52.150 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:52.144+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:52.397 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:52.391+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:52.485 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:52.479+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:52.857 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:52.852+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:52.887 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:52.882+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:52.889 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:52.884+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:53.067 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:53.062+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:53.181 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:53.176+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:53.419 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:53.413+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:53.498 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:53.492+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:53.859 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:53.854+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:53.870 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:53.865+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:53.920 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:53.914+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:54.114 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:54.108+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:54.214 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:54.209+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:54.458 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:54.452+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:54.471 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:54.460+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:54.818 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:54.814+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:54.858 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:54.852+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:54.873 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:54.868+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:55.105 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:55.099+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:55.190 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:55.182+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:55.473 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:55.467+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:55.494 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:55.488+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:55.777 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:55.772+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:55.872 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:55.867+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:55.892 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:55.884+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:56.105 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:56.100+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:56.197 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:56.192+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:56.440 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:56.434+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:56.518 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:56.513+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:56.814 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:56.806+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:56.899 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:56.893+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:56.900 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:56.896+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:57.078 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:57.072+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:57.210 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:57.205+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:57.402 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:57.396+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:57.528 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:57.519+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:57.794 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:57.787+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:57.871 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:57.866+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:57.904 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:57.898+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:58.074 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:58.068+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:58.165 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:58.160+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:58.439 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:58.431+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:58.529 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:58.524+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:58.800 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:58.795+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:58.904 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:58.898+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:18:58.909 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:58.904+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:59.077 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:18:59.073+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:18:59.206 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:18:59.197+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:18:59.392 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:18:59.387+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:18:59.490 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:18:59.484+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:18:59.852 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:18:59.848+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:18:59.912 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:18:59.907+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:18:59.955 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:18:59.950+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:00.056 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:00.051+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:00.245 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:00.235+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:00.403 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:19:00.397+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:19:00.510 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:00.505+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:00.817 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:00.812+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:00.893 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:00.886+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:01.010 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:01.002+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:01.061 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:01.056+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:01.195 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:01.190+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:01.361 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:19:01.355+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:19:01.503 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:01.497+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:01.853 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:01.848+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:01.859 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:01.853+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:01.972 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:01.966+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:02.036 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:02.031+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:02.154 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:02.149+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:02.330 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:19:02.323+0000 1694f700 -1 osd.0 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.017112+0000 front 2019-12-09T19:17:56.005059+0000 (oldest deadline 2019-12-09T19:18:39.530627+0000) 2019-12-09T19:19:02.466 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:02.461+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:02.824 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:02.819+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:02.828 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:02.823+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:02.962 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:02.956+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:03.079 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:03.074+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:03.131 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:03.125+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:03.479 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:03.473+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:03.869 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:03.861+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:03.872 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:03.868+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:04.011 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:04.005+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:04.066 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:04.062+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:04.155 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:04.149+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:04.456 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:04.450+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:04.880 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:04.874+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:04.900 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:04.891+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:04.986 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:04.980+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:05.078 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:05.073+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:05.167 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:05.160+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:05.427 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:05.422+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:05.852 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:05.846+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:05.886 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:05.880+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:05.986 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:05.981+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:06.044 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:06.038+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:06.187 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:06.181+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:06.433 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:06.427+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:06.818 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:06.812+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:06.856 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:06.850+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:06.960 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:06.954+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:07.091 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:07.086+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:07.219 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:07.214+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:07.462 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:07.457+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:07.831 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:07.825+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:07.849 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:07.839+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:07.941 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:07.935+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:08.100 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:08.094+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:08.215 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:08.210+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:08.441 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:08.431+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:08.787 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:08.783+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:08.806 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:08.797+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:08.951 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:08.943+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:09.111 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:09.106+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:09.189 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:09.183+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:09.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:09.419+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:09.769 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:09.763+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:09.852 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:09.846+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:09.986 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:09.980+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:10.159 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:10.154+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:10.169 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:10.164+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:10.396 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:10.391+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:10.774 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:10.768+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:10.888 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:10.882+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:11.021 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:11.015+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:11.153 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:11.148+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:11.194 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:11.188+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:11.445 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:11.433+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:11.761 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:11.756+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:11.936 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:11.930+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:12.020 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:12.014+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:12.125 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:12.120+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:12.158 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:12.153+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:12.423 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:12.418+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:12.806 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:19:12.801+0000 1694f700 -1 osd.4 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:56.751064+0000 front 2019-12-09T19:17:57.297707+0000 (oldest deadline 2019-12-09T19:18:41.974392+0000) 2019-12-09T19:19:12.900 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:19:12.895+0000 1694f700 -1 osd.7 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.908649+0000 front 2019-12-09T19:17:54.936627+0000 (oldest deadline 2019-12-09T19:18:39.329496+0000) 2019-12-09T19:19:13.041 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:13.036+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:13.149 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:19:13.143+0000 1694f700 -1 osd.5 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.156592+0000 front 2019-12-09T19:17:53.203338+0000 (oldest deadline 2019-12-09T19:18:39.004279+0000) 2019-12-09T19:19:13.173 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:19:13.168+0000 1694f700 -1 osd.1 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:55.016961+0000 front 2019-12-09T19:17:55.727322+0000 (oldest deadline 2019-12-09T19:18:38.281167+0000) 2019-12-09T19:19:13.436 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:19:13.431+0000 1694f700 -1 osd.3 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:57.102392+0000 front 2019-12-09T19:17:56.550699+0000 (oldest deadline 2019-12-09T19:18:41.126693+0000) 2019-12-09T19:19:13.623 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:19:13.619+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 45sec e350 v350) 2019-12-09T19:19:14.073 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:19:14.070+0000 1694f700 -1 osd.2 350 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:17:54.834932+0000 front 2019-12-09T19:17:55.967345+0000 (oldest deadline 2019-12-09T19:18:39.907766+0000) 2019-12-09T19:19:52.633 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:19:52.622+0000 34f8d700 -1 osd.6 355 build_incremental_map_msg missing incremental map 355 2019-12-09T19:19:53.696 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:19:53.685+0000 34f8d700 -1 osd.6 356 build_incremental_map_msg missing incremental map 355 2019-12-09T19:20:10.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:10.490+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:11.474 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:11.467+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:12.305 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:12.296+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:12.510 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:12.503+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:12.569 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:12.562+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:12.925 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:12.919+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:13.307 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:13.302+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:13.511 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:13.503+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:13.598 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:13.589+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:13.821 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:13.813+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:13.958 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:13.951+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:14.293 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:14.286+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:14.474 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:14.468+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:14.571 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:14.564+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:14.813 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:14.806+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:14.959 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:14.953+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:15.254 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:15.249+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:15.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:15.490+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:15.502 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:15.496+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:15.618 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:15.611+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:15.779 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:15.774+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:15.933 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:15.921+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:16.211 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:16.204+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:16.527 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:16.520+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:16.556 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:16.549+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:16.633 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:16.625+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:16.782 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:16.776+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:16.938 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:16.931+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:17.217 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:17.211+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:17.545 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:17.537+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:17.560 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:17.553+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:17.639 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:17.632+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:17.818 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:17.812+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:17.906 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:17.900+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:18.219 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:18.214+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:18.508 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:18.501+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:18.559 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:18.552+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:18.652 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:18.644+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:18.808 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:18.804+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:18.892 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:18.888+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:19.224 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:19.218+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:19.501 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:19.494+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:19.552 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:19.545+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:19.656 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:19.649+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:19.814 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:19.808+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:19.885 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:19.880+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:20.188 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:20.183+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:20.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:20.489+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:20.575 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:20.569+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:20.711 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:20.703+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:20.861 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:20.855+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:20.871 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:20.864+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:21.145 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:21.140+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:21.499 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:21.492+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:21.589 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:21.582+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:21.739 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:21.730+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:21.889 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:21.884+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:21.891 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:21.886+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:22.147 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:22.141+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:22.458 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:22.451+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:22.623 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:22.616+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:22.700 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:22.693+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:22.876 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:22.871+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:22.925 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:22.920+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:22.974 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:22.968+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:23.118 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:23.112+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:23.440 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:23.434+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:23.674 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:23.667+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:23.696 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:23.690+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:23.878 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:23.874+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:23.944 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:23.939+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:23.993 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:23.988+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:24.120 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:24.115+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:24.422 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:24.415+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:24.654 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:24.647+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:24.661 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:24.651+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:24.873 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:24.867+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:24.994 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:24.989+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:24.996 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:24.990+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:25.105 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:25.099+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:25.476 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:25.464+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:25.610 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:25.602+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:25.652 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:25.645+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:25.877 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:25.869+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:26.002 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:25.997+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:26.049 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:26.036+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:26.133 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:26.128+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:26.492 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:26.485+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:26.573 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:26.566+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:26.608 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:26.603+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:26.868 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:26.863+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:26.973 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:26.966+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:27.017 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:27.010+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:27.134 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:27.128+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:27.539 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:27.532+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:27.555 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:27.548+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:27.584 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:27.577+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:27.840 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:27.834+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:27.943 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:27.937+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:28.004 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:27.999+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:28.141 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:28.135+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:28.539 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:28.532+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:28.592 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:28.584+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:28.592 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:28.584+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:28.868 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:28.862+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:28.912 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:28.909+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:29.000 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:28.994+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:29.117 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:29.112+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:29.528 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:29.521+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:29.550 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:29.543+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:29.627 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:29.620+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:29.903 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:29.897+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:29.908 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:29.904+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:29.975 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:29.968+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:29.976 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:29.971+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:30.149 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:30.140+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:30.522 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:30.513+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:30.594 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:30.587+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:30.598 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:30.592+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:30.871 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:30.867+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:30.898 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:30.892+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:31.028 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:31.020+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:31.029 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:31.023+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:31.179 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:31.175+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:31.511 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:31.503+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:31.586 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:31.580+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:31.650 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:31.643+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:31.900 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:31.895+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:31.901 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:31.897+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:32.023 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:32.015+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:32.025 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:32.019+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:32.198 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:32.194+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:32.571 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:32.557+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:32.623 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:32.616+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:32.638 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:32.632+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:32.867 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:32.862+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:32.884 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:32.879+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:32.989 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:32.982+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:32.990 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:32.985+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:33.191 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:33.185+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:33.567 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:33.561+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:33.649 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:33.643+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:33.665 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:33.658+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:33.831 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:33.826+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:33.875 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:33.870+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:33.987 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:33.979+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:33.994 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:33.983+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:34.165 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:34.161+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:34.584 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:34.576+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:34.659 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:34.653+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:34.690 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:34.684+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:34.828 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:34.820+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:34.873 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:34.868+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:34.995 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:34.988+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:34.996 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:34.991+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:35.124 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:35.120+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:35.625 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:35.618+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:35.643 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:35.636+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:35.727 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:35.719+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:35.851 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:35.846+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:35.895 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:35.891+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:35.972 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:35.965+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:35.973 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:35.968+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:36.111 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:36.106+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:36.665 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:36.659+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:36.672 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:36.665+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:36.700 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:36.692+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:36.824 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:36.819+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:36.929 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:36.924+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:36.980 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:36.973+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:36.981 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:36.976+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:37.126 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:37.122+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:37.709 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:37.702+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:37.715 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:37.708+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:37.723 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:37.714+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:37.778 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:37.774+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:37.919 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:37.912+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:38.017 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:38.010+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:38.018 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:38.013+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:38.177 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:38.173+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:38.700 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:38.693+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:38.726 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:38.719+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:38.733 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:38.725+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:38.766 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:38.761+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:38.887 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:38.883+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:39.068 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:39.062+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:39.068 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:39.064+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:39.194 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:39.189+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:39.675 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:39.669+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:39.764 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:39.744+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:39.775 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:39.770+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:39.777 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:39.771+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:39.900 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:39.896+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:40.026 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:40.018+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:40.027 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:40.021+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:40.156 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:40.151+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:40.696 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:40.690+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:40.728 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:40.721+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:40.801 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:40.796+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:40.804 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:40.797+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:40.892 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:40.886+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:41.036 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:41.030+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:41.037 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:41.032+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:41.187 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:41.183+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:41.727 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:41.721+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:41.731 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:41.724+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:41.795 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:41.788+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:41.849 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:41.844+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:41.868 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:41.863+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:42.088 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:42.082+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:42.092 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:42.084+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:42.240 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:42.235+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:42.734 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:42.728+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:42.769 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:42.762+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:42.820 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:42.816+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:42.821 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:42.814+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:42.833 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:42.827+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:43.108 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:43.100+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:43.109 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:43.103+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:43.199 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:43.195+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:43.733 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:43.726+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:43.788 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:43.781+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:43.791 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:43.787+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:43.796 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:43.792+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:43.842 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:43.836+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:43.954 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:20:43.951+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e356 v356) 2019-12-09T19:20:44.005 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:15:05.063 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:20:44.016 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:15:05.074 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:20:44.023 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:15:05.081 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:20:44.037 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:15:05.087 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:20:44.083 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:15:05.117 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:20:44.089 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:15:05.123 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:20:44.144 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:15:05.202 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:20:44.155 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:44.147+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:44.156 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:44.151+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:44.171 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:15:05.229 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:20:44.233 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:44.228+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:44.260 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:15:05.294 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:20:44.751 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:44.746+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:44.771 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:44.767+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:44.775 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:44.771+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:44.805 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:44.793+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:44.810 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:44.805+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:45.145 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:45.139+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:45.145 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:45.141+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:45.203 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:45.196+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:45.782 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:45.777+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:45.801 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:45.794+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:45.803 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:45.799+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:45.809 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:45.803+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:45.809 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:45.804+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:46.195 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:46.185+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:46.195 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:46.188+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:46.252 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:46.248+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:46.773 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:46.768+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:46.774 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:46.768+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:46.796 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:46.791+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:46.800 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:46.794+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:46.852 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:46.845+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:47.189 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:47.182+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:47.191 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:47.185+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:47.234 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:47.230+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:47.766 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:47.760+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:47.780 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:47.773+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:47.806 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:47.800+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:47.812 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:47.806+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:47.841 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:47.834+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:48.160 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:48.152+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:48.161 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:48.156+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:48.283 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:48.279+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:48.746 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:48.734+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:48.756 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:48.752+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:48.767 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:48.762+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:48.827 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:48.821+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:48.842 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:48.836+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:48.976 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:20:48.973+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e356 v356) 2019-12-09T19:20:49.182 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:49.175+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:49.183 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:49.178+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:49.320 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:49.315+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:49.776 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:49.769+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:49.794 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:49.788+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:49.806 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:49.801+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:49.806 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:49.794+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:49.852 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:49.845+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:50.211 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:50.205+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:50.214 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:50.210+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:50.282 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:50.277+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:50.741 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:50.729+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:50.799 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:50.794+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:50.814 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:50.810+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:50.851 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:50.844+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:50.856 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:50.850+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:51.207 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:51.199+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:51.208 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:51.202+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:51.315 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:51.311+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:51.753 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:51.746+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:51.791 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:51.785+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:51.793 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:51.788+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:51.898 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:51.891+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:51.908 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:51.902+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:52.238 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:52.231+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:52.239 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:52.234+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:52.362 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:52.357+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:52.713 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:52.705+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:52.792 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:52.786+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:52.823 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:52.818+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:52.854 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:52.847+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:52.879 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:52.873+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:53.237 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:53.230+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:53.238 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:53.233+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:53.386 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:53.382+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:53.734 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:53.727+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:53.792 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:53.787+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:53.856 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:53.849+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:53.880 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:53.866+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:53.914 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:53.907+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:53.994 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:20:53.990+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e356 v356) 2019-12-09T19:20:54.264 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:54.257+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:54.265 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:54.260+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:54.358 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:54.353+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:54.777 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:54.773+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:54.787 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:54.778+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:54.818 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:54.814+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:54.876 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:54.869+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:54.912 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:54.891+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:55.315 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:55.306+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:55.315 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:55.311+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:55.342 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:55.338+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:55.780 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:55.773+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:55.818 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:55.814+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:55.822 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:55.817+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:55.882 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:55.875+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:55.924 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:55.917+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:56.276 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:56.269+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:56.278 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:56.272+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:56.377 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:56.371+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:56.741 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:56.734+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:56.804 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:56.801+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:56.850 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:56.844+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:56.861 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:56.855+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:56.960 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:56.953+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:57.305 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:57.301+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:57.317 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:57.304+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:57.408 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:57.404+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:57.732 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:57.725+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:57.824 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:57.818+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:57.833 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:57.827+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:57.848 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:57.842+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:57.952 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:57.946+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:58.286 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:58.278+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:58.287 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:58.282+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:58.401 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:58.397+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:58.738 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:58.732+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:58.802 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:58.797+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:58.816 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:58.810+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:58.892 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:58.886+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:58.934 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:58.928+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:20:59.014 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:20:59.006+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e356 v356) 2019-12-09T19:20:59.316 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:59.308+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:20:59.317 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:20:59.311+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:20:59.432 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:20:59.426+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:20:59.779 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:20:59.773+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:20:59.791 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:20:59.785+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:20:59.818 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:20:59.811+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:20:59.886 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:20:59.879+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:20:59.903 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:20:59.897+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:21:00.284 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:21:00.269+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:21:00.284 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:21:00.273+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:21:00.403 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:21:00.396+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:21:00.755 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:21:00.749+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:21:00.813 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:21:00.806+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:21:00.842 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:21:00.835+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:21:00.844 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:21:00.837+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:21:00.932 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:21:00.925+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:21:01.273 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:21:01.264+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:21:01.273 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:21:01.268+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:21:01.452 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:21:01.447+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:21:01.750 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:21:01.745+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:21:01.774 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:21:01.763+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:21:01.852 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:21:01.845+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:21:01.889 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:21:01.883+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:21:01.965 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:21:01.958+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:21:02.271 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:21:02.264+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:21:02.275 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:21:02.270+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:21:02.432 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:21:02.426+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:21:02.775 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:21:02.769+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:21:02.797 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:21:02.790+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:21:02.858 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:21:02.850+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:21:02.887 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:21:02.880+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:21:03.012 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:21:03.006+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:21:03.263 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:21:03.256+0000 1694f700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:19:49.297602+0000 (oldest deadline 2019-12-09T19:20:29.297602+0000) 2019-12-09T19:21:03.264 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:21:03.259+0000 1694f700 -1 osd.6 356 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:21:03.471 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:21:03.465+0000 1694f700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.385252+0000 front 2019-12-09T19:19:27.384398+0000 (oldest deadline 2019-12-09T19:20:11.473730+0000) 2019-12-09T19:21:03.735 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:21:03.728+0000 1694f700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:27.391606+0000 front 2019-12-09T19:19:27.195432+0000 (oldest deadline 2019-12-09T19:20:13.035737+0000) 2019-12-09T19:21:03.824 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:21:03.817+0000 1694f700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.476404+0000 front 2019-12-09T19:19:26.973232+0000 (oldest deadline 2019-12-09T19:20:10.441184+0000) 2019-12-09T19:21:03.842 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:21:03.836+0000 1694f700 -1 osd.3 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:29.041310+0000 front 2019-12-09T19:19:29.052924+0000 (oldest deadline 2019-12-09T19:20:12.525444+0000) 2019-12-09T19:21:03.867 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:21:03.861+0000 1694f700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:25.908543+0000 front 2019-12-09T19:19:25.909234+0000 (oldest deadline 2019-12-09T19:20:11.677283+0000) 2019-12-09T19:21:04.011 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:21:04.004+0000 1694f700 -1 osd.5 356 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:19:30.736337+0000 front 2019-12-09T19:19:30.251769+0000 (oldest deadline 2019-12-09T19:20:15.482042+0000) 2019-12-09T19:21:04.076 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:21:04.069+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e356 v356) 2019-12-09T19:21:04.781 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:21:04.592+0000 1694f700 -1 osd.6 357 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e354) 2019-12-09T19:21:04.860 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:21:04.731+0000 38f95700 -1 osd.6 357 build_incremental_map_msg missing incremental map 355 2019-12-09T19:21:33.749 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:21:33.554+0000 37f93700 -1 osd.0 362 build_incremental_map_msg missing incremental map 361 2019-12-09T19:21:50.491 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:16:11.549 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:21:50.499 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:16:11.557 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:21:50.510 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:16:11.567 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:21:50.513 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:16:11.571 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:21:50.524 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:16:11.558 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:21:50.534 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:16:11.568 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:21:50.586 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:16:11.644 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:21:50.603 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:16:11.661 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:21:50.659 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:16:11.693 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:22:30.430 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:30.425+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:30.968 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:30.963+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:31.391 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:31.386+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:31.920 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:31.915+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:31.936 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:31.932+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:32.055 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:32.049+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:32.426 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:32.421+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:32.899 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:32.894+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:32.971 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:32.963+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:33.029 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:33.022+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:33.178 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:33.173+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:33.414 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:33.404+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:33.623 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:33.619+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:33.886 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:33.879+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:33.999 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:33.993+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:34.022 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:34.018+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:34.060 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:34.055+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:34.164 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:34.160+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:34.390 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:34.386+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:34.590 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:34.585+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:34.915 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:34.910+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:35.000 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:34.995+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:35.028 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:35.024+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:35.058 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:35.052+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:35.170 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:35.164+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:35.388 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:35.382+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:35.553 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:35.548+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:35.967 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:35.963+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:36.012 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:36.009+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:36.029 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:36.023+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:36.053 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:36.049+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:36.132 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:36.128+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:36.441 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:36.434+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:36.574 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:36.569+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:36.976 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:36.971+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:37.041 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:37.036+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:37.059 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:37.055+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:37.086 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:37.079+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:37.096 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:37.092+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:37.418 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:37.412+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:37.555 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:37.550+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:37.972 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:37.968+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:38.030 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:38.025+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:38.035 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:38.031+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:38.105 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:38.095+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:38.141 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:38.137+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:38.392 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:38.386+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:38.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:38.570+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:38.981 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:38.977+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:39.025 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:39.020+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:39.051 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:39.047+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:39.135 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:39.130+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:39.173 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:39.168+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:39.359 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:39.352+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:39.587 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:39.581+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:40.001 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:39.997+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:40.002 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:39.998+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:40.035 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:40.031+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:40.106 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:40.100+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:40.178 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:40.173+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:40.408 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:40.403+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:40.636 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:40.629+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:40.961 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:40.957+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:41.028 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:41.024+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:41.044 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:41.040+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:41.102 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:41.096+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:41.190 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:41.186+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:41.373 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:41.369+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:41.593 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:41.588+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:41.970 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:41.965+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:41.999 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:41.995+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:42.075 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:42.071+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:42.127 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:42.121+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:42.170 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:42.165+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:42.383 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:42.377+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:42.570 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:42.564+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:42.973 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:42.969+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:43.036 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:43.031+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:43.092 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:43.088+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:43.160 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:43.153+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:43.198 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:43.195+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:43.427 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:43.421+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:43.598 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:43.592+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:43.948 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:43.943+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:44.062 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:44.058+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:44.121 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:44.117+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:44.170 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:44.165+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:44.208 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:44.203+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:44.444 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:44.440+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:44.648 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:44.643+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:44.991 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:44.987+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:45.022 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:45.017+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:45.115 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:45.110+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:45.182 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:45.176+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:45.202 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:45.198+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:45.498 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:45.492+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:45.605 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:45.600+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:45.992 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:45.987+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:46.017 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:46.012+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:46.102 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:46.096+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:46.169 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:46.165+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:46.198 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:46.193+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:46.490 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:46.485+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:46.633 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:46.627+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:46.977 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:46.973+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:46.978 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:46.974+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:47.145 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:47.140+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:47.189 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:47.175+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:47.232 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:47.227+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:47.511 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:47.501+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:47.665 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:47.660+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:47.967 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:47.962+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:48.006 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:48.002+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:48.180 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:48.176+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:48.193 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:48.189+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:48.212 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:48.206+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:48.560 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:48.554+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:48.662 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:48.656+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:48.994 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:48.990+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:49.024 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:49.020+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:49.150 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:49.146+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:49.162 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:49.158+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:49.211 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:49.206+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:49.553 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:49.548+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:49.715 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:49.710+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:49.966 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:49.961+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:49.990 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:49.985+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:50.134 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:50.130+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:50.135 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:50.131+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:50.234 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:50.228+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:50.542 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:50.536+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:50.741 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:50.736+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:50.932 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:50.928+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:50.968 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:50.964+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:51.094 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:51.090+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:51.161 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:51.156+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:51.195 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:51.190+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:51.595 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:51.590+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:51.759 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:51.754+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:51.966 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:51.962+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:51.986 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:51.982+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:52.066 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:52.062+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:52.143 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:52.139+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:52.222 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:52.218+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:52.643 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:52.639+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:52.772 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:52.766+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:52.982 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:52.977+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:52.990 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:52.986+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:53.110 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:53.106+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:53.175 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:53.170+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:53.276 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:53.270+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:53.603 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:53.598+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:53.747 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:53.741+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:54.000 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:53.995+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:54.022 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:54.018+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:54.070 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:54.066+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:54.176 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:54.171+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:54.241 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:54.236+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:54.572 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:54.566+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:54.737 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:54.731+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:54.994 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:54.990+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:55.012 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:55.009+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:55.068 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:55.063+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:55.186 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:55.181+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:55.227 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:55.222+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:55.554 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:55.549+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:55.747 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:55.741+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:56.027 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:56.022+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:56.038 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:56.034+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:56.050 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:56.046+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:56.222 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:56.217+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:56.276 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:56.271+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:56.536 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:56.531+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:56.703 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:56.697+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:57.034 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:57.029+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:57.043 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:57.039+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:57.069 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:57.064+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:57.237 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:57.234+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:57.249 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:57.244+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:57.535 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:57.530+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:57.738 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:57.733+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:58.009 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:58.005+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:58.024 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:58.017+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:58.024 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:58.019+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:58.247 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:58.242+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:58.285 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:58.281+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:58.550 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:58.545+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:58.765 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:58.760+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:59.005 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:59.000+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:22:59.027 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:22:59.022+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:22:59.042 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:22:59.038+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:22:59.264 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:22:59.258+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:22:59.286 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:22:59.281+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:22:59.585 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:22:59.579+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:22:59.818 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:22:59.812+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:22:59.991 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:22:59.986+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:23:00.046 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:23:00.042+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:23:00.084 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:23:00.079+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:23:00.253 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:23:00.249+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:23:00.312 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:23:00.307+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:23:00.561 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:23:00.555+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:23:00.809 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:23:00.805+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:23:00.962 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:23:00.958+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:23:01.059 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:23:01.055+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:23:01.070 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:23:01.065+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:23:01.277 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:23:01.272+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:23:01.357 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:23:01.352+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:23:01.604 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:23:01.599+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:23:01.817 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:23:01.811+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:23:01.931 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:23:01.926+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:23:02.061 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:23:02.056+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:23:02.071 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:23:02.068+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:23:02.257 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:23:02.253+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:23:02.391 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:23:02.386+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:23:02.602 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:23:02.597+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:23:02.771 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:23:02.766+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:23:02.962 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:23:02.958+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:23:03.014 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:23:03.010+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:23:03.116 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:23:03.111+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:23:03.267 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:23:03.263+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:23:03.378 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:23:03.374+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:23:03.587 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:23:03.581+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:23:03.763 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:23:03.758+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:23:03.918 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:23:03.913+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:23:04.039 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:23:04.035+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:23:04.103 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:23:04.099+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:23:04.287 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:23:04.282+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:23:04.393 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:23:04.389+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:23:04.517 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:23:04.512+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e362 v362) 2019-12-09T19:23:04.541 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:23:04.536+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:23:04.805 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:23:04.798+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:23:04.909 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:23:04.901+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:23:05.040 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:23:05.036+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:23:05.154 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:23:05.150+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:23:05.303 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:23:05.298+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:23:05.400 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:23:05.395+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:23:05.558 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:23:05.552+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:23:05.783 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:23:05.779+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:23:05.927 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:23:05.921+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:23:05.994 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:23:05.990+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:23:06.110 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:23:06.105+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:23:06.267 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:23:06.263+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:23:06.437 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:23:06.432+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:23:06.575 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:23:06.569+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:23:06.813 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:23:06.807+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:23:06.931 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:23:06.926+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:23:07.023 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:23:07.019+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:23:07.068 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:23:07.063+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:23:07.259 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:23:07.255+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:23:07.392 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:23:07.386+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:23:07.555 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:23:07.550+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:23:07.770 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:23:07.765+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:23:07.976 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:23:07.971+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:23:08.066 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:23:08.061+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:23:08.070 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:23:08.065+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:23:08.217 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:23:08.212+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:23:08.414 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:23:08.410+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:23:08.565 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:23:08.560+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:23:08.812 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:23:08.806+0000 1694f700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.221619+0000 front 2019-12-09T19:21:48.078094+0000 (oldest deadline 2019-12-09T19:22:33.046164+0000) 2019-12-09T19:23:09.028 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:23:09.023+0000 1694f700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.886800+0000 front 2019-12-09T19:21:47.888529+0000 (oldest deadline 2019-12-09T19:22:30.878916+0000) 2019-12-09T19:23:09.072 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:23:09.066+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.531618+0000 front 2019-12-09T19:21:49.096568+0000 (oldest deadline 2019-12-09T19:22:33.129015+0000) 2019-12-09T19:23:09.076 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:23:09.070+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:48.080021+0000 front 2019-12-09T19:21:48.225257+0000 (oldest deadline 2019-12-09T19:22:33.066446+0000) 2019-12-09T19:23:09.233 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:23:09.228+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:45.751127+0000 front 2019-12-09T19:21:45.752030+0000 (oldest deadline 2019-12-09T19:22:30.317808+0000) 2019-12-09T19:23:09.457 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:23:09.452+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:49.602262+0000 front 2019-12-09T19:21:49.049007+0000 (oldest deadline 2019-12-09T19:22:31.899823+0000) 2019-12-09T19:23:09.589 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:23:09.583+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:21:47.583600+0000 front 2019-12-09T19:21:50.092776+0000 (oldest deadline 2019-12-09T19:22:29.999970+0000) 2019-12-09T19:23:09.592 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:23:09.588+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e362 v362) 2019-12-09T19:24:07.781 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:07.776+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:08.365 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:08.361+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:08.369 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:08.362+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:08.749 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:08.743+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:09.329 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:09.324+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:09.381 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:09.372+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:09.422 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:09.416+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:09.765 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:09.761+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:10.298 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:10.293+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:10.383 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:10.376+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:10.445 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:10.439+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:10.797 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:10.791+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:11.315 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:11.310+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:11.332 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:11.328+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:11.364 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:11.357+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:11.471 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:11.463+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:11.515 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:11.510+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:11.826 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:11.819+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:12.310 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:12.304+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:12.325 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:12.320+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:12.413 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:12.406+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:12.487 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:12.478+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:12.519 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:12.514+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:12.859 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:12.854+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:13.289 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:13.284+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:13.319 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:13.312+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:13.456 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:13.451+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:13.462 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:13.448+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:13.548 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:13.543+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:13.856 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:13.852+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:14.313 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:14.307+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:14.365 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:14.359+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:14.455 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:14.449+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:14.497 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:14.489+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:14.522 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:14.516+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:14.834 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:14.829+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:15.329 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:15.322+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:15.391 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:15.385+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:15.478 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:15.471+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:15.495 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:15.489+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:15.563 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:15.558+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:15.826 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:15.821+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:16.318 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:16.313+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:16.384 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:16.378+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:16.433 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:16.427+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:16.522 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:16.516+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:16.544 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:16.539+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:16.854 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:16.848+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:17.366 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:17.361+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:17.372 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:17.366+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:17.481 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:17.474+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:17.515 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:17.510+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:17.531 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:17.525+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:17.819 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:17.814+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:18.349 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:18.343+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:18.369 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:18.364+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:18.511 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:18.503+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:18.563 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:18.554+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:18.565 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:18.558+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:18.567 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:18.560+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:18.825 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:18.820+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:19.328 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:19.323+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:19.413 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:19.408+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:19.545 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:19.537+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:19.546 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:19.541+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:19.561 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:19.553+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:19.605 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:19.598+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:19.782 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:19.776+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:20.321 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:20.316+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:20.379 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:20.374+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:20.578 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:20.572+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:20.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:20.582+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:20.592 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:20.585+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:20.593 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:20.588+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:20.829 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:20.823+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:21.348 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:21.342+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:21.407 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:21.401+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:21.567 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:21.560+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:21.587 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:21.581+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:21.641 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:21.635+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:21.646 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:21.640+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:21.832 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:21.827+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:22.347 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:22.339+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:22.380 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:22.374+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:22.607 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:22.600+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:22.621 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:22.610+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:22.655 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:22.648+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:22.656 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:22.651+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:22.818 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:22.810+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:23.300 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:23.294+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:23.368 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:23.359+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:23.655 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:23.648+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:23.658 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:23.650+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:23.660 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:23.654+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:23.664 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:23.660+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:23.807 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:23.801+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:24.297 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:24.292+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:24.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:24.345+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:24.620 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:24.614+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:24.622 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:24.615+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:24.624 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:24.618+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:24.626 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:24.619+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:24.780 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:24.774+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:25.307 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:25.300+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:25.330 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:25.324+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:25.579 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:25.572+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:25.601 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:25.594+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:25.602 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:25.597+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:25.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:25.622+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:25.786 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:25.781+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:26.302 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:26.295+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:26.326 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:26.321+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:26.590 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:26.583+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:26.593 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:26.589+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:26.609 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:26.600+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:26.653 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:26.645+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:26.744 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:26.739+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:27.294 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:27.288+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:27.295 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:27.291+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:27.586 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:27.580+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:27.639 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:27.633+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:27.643 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:27.637+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:27.646 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:27.640+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:27.756 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:27.750+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:28.330 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:28.325+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:28.342 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:28.337+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:28.549 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:28.541+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:28.608 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:28.600+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:28.609 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:28.604+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:28.672 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:28.665+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:28.808 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:28.802+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:29.312 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:29.307+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:29.383 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:29.378+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:29.571 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:29.565+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:29.645 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:29.638+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:29.650 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:29.644+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:29.651 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:29.647+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:29.836 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:29.832+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:30.358 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:30.351+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:30.364 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:30.359+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:30.600 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:30.594+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:30.667 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:30.659+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:30.683 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:30.676+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:30.684 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:30.679+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:30.814 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:30.808+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:31.335 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:31.330+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:31.348 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:31.343+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:31.577 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:31.571+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:31.636 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:31.629+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:31.685 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:31.672+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:31.685 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:31.679+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:31.770 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:31.764+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:32.303 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:32.297+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:32.367 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:32.363+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:32.567 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:32.560+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:32.637 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:32.631+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:32.644 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:32.639+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:32.661 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:32.655+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:32.780 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:32.773+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:33.303 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:33.298+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:33.377 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:33.371+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:33.544 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:33.537+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:33.634 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:33.627+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:33.636 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:33.630+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:33.667 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:33.660+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:33.832 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:33.826+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:34.333 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:34.327+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:34.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:34.345+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:34.556 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:34.550+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:34.625 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:34.618+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:34.660 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:34.654+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:34.663 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:34.659+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:34.824 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:34.818+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:35.306 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:35.301+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:35.377 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:35.372+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:35.516 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:35.509+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:35.586 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:35.579+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:35.618 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:35.611+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:35.620 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:35.615+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:35.841 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:35.836+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:36.288 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:36.283+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:36.358 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:36.353+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:36.506 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:36.499+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:36.599 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:36.582+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:36.637 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:36.629+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:36.640 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:36.633+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:36.880 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:36.875+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:37.309 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:37.304+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:37.373 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:37.368+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:37.466 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:37.460+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:37.602 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:37.595+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:37.619 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:37.613+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:37.624 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:37.619+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:37.932 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:37.928+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:38.329 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:38.325+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:38.365 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:38.362+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:38.420 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:38.414+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:38.600 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:38.594+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:38.625 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:38.618+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:38.626 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:38.621+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:38.930 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:38.925+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:39.361 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:39.356+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:39.388 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:39.384+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:39.409 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:39.402+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:39.612 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:39.605+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:39.674 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:39.668+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:39.678 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:39.673+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:39.816 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:24:39.807+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e369 v369) 2019-12-09T19:24:39.916 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:39.912+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:40.332 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:40.328+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:40.375 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:40.370+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:40.404 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:40.397+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:40.635 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:40.629+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:40.675 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:40.668+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:40.676 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:40.671+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:40.908 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:40.903+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:41.313 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:41.309+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:41.386 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:41.380+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:41.423 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:41.416+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:41.676 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:41.670+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:41.692 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:41.685+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:41.693 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:41.688+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:41.895 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:41.891+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:42.223 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:24:42.217+0000 1694f700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.163305+0000 front 2019-12-09T19:23:24.444874+0000 (oldest deadline 2019-12-09T19:24:41.987538+0000) 2019-12-09T19:24:42.340 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:42.335+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:42.366 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:42.362+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:42.433 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:42.427+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:42.651 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:42.645+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:42.661 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:42.654+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:42.662 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:42.656+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:42.924 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:42.918+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:43.220 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:24:43.213+0000 1694f700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.163305+0000 front 2019-12-09T19:23:24.444874+0000 (oldest deadline 2019-12-09T19:24:41.987538+0000) 2019-12-09T19:24:43.334 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:43.329+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:43.418 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:43.413+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:43.452 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:43.444+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:43.640 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:43.632+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:43.641 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:43.635+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:43.693 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:43.686+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:43.911 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:43.907+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:44.194 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:24:44.188+0000 1694f700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.163305+0000 front 2019-12-09T19:23:24.444874+0000 (oldest deadline 2019-12-09T19:24:41.987538+0000) 2019-12-09T19:24:44.369 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:44.363+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:44.417 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:44.413+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:44.494 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:44.488+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:44.664 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:44.658+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:44.675 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:44.668+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:44.676 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:44.671+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:44.837 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:24:44.832+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e369 v369) 2019-12-09T19:24:44.930 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:44.926+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:45.195 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:24:45.188+0000 1694f700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.163305+0000 front 2019-12-09T19:23:24.444874+0000 (oldest deadline 2019-12-09T19:24:41.987538+0000) 2019-12-09T19:24:45.359 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:45.355+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:45.422 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:45.418+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:45.529 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:45.525+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:45.638 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:45.632+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:45.650 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:45.644+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:45.654 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:45.649+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:45.925 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:45.921+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:46.186 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:24:46.180+0000 1694f700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.163305+0000 front 2019-12-09T19:23:24.444874+0000 (oldest deadline 2019-12-09T19:24:41.987538+0000) 2019-12-09T19:24:46.329 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:46.323+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:46.472 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:46.466+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:46.513 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:46.505+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:46.662 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:46.654+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:46.666 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:46.658+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:46.674 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:46.666+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:46.958 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:46.954+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:47.164 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:24:47.157+0000 1694f700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.163305+0000 front 2019-12-09T19:23:24.444874+0000 (oldest deadline 2019-12-09T19:24:41.987538+0000) 2019-12-09T19:24:47.293 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:47.289+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:47.443 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:47.440+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:47.576 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:47.569+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:47.620 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:47.614+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:47.624 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:47.620+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:47.724 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:47.718+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:48.001 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:47.996+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:48.147 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:24:48.141+0000 1694f700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.163305+0000 front 2019-12-09T19:23:24.444874+0000 (oldest deadline 2019-12-09T19:24:41.987538+0000) 2019-12-09T19:24:48.298 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:48.292+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:48.493 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:48.487+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:48.619 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:48.613+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:48.662 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:48.656+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:48.663 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:48.659+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:48.699 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:48.692+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:48.981 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:24:48.976+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:23.483844+0000 front 2019-12-09T19:23:23.610039+0000 (oldest deadline 2019-12-09T19:24:07.697110+0000) 2019-12-09T19:24:49.189 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:24:49.183+0000 1694f700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.163305+0000 front 2019-12-09T19:23:24.444874+0000 (oldest deadline 2019-12-09T19:24:41.987538+0000) 2019-12-09T19:24:49.338 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:24:49.333+0000 1694f700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.352215+0000 front 2019-12-09T19:23:25.385290+0000 (oldest deadline 2019-12-09T19:24:11.115567+0000) 2019-12-09T19:24:49.459 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:24:49.455+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.570253+0000 front 2019-12-09T19:23:25.545542+0000 (oldest deadline 2019-12-09T19:24:08.294385+0000) 2019-12-09T19:24:49.630 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:24:49.624+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:25.473090+0000 front 2019-12-09T19:23:25.475112+0000 (oldest deadline 2019-12-09T19:24:07.485724+0000) 2019-12-09T19:24:49.661 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:49.655+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:23:37.572159+0000 (oldest deadline 2019-12-09T19:24:17.572159+0000) 2019-12-09T19:24:49.664 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:24:49.660+0000 1694f700 -1 osd.6 369 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e367) 2019-12-09T19:24:49.749 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:24:49.742+0000 1694f700 -1 osd.5 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.041444+0000 front 2019-12-09T19:23:24.418910+0000 (oldest deadline 2019-12-09T19:24:09.250467+0000) 2019-12-09T19:24:49.894 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:24:49.889+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e369 v369) 2019-12-09T19:24:50.162 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:24:50.157+0000 1694f700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:23:24.163305+0000 front 2019-12-09T19:23:24.444874+0000 (oldest deadline 2019-12-09T19:24:41.987538+0000) 2019-12-09T19:25:26.465 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:25:26.383+0000 35f8f700 -1 osd.6 373 build_incremental_map_msg missing incremental map 373 2019-12-09T19:25:26.598 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:25:26.444+0000 31786700 -1 osd.6 373 build_incremental_map_msg missing incremental map 373 2019-12-09T19:25:26.653 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:25:26.460+0000 32f89700 -1 osd.6 373 build_incremental_map_msg missing incremental map 373 2019-12-09T19:25:26.685 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:25:26.541+0000 35f8f700 -1 osd.6 373 build_incremental_map_msg missing incremental map 373 2019-12-09T19:25:26.712 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:25:26.564+0000 37f93700 -1 osd.6 373 build_incremental_map_msg missing incremental map 373 2019-12-09T19:25:26.755 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:25:26.743+0000 3578e700 -1 osd.4 373 build_incremental_map_msg missing incremental map 373 2019-12-09T19:25:26.808 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:25:26.797+0000 34f8d700 -1 osd.4 373 build_incremental_map_msg missing incremental map 373 2019-12-09T19:25:26.970 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:25:26.945+0000 36790700 -1 osd.4 373 build_incremental_map_msg missing incremental map 373 2019-12-09T19:25:27.211 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:25:27.135+0000 3478c700 -1 osd.4 373 build_incremental_map_msg missing incremental map 373 2019-12-09T19:25:27.278 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:25:27.184+0000 3378a700 -1 osd.4 373 build_incremental_map_msg missing incremental map 373 2019-12-09T19:25:28.308 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:25:28.275+0000 3578e700 -1 osd.0 374 build_incremental_map_msg missing incremental map 374 2019-12-09T19:25:28.399 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:25:28.337+0000 32f89700 -1 osd.0 374 build_incremental_map_msg missing incremental map 374 2019-12-09T19:25:28.614 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:25:28.609+0000 33f8b700 -1 osd.0 374 build_incremental_map_msg missing incremental map 374 2019-12-09T19:25:47.563 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:20:08.621 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:47.571 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:20:08.629 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:47.578 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:20:08.636 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:47.585 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:20:08.640 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:47.591 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:20:08.620 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:47.593 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:20:08.627 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:47.803 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:20:08.857 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:47.811 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:20:08.869 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:47.886 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:20:08.920 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:26:28.242 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:28.236+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:29.145 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:29.137+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:29.227 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:29.222+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:30.081 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:26:30.076+0000 1694f700 -1 osd.0 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.406013+0000 front 2019-12-09T19:25:45.680834+0000 (oldest deadline 2019-12-09T19:26:29.102015+0000) 2019-12-09T19:26:30.105 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:30.099+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:30.181 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:30.176+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:30.265 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:30.258+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:30.334 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:30.329+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:31.043 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:26:31.035+0000 1694f700 -1 osd.0 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.406013+0000 front 2019-12-09T19:25:45.680834+0000 (oldest deadline 2019-12-09T19:26:29.102015+0000) 2019-12-09T19:26:31.154 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:31.149+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:31.224 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:31.220+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:31.234 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:31.224+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:31.305 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:31.300+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:31.927 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:31.923+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:32.017 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:26:32.013+0000 1694f700 -1 osd.0 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.406013+0000 front 2019-12-09T19:25:45.680834+0000 (oldest deadline 2019-12-09T19:26:29.102015+0000) 2019-12-09T19:26:32.122 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:32.116+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:32.223 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:32.218+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:32.269 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:32.264+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:32.271 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:32.267+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:32.940 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:32.934+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:33.003 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:26:32.998+0000 1694f700 -1 osd.0 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.406013+0000 front 2019-12-09T19:25:45.680834+0000 (oldest deadline 2019-12-09T19:26:29.102015+0000) 2019-12-09T19:26:33.155 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:33.151+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:33.215 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:33.209+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:33.268 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:33.263+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:33.294 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:33.289+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:33.960 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:26:33.953+0000 1694f700 -1 osd.0 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.406013+0000 front 2019-12-09T19:25:45.680834+0000 (oldest deadline 2019-12-09T19:26:29.102015+0000) 2019-12-09T19:26:33.973 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:33.967+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:34.068 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:34.064+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:34.163 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:34.158+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:34.198 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:34.193+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:34.250 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:34.244+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:34.294 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:34.289+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:34.948 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:26:34.942+0000 1694f700 -1 osd.0 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.406013+0000 front 2019-12-09T19:25:45.680834+0000 (oldest deadline 2019-12-09T19:26:29.102015+0000) 2019-12-09T19:26:34.957 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:34.951+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:35.105 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:35.099+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:35.156 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:35.152+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:35.205 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:35.201+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:35.219 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:35.214+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:35.313 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:35.302+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:35.920 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:26:35.914+0000 1694f700 -1 osd.0 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.406013+0000 front 2019-12-09T19:25:45.680834+0000 (oldest deadline 2019-12-09T19:26:29.102015+0000) 2019-12-09T19:26:35.990 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:35.980+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:36.077 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:36.071+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:36.115 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:36.109+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:36.213 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:36.207+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:36.260 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:36.254+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:36.322 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:36.318+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:36.970 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:36.965+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:37.074 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:37.069+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:37.122 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:37.116+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:37.203 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:37.198+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:37.302 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:37.297+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:37.318 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:37.314+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:37.967 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:37.962+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:38.102 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:38.096+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:38.153 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:38.148+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:38.224 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:38.219+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:38.284 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:38.278+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:38.334 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:38.329+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:38.953 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:38.947+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:39.067 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:39.061+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:39.191 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:39.185+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:39.227 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:39.221+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:39.275 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:39.264+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:39.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:39.330+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:39.944 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:39.936+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:40.055 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:40.049+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:40.211 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:40.205+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:40.231 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:40.225+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:40.259 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:40.254+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:40.341 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:40.336+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:40.972 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:40.967+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:41.051 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:41.045+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:41.173 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:41.164+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:41.223 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:41.217+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:41.282 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:41.276+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:41.391 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:41.386+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:41.967 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:41.960+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:42.020 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:42.015+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:42.209 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:42.204+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:42.234 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:42.229+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:42.264 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:42.259+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:42.378 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:42.372+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:42.965 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:42.959+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:43.049 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:43.044+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:43.200 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:43.195+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:43.215 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:43.210+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:43.316 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:43.301+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:43.430 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:43.424+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:43.948 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:43.942+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:44.088 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:44.084+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:44.190 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:44.186+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:44.195 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:44.189+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:44.353 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:44.348+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:44.467 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:44.456+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:44.906 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:44.900+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:45.114 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:45.109+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:45.148 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:45.144+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:45.188 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:45.184+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:45.330 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:45.324+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:45.436 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:45.431+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:45.913 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:45.908+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:46.095 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:46.091+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:46.145 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:46.141+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:46.186 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:46.181+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:46.328 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:46.322+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:46.471 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:46.465+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:46.872 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:46.867+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:47.122 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:47.115+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:47.130 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:47.126+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:47.171 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:47.167+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:47.376 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:47.370+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:47.502 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:47.498+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:47.850 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:47.845+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:48.103 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:48.098+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:48.143 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:48.138+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:48.177 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:48.173+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:48.344 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:48.338+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:48.534 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:48.530+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:48.867 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:48.860+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:49.071 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:49.064+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:49.134 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:49.130+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:49.175 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:49.171+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:49.385 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:49.379+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:49.538 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:49.533+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:49.886 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:49.880+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:50.110 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:50.105+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:50.146 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:50.141+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:50.186 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:50.182+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:50.411 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:50.407+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:50.583 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:50.577+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:50.840 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:50.835+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:51.095 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:51.090+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:51.122 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:51.117+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:51.235 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:51.230+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:51.373 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:51.368+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:51.592 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:51.586+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:51.869 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:51.865+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:52.078 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:52.074+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:52.139 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:52.133+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:52.208 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:52.204+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:52.388 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:52.384+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:52.546 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:52.540+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:52.891 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:52.886+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:53.048 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:53.043+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:53.153 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:53.149+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:53.242 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:53.237+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:53.418 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:53.414+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:53.573 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:53.568+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:53.916 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:53.911+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:54.040 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:54.036+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:54.110 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:54.106+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:54.240 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:54.236+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:54.441 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:54.437+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:54.533 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:54.527+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:54.945 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:26:54.939+0000 1694f700 -1 osd.5 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.206446+0000 front 2019-12-09T19:25:46.249283+0000 (oldest deadline 2019-12-09T19:26:31.789100+0000) 2019-12-09T19:26:55.032 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:55.028+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:55.120 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:55.115+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:55.213 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:55.209+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:55.424 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:55.419+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:55.527 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:55.523+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:55.998 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:55.993+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:56.114 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:56.110+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:56.207 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:56.200+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:56.389 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:56.384+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:56.561 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:56.555+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:57.053 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:57.048+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:57.133 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:57.129+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:57.258 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:57.253+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:57.410 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:57.405+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:57.546 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:57.542+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:58.008 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:58.003+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:58.112 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:58.108+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:58.296 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:58.291+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:58.426 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:58.421+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:58.529 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:58.525+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:26:59.014 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:26:59.009+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:26:59.085 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:26:59.081+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:26:59.327 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:26:59.323+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:26:59.471 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:26:59.465+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:26:59.579 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:26:59.575+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:27:00.039 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:27:00.035+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:27:00.070 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:27:00.065+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:27:00.300 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:27:00.296+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:27:00.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:27:00.513+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:27:00.540 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:27:00.535+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:27:01.086 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:27:01.078+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:27:01.096 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:27:01.088+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:27:01.270 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:27:01.265+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:27:01.541 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:27:01.537+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:27:01.566 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:27:01.562+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:27:02.107 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:27:02.103+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:27:02.127 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:27:02.123+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:27:02.297 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:27:02.292+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:27:02.536 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:27:02.531+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:27:02.560 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:27:02.555+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:27:03.125 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:27:03.120+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:27:03.148 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:27:03.144+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:27:03.281 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:27:03.278+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:27:03.522 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:27:03.518+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:27:03.556 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:27:03.550+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:27:04.104 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:27:04.099+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:27:04.172 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:27:04.163+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:27:04.259 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:27:04.255+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:27:04.536 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:27:04.528+0000 1694f700 -1 osd.4 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:43.758832+0000 front 2019-12-09T19:25:43.759781+0000 (oldest deadline 2019-12-09T19:26:27.627729+0000) 2019-12-09T19:27:04.549 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:27:04.543+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:27:05.132 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:27:05.127+0000 1694f700 -1 osd.2 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:47.540511+0000 front 2019-12-09T19:25:47.596944+0000 (oldest deadline 2019-12-09T19:26:33.398859+0000) 2019-12-09T19:27:05.154 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:27:05.150+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.202420+0000 front 2019-12-09T19:25:45.942411+0000 (oldest deadline 2019-12-09T19:26:29.870413+0000) 2019-12-09T19:27:05.236 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:27:05.232+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:46.252157+0000 front 2019-12-09T19:25:46.251573+0000 (oldest deadline 2019-12-09T19:26:29.707744+0000) 2019-12-09T19:27:05.336 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:27:05.330+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 46sec e374 v374) 2019-12-09T19:27:05.526 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:27:05.521+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:25:45.942221+0000 front 2019-12-09T19:25:45.898699+0000 (oldest deadline 2019-12-09T19:26:28.278386+0000) 2019-12-09T19:27:44.944 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:27:44.916+0000 35f8f700 -1 osd.6 379 build_incremental_map_msg missing incremental map 379 2019-12-09T19:27:44.986 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:27:44.982+0000 37792700 -1 osd.6 379 build_incremental_map_msg missing incremental map 379 2019-12-09T19:27:45.122 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:27:45.101+0000 38794700 -1 osd.6 379 build_incremental_map_msg missing incremental map 379 2019-12-09T19:27:45.436 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:27:45.401+0000 35f8f700 -1 osd.6 379 build_incremental_map_msg missing incremental map 379 2019-12-09T19:28:03.532 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:03.528+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:03.688 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:03.682+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:04.174 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:04.168+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:04.493 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:04.489+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:04.710 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:04.704+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:05.132 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:05.124+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:05.501 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:05.497+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:05.592 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:05.588+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:05.694 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:05.688+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:05.848 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:05.836+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:06.121 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:06.114+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:06.537 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:06.533+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:06.612 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:06.607+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:06.729 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:06.722+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:06.792 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:06.785+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:06.802 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:06.798+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:07.124 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:07.117+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:07.586 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:07.577+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:07.622 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:07.617+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:07.694 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:07.687+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:07.840 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:07.835+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:07.852 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:07.848+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:08.121 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:08.114+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:08.608 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:08.604+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:08.609 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:08.604+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:08.689 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:08.683+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:08.854 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:08.850+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:08.894 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:08.888+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:09.127 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:09.121+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:09.605 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:09.601+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:09.605 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:09.600+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:09.707 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:09.700+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:09.836 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:09.831+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:09.900 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:09.892+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:10.155 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:10.150+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:10.571 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:10.565+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:10.580 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:10.572+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:10.753 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:10.746+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:10.867 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:10.863+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:10.942 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:10.936+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:11.195 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:11.189+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:11.542 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:11.536+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:11.610 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:11.605+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:11.791 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:11.784+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:11.890 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:11.885+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:11.965 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:11.959+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:12.150 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:12.144+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:12.520 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:12.516+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:12.594 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:12.589+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:12.782 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:12.776+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:12.883 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:12.877+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:12.960 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:12.953+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:13.177 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:13.171+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:13.519 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:13.515+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:13.634 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:13.629+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:13.786 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:13.780+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:13.855 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:13.850+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:13.929 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:13.922+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:14.208 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:14.201+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:14.334 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:14.328+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:14.565 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:14.560+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:14.665 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:14.661+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:14.761 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:14.755+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:14.822 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:14.818+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:14.928 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:14.918+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:15.180 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:15.174+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:15.305 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:15.299+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:15.537 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:15.531+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:15.640 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:15.636+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:15.743 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:15.738+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:15.810 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:15.804+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:15.911 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:15.906+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:16.206 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:16.199+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:16.307 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:16.298+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:16.532 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:16.528+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:16.607 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:16.603+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:16.715 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:16.709+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:16.792 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:16.787+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:16.904 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:16.899+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:17.169 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:17.163+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:17.351 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:17.347+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:17.563 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:17.558+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:17.606 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:17.602+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:17.723 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:17.716+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:17.817 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:17.811+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:17.889 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:17.882+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:18.176 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:18.169+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:18.339 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:18.334+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:18.609 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:18.605+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:18.641 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:18.636+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:18.738 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:18.727+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:18.811 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:18.803+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:18.858 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:18.851+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:19.209 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:19.200+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:19.392 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:19.385+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:19.637 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:19.631+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:19.652 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:19.646+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:19.755 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:19.749+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:19.766 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:19.761+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:19.900 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:19.894+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:20.240 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:20.234+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:20.403 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:20.398+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:20.678 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:20.675+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:20.681 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:20.677+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:20.798 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:20.794+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:20.807 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:20.801+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:20.888 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:20.881+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:21.291 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:21.286+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:21.389 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:21.378+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:21.391 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:21.381+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:21.650 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:21.645+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:21.705 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:21.702+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:21.769 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:21.763+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:21.778 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:21.774+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:21.874 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:21.868+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:22.277 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:22.271+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:22.416 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:22.411+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:22.421 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:22.416+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:22.645 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:22.641+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:22.712 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:22.707+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:22.786 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:22.782+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:22.818 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:22.812+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:22.849 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:22.843+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:23.265 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:23.250+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:23.382 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:23.376+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:23.386 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:23.381+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:23.628 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:23.624+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:23.755 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:23.749+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:23.776 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:23.771+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:23.804 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:23.798+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:23.856 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:23.849+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:24.260 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:24.254+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:24.416 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:24.408+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:24.418 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:24.414+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:24.633 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:24.629+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:24.800 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:24.793+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:24.802 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:24.798+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:24.817 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:24.810+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:24.841 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:24.835+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:25.289 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:25.283+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:25.472 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:25.464+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:25.473 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:25.468+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:25.600 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:25.595+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:25.807 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:25.803+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:25.816 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:25.812+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:25.851 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:25.845+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:25.896 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:25.890+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:26.305 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:26.298+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:26.508 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:26.502+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:26.513 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:26.509+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:26.633 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:26.627+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:26.770 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:26.765+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:26.842 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:26.836+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:26.873 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:26.866+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:26.937 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:26.931+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:27.347 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:27.340+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:27.545 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:27.539+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:27.549 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:27.544+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:27.621 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:27.618+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:27.747 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:27.741+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:27.802 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:27.797+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:27.903 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:27.896+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:27.959 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:27.952+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:28.332 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:28.324+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:28.590 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:28.583+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:28.592 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:28.586+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:28.600 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:28.596+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:28.759 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:28.753+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:28.807 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:28.801+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:28.928 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:28.920+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:28.930 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:28.919+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:29.289 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:29.282+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:29.566 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:29.559+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:29.567 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:29.563+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:29.631 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:29.625+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:29.796 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:29.791+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:29.813 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:29.805+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:29.914 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:29.907+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:29.930 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:29.923+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:30.268 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:30.261+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:30.600 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:30.595+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:30.613 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:30.605+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:30.613 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:30.608+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:30.778 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:30.771+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:30.799 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:30.793+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:30.904 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:30.898+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:30.945 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:30.938+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:31.314 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:31.308+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:31.652 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:31.647+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:31.660 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:31.653+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:31.661 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:31.656+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:31.756 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:31.751+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:31.847 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:31.842+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:31.951 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:31.945+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:31.961 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:31.954+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:32.331 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:32.324+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:32.637 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:32.630+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:32.663 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:32.655+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:32.665 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:32.658+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:32.759 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:32.752+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:32.856 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:32.840+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:32.910 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:32.905+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:32.977 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:32.972+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:33.394 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:33.387+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:33.621 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:33.608+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:33.674 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:33.668+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:33.684 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:33.673+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:33.791 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:33.785+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:33.854 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:33.850+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:33.871 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:33.863+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:34.000 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:33.993+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:34.446 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:34.439+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:34.664 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:34.659+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:34.696 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:34.688+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:34.697 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:34.692+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:34.827 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:34.818+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:34.833 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:34.825+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:34.893 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:34.887+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:35.025 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:35.020+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:35.499 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:35.493+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:35.678 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:35.673+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:35.732 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:35.724+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:35.732 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:35.728+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:35.763 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:28:35.756+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e380 v380) 2019-12-09T19:28:35.823 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:35.816+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:35.842 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:35.837+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:35.849 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:35.843+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:36.032 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:36.025+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:36.479 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:36.473+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:36.654 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:36.649+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:36.733 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:36.727+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:36.735 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:36.730+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:36.835 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:36.828+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:36.846 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:36.840+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:36.878 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:36.872+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:37.085 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:37.079+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:37.532 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:37.523+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:37.666 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:37.657+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:37.782 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:37.774+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:37.783 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:37.778+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:37.833 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:37.828+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:37.854 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:37.849+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:37.877 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:37.871+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:38.135 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:38.129+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:38.512 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:38.506+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:38.654 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:38.648+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:38.793 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:38.787+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:38.796 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:38.792+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:38.827 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:38.822+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:38.857 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:38.850+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:38.861 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:38.855+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:39.153 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:39.147+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:39.533 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:39.527+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:39.629 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:39.624+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:39.835 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:39.829+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:39.836 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:39.831+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:39.846 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:39.837+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:39.852 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:39.847+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:39.855 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:39.850+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:40.203 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:40.197+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:40.555 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:40.550+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:40.625 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:40.618+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:40.772 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:28:40.768+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e380 v380) 2019-12-09T19:28:40.828 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:40.821+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:40.845 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:40.839+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:40.848 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:40.844+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:40.860 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:40.854+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:40.890 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:40.884+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:41.203 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:41.196+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:41.607 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:41.601+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:41.666 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:41.660+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:41.816 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:41.806+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:41.817 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:41.810+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:41.832 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:41.825+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:41.860 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:41.849+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:41.941 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:41.935+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:42.244 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:42.237+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:42.603 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:42.596+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:42.717 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:42.711+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:42.834 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:42.827+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:42.835 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:42.830+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:42.853 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:42.847+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:42.894 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:42.877+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:42.929 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:42.923+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:43.236 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:43.229+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:43.578 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:43.561+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:43.699 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:43.694+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:43.870 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:43.863+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:43.884 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:43.878+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:43.885 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:43.881+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:43.904 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:43.899+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:43.965 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:43.959+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:44.291 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:44.280+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:44.605 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:44.599+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:44.749 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:44.742+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:44.848 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:44.842+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:44.863 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:44.855+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:44.869 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:44.859+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:44.882 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:44.875+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:44.983 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:44.977+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:45.312 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:45.305+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:45.589 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:45.584+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:45.782 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:28:45.777+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e380 v380) 2019-12-09T19:28:45.792 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:45.787+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:45.870 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:45.864+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:45.873 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:45.869+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:45.905 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:45.898+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:45.924 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:45.918+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:46.014 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:46.008+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:46.336 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:46.328+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:46.585 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:46.578+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:46.832 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:46.825+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:46.833 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:46.828+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:46.834 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:46.828+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:46.879 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:46.873+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:46.879 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:46.873+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:47.010 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:47.003+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:47.342 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:47.335+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:47.572 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:47.565+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:47.796 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:47.790+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:47.799 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:47.795+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:47.813 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:47.807+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:47.891 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:47.886+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:47.921 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:47.915+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:48.002 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:47.996+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:48.354 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:48.348+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:48.588 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:48.581+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:48.796 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:48.791+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:48.797 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:48.793+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:48.840 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:48.833+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:48.861 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:48.857+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:48.893 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:48.888+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:49.053 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:49.047+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:49.387 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:49.380+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:49.560 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:49.552+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:49.811 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:49.805+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:49.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:49.842+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:49.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:49.848+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:49.858 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:49.852+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:49.884 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:49.878+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:50.013 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:50.007+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:50.386 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:50.381+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:50.525 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:50.516+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:50.800 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:28:50.794+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e380 v380) 2019-12-09T19:28:50.819 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:50.813+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:50.892 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:50.887+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:50.894 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:50.889+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:50.895 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:50.891+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:50.909 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:50.902+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:50.973 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:50.968+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:51.362 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:51.355+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:51.557 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:51.550+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:51.788 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:51.781+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:51.876 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:51.870+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:51.877 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:51.873+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:51.933 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:51.930+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:51.949 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:51.943+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:52.002 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:51.995+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:52.373 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:52.363+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:52.537 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:52.530+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:52.747 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:52.742+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:52.896 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:52.891+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:52.900 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:52.896+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:52.946 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:52.941+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:52.972 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:52.966+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:53.030 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:53.024+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:53.374 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:53.369+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:53.554 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:53.546+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:53.738 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:53.734+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:53.907 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:53.901+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:53.910 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:53.906+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:53.924 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:53.920+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:53.939 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:53.933+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:54.076 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:54.072+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:54.333 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:54.327+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:54.557 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:54.551+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:54.757 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:54.752+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:54.904 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:54.897+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:54.905 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:54.900+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:54.907 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:54.899+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:54.933 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:54.929+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:55.088 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:28:55.083+0000 1694f700 -1 osd.1 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:23.112216+0000 front 2019-12-09T19:27:22.652687+0000 (oldest deadline 2019-12-09T19:28:05.439900+0000) 2019-12-09T19:28:55.374 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:28:55.364+0000 1694f700 -1 osd.5 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:17.682711+0000 front 2019-12-09T19:27:17.664612+0000 (oldest deadline 2019-12-09T19:28:03.542425+0000) 2019-12-09T19:28:55.540 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:28:55.533+0000 1694f700 -1 osd.4 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:18.659148+0000 front 2019-12-09T19:27:18.661120+0000 (oldest deadline 2019-12-09T19:28:03.776097+0000) 2019-12-09T19:28:55.805 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:28:55.801+0000 1694f700 -1 osd.2 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:21.088811+0000 front 2019-12-09T19:27:21.087074+0000 (oldest deadline 2019-12-09T19:28:03.049373+0000) 2019-12-09T19:28:55.863 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:55.857+0000 1694f700 -1 osd.6 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:27:40.720585+0000 (oldest deadline 2019-12-09T19:28:20.720585+0000) 2019-12-09T19:28:55.865 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:55.859+0000 1694f700 -1 osd.6 380 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e378) 2019-12-09T19:28:55.867 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:28:55.862+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e380 v380) 2019-12-09T19:28:55.955 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:28:55.947+0000 1694f700 -1 osd.7 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.812117+0000 front 2019-12-09T19:27:20.821646+0000 (oldest deadline 2019-12-09T19:28:06.231698+0000) 2019-12-09T19:28:55.977 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:28:55.972+0000 1694f700 -1 osd.3 380 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:27:20.309282+0000 front 2019-12-09T19:27:20.321283+0000 (oldest deadline 2019-12-09T19:28:05.394519+0000) 2019-12-09T19:28:56.618 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:28:56.598+0000 34f8d700 -1 osd.6 381 build_incremental_map_msg missing incremental map 379 2019-12-09T19:29:06.282 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:23:27.340 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:06.290 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:23:27.348 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:06.349 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:23:27.407 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:06.358 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:23:27.416 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:06.378 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:23:27.412 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:06.383 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:23:27.417 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:06.568 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:23:27.625 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:06.587 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:23:27.644 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:06.620 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:23:27.655 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:08.038 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:23:29.073 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:08.040 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:23:29.075 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:08.065 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:23:29.100 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:08.103 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:23:29.161 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:08.105 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:23:29.163 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:08.123 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:23:29.181 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:08.357 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:23:29.415 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:08.360 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:23:29.418 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:08.408 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:23:29.466 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:23.239 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:29:23.230+0000 35f8f700 -1 osd.0 386 build_incremental_map_msg missing incremental map 386 2019-12-09T19:29:23.402 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:29:23.282+0000 32788700 -1 osd.0 386 build_incremental_map_msg missing incremental map 386 2019-12-09T19:29:23.489 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:29:23.311+0000 36f91700 -1 osd.0 386 build_incremental_map_msg missing incremental map 386 2019-12-09T19:29:23.619 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:29:23.330+0000 32788700 -1 osd.0 386 build_incremental_map_msg missing incremental map 386 2019-12-09T19:29:23.622 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:29:23.335+0000 32788700 -1 osd.0 386 build_incremental_map_msg missing incremental map 386 2019-12-09T19:29:23.682 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:29:23.521+0000 36f91700 -1 osd.0 386 build_incremental_map_msg missing incremental map 386 2019-12-09T19:29:23.724 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:29:23.537+0000 36790700 -1 osd.0 386 build_incremental_map_msg missing incremental map 386 2019-12-09T19:29:24.199 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:29:24.154+0000 33f8b700 -1 osd.0 386 build_incremental_map_msg missing incremental map 386 2019-12-09T19:29:49.687 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:24:10.745 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.697 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:24:10.755 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.705 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:24:10.763 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.710 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:24:10.769 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.723 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:24:10.757 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.760 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:24:10.816 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.763 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:24:10.797 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.769 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:24:10.827 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.863 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:24:10.897 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:30:23.629 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:23.624+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:24.303 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:24.298+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:24.363 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:24.359+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:24.592 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:24.587+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:25.307 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:25.302+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:25.394 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:25.389+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:25.559 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:25.553+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:26.075 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:26.070+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:26.278 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:26.268+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:26.359 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:26.354+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:26.501 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:26.491+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:26.516 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:26.511+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:26.658 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:26.654+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:27.064 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:27.060+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:27.184 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:27.179+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:27.323 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:27.318+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:27.350 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:27.345+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:27.497 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:27.494+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:27.567 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:27.562+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:27.633 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:27.628+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:28.059 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:28.054+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:28.151 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:28.148+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:28.338 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:28.331+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:28.357 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:28.351+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:28.493 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:28.486+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:28.600 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:28.596+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:28.604 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:28.600+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:29.017 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:29.012+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:29.206 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:29.202+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:29.313 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:29.309+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:29.345 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:29.340+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:29.508 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:29.505+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:29.592 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:29.587+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:29.647 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:29.643+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:29.978 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:29.972+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:30.164 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:30.160+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:30.316 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:30.310+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:30.327 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:30.322+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:30.549 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:30.541+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:30.625 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:30.620+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:30.698 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:30.693+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:31.006 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:31.000+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:31.174 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:31.170+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:31.299 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:31.295+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:31.360 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:31.354+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:31.515 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:31.511+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:31.601 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:31.596+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:31.691 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:31.686+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:32.007 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:32.002+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:32.187 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:32.182+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:32.289 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:32.285+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:32.381 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:32.376+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:32.495 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:32.491+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:32.562 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:32.558+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:32.726 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:32.721+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:33.058 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:33.053+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:33.219 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:33.215+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:33.254 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:33.250+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:33.420 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:33.414+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:33.489 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:33.485+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:33.542 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:33.537+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:33.739 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:33.734+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:34.028 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:34.024+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:34.254 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:34.250+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:34.277 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:34.272+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:34.452 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:34.447+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:34.515 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:34.510+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:34.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:34.572+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:34.714 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:34.706+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:35.077 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:35.072+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:35.233 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:35.228+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:35.256 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:35.252+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:35.497 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:35.491+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:35.556 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:35.551+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:35.565 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:35.560+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:35.754 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:35.750+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:36.076 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:36.070+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:36.240 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:36.233+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:36.274 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:36.269+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:36.515 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:36.509+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:36.519 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:36.514+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:36.582 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:36.573+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:36.801 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:36.793+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:37.070 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:37.067+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:37.196 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:37.192+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:37.290 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:37.285+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:37.472 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:37.466+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:37.502 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:37.496+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:37.544 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:37.540+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:37.757 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:37.752+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:38.052 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:38.047+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:38.250 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:38.244+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:38.309 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:38.304+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:38.514 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:38.509+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:38.514 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:38.509+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:38.534 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:38.526+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:38.712 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:38.707+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:39.073 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:39.068+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:39.229 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:39.224+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:39.296 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:39.291+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:39.508 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:39.503+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:39.556 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:39.552+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:39.563 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:39.559+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:39.679 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:39.674+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:40.032 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:40.027+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:40.257 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:40.251+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:40.297 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:40.291+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:40.526 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:40.519+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:40.548 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:40.543+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:40.562 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:40.556+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:40.700 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:40.695+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:41.071 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:41.065+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:41.277 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:41.271+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:41.324 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:41.319+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:41.506 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:41.500+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:41.526 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:41.521+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:41.611 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:41.605+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:41.741 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:41.734+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:42.053 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:42.048+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:42.329 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:42.324+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:42.332 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:42.327+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:42.488 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:42.483+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:42.539 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:42.534+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:42.567 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:42.561+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:42.732 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:42.727+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:43.029 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:43.024+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:43.300 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:43.294+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:43.323 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:43.318+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:43.495 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:43.490+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:43.517 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:43.507+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:43.543 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:43.536+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:43.784 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:43.779+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:43.995 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:43.990+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:44.279 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:44.274+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:44.336 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:44.332+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:44.468 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:44.463+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:44.526 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:44.520+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:44.572 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:44.567+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:44.796 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:44.790+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:45.005 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:45.000+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:45.260 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:45.254+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:45.353 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:45.348+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:45.468 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:45.463+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:45.502 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:45.497+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:45.603 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:45.599+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:45.811 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:45.807+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:45.986 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:45.982+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:46.308 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:46.303+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:46.389 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:46.380+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:46.502 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:46.497+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:46.527 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:46.523+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:46.621 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:46.617+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:46.837 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:46.832+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:47.017 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:47.011+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:47.268 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:47.263+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:47.359 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:47.354+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:47.512 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:47.507+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:47.531 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:47.521+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:47.584 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:47.577+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:47.863 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:47.858+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:48.000 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:47.995+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:48.264 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:48.259+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:48.322 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:48.314+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:48.478 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:48.472+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:48.584 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:48.577+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:48.610 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:48.602+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:48.895 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:48.890+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:48.970 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:48.964+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:49.233 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:49.227+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:49.329 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:49.323+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:49.446 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:49.441+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:49.593 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:49.587+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:49.621 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:49.616+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:49.941 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:49.936+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:49.957 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:49.952+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:50.272 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:50.267+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:50.361 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:50.356+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:50.442 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:50.436+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:50.585 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:50.579+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:50.618 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:50.614+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:50.949 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:50.944+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:50.966 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:50.962+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:51.278 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:51.272+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:51.401 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:51.393+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:51.505 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:51.488+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:51.563 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:51.557+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:51.613 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:51.609+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:51.957 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:51.952+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:51.981 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:51.975+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:52.289 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:52.282+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:52.373 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:52.358+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:52.479 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:52.474+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:52.521 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:52.515+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:52.641 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:52.636+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:52.945 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:52.939+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:52.983 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:52.978+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:53.294 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:53.286+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:53.375 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:53.370+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:53.501 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:53.488+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:53.574 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:53.568+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:53.612 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:53.602+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:53.936 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:53.930+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:54.013 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:54.008+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:54.274 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:54.268+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:54.353 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:54.347+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:54.462 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:54.457+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:54.610 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:54.603+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:54.656 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:54.651+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:54.926 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:54.920+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:55.000 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:54.995+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:55.322 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:55.317+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:55.374 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:55.369+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:55.421 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:55.416+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:55.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:55.564+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:55.643 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:55.638+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:55.907 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:55.902+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:56.032 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:56.027+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:56.277 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:56.271+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:56.388 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:56.383+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:56.408 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:56.403+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:56.584 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:56.578+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:56.615 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:30:56.612+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e386 v386) 2019-12-09T19:30:56.692 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:56.688+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:56.888 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:56.883+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:57.075 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:57.071+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:57.235 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:57.228+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:57.387 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:57.383+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:57.410 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:57.406+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:57.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:57.622+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:57.736 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:57.730+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:57.846 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:57.840+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:58.102 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:58.098+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:58.199 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:58.194+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:58.404 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:58.400+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:58.453 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:58.448+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:58.587 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:58.581+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:58.729 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:58.723+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:58.815 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:58.810+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:30:59.062 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:30:59.057+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:30:59.218 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:30:59.212+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:30:59.411 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:30:59.406+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:30:59.443 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:30:59.438+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:30:59.579 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:30:59.574+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:30:59.779 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:30:59.774+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:30:59.813 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:30:59.808+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:31:00.030 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:31:00.018+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:31:00.244 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:31:00.239+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:31:00.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:31:00.410+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:31:00.418 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:31:00.413+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:31:00.621 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:31:00.612+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:31:00.780 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:31:00.775+0000 1694f700 -1 osd.4 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.174050+0000 front 2019-12-09T19:29:40.174799+0000 (oldest deadline 2019-12-09T19:30:23.669215+0000) 2019-12-09T19:31:00.857 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:31:00.853+0000 1694f700 -1 osd.1 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.997247+0000 front 2019-12-09T19:29:43.021627+0000 (oldest deadline 2019-12-09T19:30:25.708793+0000) 2019-12-09T19:31:01.038 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:31:01.032+0000 1694f700 -1 osd.7 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.774544+0000 front 2019-12-09T19:29:42.527104+0000 (oldest deadline 2019-12-09T19:30:26.012230+0000) 2019-12-09T19:31:01.209 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:31:01.205+0000 1694f700 -1 osd.0 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:40.202665+0000 front 2019-12-09T19:29:40.011282+0000 (oldest deadline 2019-12-09T19:30:24.055660+0000) 2019-12-09T19:31:01.406 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:31:01.402+0000 1694f700 -1 osd.3 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.517987+0000 front 2019-12-09T19:29:42.511890+0000 (oldest deadline 2019-12-09T19:30:26.591736+0000) 2019-12-09T19:31:01.452 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:31:01.449+0000 1694f700 -1 osd.2 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:42.063358+0000 front 2019-12-09T19:29:41.839113+0000 (oldest deadline 2019-12-09T19:30:25.819553+0000) 2019-12-09T19:31:01.662 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:31:01.656+0000 1694f700 -1 osd.5 386 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:29:41.801646+0000 front 2019-12-09T19:29:41.421825+0000 (oldest deadline 2019-12-09T19:30:23.098389+0000) 2019-12-09T19:31:01.665 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:31:01.659+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e386 v386) 2019-12-09T19:31:35.247 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:31:35.198+0000 3578e700 -1 osd.6 391 build_incremental_map_msg missing incremental map 391 2019-12-09T19:31:35.252 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:31:35.208+0000 36f91700 -1 osd.6 391 build_incremental_map_msg missing incremental map 391 2019-12-09T19:31:35.254 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:31:35.214+0000 36f91700 -1 osd.6 391 build_incremental_map_msg missing incremental map 391 2019-12-09T19:31:35.484 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:31:35.356+0000 31786700 -1 osd.6 391 build_incremental_map_msg missing incremental map 391 2019-12-09T19:31:35.574 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:31:35.493+0000 33f8b700 -1 osd.6 391 build_incremental_map_msg missing incremental map 391 2019-12-09T19:31:35.698 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:31:35.650+0000 32788700 -1 osd.6 391 build_incremental_map_msg missing incremental map 391 2019-12-09T19:31:37.761 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:31:37.739+0000 38f95700 -1 osd.6 392 build_incremental_map_msg missing incremental map 391 2019-12-09T19:31:59.152 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:31:59.146+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:00.130 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:00.123+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:00.228 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:00.220+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:00.900 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:00.894+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:01.104 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:01.097+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:01.161 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:01.155+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:01.219 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:01.208+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:01.884 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:01.879+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:01.975 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:01.970+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:02.074 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:02.070+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:02.203 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:02.196+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:02.256 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:02.251+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:02.855 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:02.850+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:02.999 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:02.993+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:03.129 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:03.122+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:03.169 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:03.159+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:03.247 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:03.241+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:03.456 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:03.450+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:03.823 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:03.818+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:03.973 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:03.968+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:04.154 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:04.147+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:04.154 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:04.147+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:04.264 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:04.260+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:04.269 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:04.263+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:04.463 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:04.459+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:04.846 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:04.837+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:04.985 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:04.978+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:05.153 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:05.147+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:05.183 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:05.177+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:05.282 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:05.276+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:05.283 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:05.278+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:05.417 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:05.413+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:05.802 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:05.797+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:05.969 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:05.962+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:06.147 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:06.138+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:06.157 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:06.151+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:06.321 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:06.318+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:06.325 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:06.321+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:06.380 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:06.376+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:06.796 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:06.790+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:06.980 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:06.973+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:07.175 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:07.170+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:07.185 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:07.173+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:07.276 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:07.272+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:07.278 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:07.274+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:07.421 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:07.416+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:07.834 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:07.830+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:07.956 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:07.950+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:08.142 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:08.137+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:08.158 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:08.153+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:08.325 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:08.320+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:08.335 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:08.327+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:08.377 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:08.371+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:08.840 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:08.835+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:08.928 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:08.920+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:09.179 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:09.173+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:09.180 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:09.176+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:09.285 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:09.280+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:09.360 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:09.354+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:09.368 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:09.362+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:09.870 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:09.866+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:09.997 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:09.981+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:10.153 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:10.145+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:10.172 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:10.160+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:10.294 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:10.288+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:10.393 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:10.386+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:10.394 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:10.388+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:10.839 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:10.830+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:10.969 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:10.962+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:11.125 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:11.120+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:11.151 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:11.146+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:11.297 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:11.291+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:11.360 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:11.354+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:11.369 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:11.365+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:11.873 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:11.869+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:11.950 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:11.944+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:12.138 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:12.131+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:12.138 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:12.131+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:12.330 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:12.324+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:12.334 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:12.330+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:12.406 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:12.401+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:12.406 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:12.402+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:12.892 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:12.888+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:12.936 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:12.929+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:13.094 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:13.088+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:13.133 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:13.126+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:13.384 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:13.377+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:13.385 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:13.380+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:13.390 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:13.387+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:13.443 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:13.439+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:13.928 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:13.924+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:13.952 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:13.946+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:14.083 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:14.077+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:14.103 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:14.097+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:14.386 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:14.378+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:14.388 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:14.382+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:14.394 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:14.389+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:14.467 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:14.462+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:14.912 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:14.908+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:14.962 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:14.956+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:15.114 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:15.108+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:15.132 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:15.125+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:15.366 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:15.360+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:15.433 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:15.426+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:15.434 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:15.430+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:15.487 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:15.484+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:15.942 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:15.937+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:15.996 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:15.990+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:16.170 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:16.164+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:16.185 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:16.178+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:16.378 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:16.372+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:16.474 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:16.467+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:16.478 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:16.473+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:16.525 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:16.520+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:16.930 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:16.926+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:17.026 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:17.018+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:17.152 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:17.142+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:17.200 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:17.193+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:17.358 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:17.354+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:17.473 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:17.467+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:17.474 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:17.469+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:17.575 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:17.569+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:17.982 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:17.978+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:17.983 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:17.978+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:18.131 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:18.125+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:18.174 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:18.168+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:18.321 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:18.317+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:18.500 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:18.494+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:18.502 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:18.496+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:18.548 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:18.543+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:18.990 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:18.983+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:19.001 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:18.997+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:19.142 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:19.137+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:19.159 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:19.153+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:19.282 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:19.276+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:19.494 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:19.488+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:19.503 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:19.493+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:19.558 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:19.554+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:19.969 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:19.964+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:19.981 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:19.975+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:20.122 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:20.114+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:20.197 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:20.193+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:20.304 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:20.300+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:20.451 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:20.446+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:20.454 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:20.450+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:20.530 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:20.524+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:20.952 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:20.947+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:21.035 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:21.028+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:21.104 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:21.097+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:21.219 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:21.209+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:21.312 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:21.309+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:21.477 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:21.471+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:21.481 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:21.476+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:21.561 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:21.557+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:21.977 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:21.974+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:22.068 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:22.062+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:22.144 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:22.137+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:22.176 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:22.170+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:22.349 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:22.344+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:22.449 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:22.441+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:22.449 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:22.443+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:22.548 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:22.543+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:23.013 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:23.009+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:23.031 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:23.026+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:23.129 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:23.123+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:23.186 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:23.182+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:23.389 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:23.383+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:23.442 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:23.436+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:23.443 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:23.438+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:23.555 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:23.551+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:23.991 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:23.986+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:24.047 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:24.042+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:24.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:24.129+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:24.158 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:24.153+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:24.416 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:24.411+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:24.465 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:24.460+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:24.469 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:24.465+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:24.526 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:24.521+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:25.010 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:25.004+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:25.073 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:25.068+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:25.110 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:25.100+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:25.144 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:25.138+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:25.391 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:25.386+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:25.518 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:25.512+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:25.522 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:25.517+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:25.553 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:25.548+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:25.987 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:25.980+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:26.053 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:26.048+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:26.147 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:26.140+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:26.183 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:26.177+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:26.435 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:26.431+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:26.517 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:26.512+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:26.575 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:26.569+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:26.577 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:26.574+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:27.002 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:26.997+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:27.052 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:27.047+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:27.181 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:27.175+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:27.192 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:27.186+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:27.392 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:27.387+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:27.538 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:27.533+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:27.541 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:27.537+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:27.548 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:27.544+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:28.008 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:28.003+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:28.021 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:28.017+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:28.147 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:28.141+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:28.233 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:28.224+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:28.362 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:28.356+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:28.559 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:28.554+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:28.561 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:28.554+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:28.563 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:28.557+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:28.973 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:28.966+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:29.010 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:29.006+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:29.187 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:29.180+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:29.190 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:29.184+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:29.349 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:29.343+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:29.533 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:29.521+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:29.595 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:29.589+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:29.599 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:29.594+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:30.006 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:29.999+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:30.013 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:30.009+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:30.171 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:30.165+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:30.241 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:30.234+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:30.340 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:30.335+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:30.571 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:30.566+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:30.605 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:30.595+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:30.605 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:30.599+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:30.968 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:30.962+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:31.012 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:31.005+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:31.156 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:31.150+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:31.275 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:31.269+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:31.347 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:31.341+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:31.552 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:31.547+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:31.569 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:31.561+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:31.570 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:31.565+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:31.960 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:31.956+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:32.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:32.055+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:32.190 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:32.183+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:32.267 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:32.260+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:32.321 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:32.316+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:32.541 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:32.536+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:32.623 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:32.616+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:32.624 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:32.619+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:32.918 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:32.914+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:33.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:33.055+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:33.215 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:33.207+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:33.298 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:33.292+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:33.332 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:33.327+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:33.588 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:33.582+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:33.674 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:33.669+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:33.678 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:33.674+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:33.927 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:33.922+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:34.109 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:34.103+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:34.255 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:34.249+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:34.294 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:34.287+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:34.347 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:34.343+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:34.627 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:34.614+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:34.661 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:34.654+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:34.662 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:34.657+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:34.933 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:34.928+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:35.130 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:35.123+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:35.251 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:35.245+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:35.303 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:35.296+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:35.401 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:35.391+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:35.602 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:35.598+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:35.664 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:35.657+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:35.665 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:35.660+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:35.913 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:35.907+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:36.166 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:36.155+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:36.274 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:36.264+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:36.280 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:36.270+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:36.388 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:36.383+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:36.577 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:36.573+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:36.620 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:36.614+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:36.624 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:36.620+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:36.891 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:32:36.887+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e392 v392) 2019-12-09T19:32:36.908 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:36.901+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:37.126 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:37.118+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:37.242 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:37.236+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:37.275 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:37.269+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:37.386 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:37.381+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:37.578 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:37.572+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:37.582 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:37.578+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:37.627 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:37.623+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:37.863 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:37.858+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:38.146 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:38.140+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:38.211 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:38.204+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:38.316 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:38.310+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:38.348 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:38.343+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:38.627 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:38.621+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:38.628 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:38.624+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:38.636 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:38.631+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:38.868 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:38.863+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:39.141 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:39.131+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:39.195 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:39.191+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:39.284 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:39.280+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:39.321 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:39.317+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:39.634 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:39.628+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:39.638 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:39.634+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:39.650 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:39.647+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:39.865 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:39.860+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:40.102 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:40.096+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:40.198 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:40.192+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:40.284 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:40.278+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:40.317 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:40.312+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:40.598 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:40.592+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:40.599 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:40.595+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:40.625 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:40.620+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:40.873 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:40.856+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:41.125 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:41.120+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:41.202 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:41.197+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:41.267 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:41.262+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:41.295 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:41.289+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:41.637 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:41.629+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:41.638 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:41.633+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:41.663 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:41.655+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:41.907 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:32:41.901+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e392 v392) 2019-12-09T19:32:41.914 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:41.909+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:42.085 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:42.079+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:42.246 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:42.239+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:42.290 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:42.285+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:42.328 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:42.322+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:42.626 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:42.620+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:42.630 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:42.626+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:42.714 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:42.709+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:42.908 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:42.904+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:43.093 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:43.085+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:43.246 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:43.240+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:43.262 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:43.257+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:43.328 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:43.321+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:43.641 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:43.634+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:43.643 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:43.637+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:43.722 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:43.718+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:43.924 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:43.920+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:44.118 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:44.111+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:44.215 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:44.208+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:44.276 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:44.270+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:44.289 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:44.280+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:44.673 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:44.666+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:44.676 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:44.670+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:44.677 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:44.671+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:44.880 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:44.875+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:45.124 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:45.118+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:45.251 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:45.244+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:45.270 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:45.266+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:45.302 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:45.295+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:45.635 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:45.630+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:45.700 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:45.683+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:45.706 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:45.686+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:45.869 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:45.864+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:46.096 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:46.089+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:32:46.257 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:32:46.252+0000 1694f700 -1 osd.1 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.200538+0000 front 2019-12-09T19:31:18.259348+0000 (oldest deadline 2019-12-09T19:32:03.432566+0000) 2019-12-09T19:32:46.283 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:32:46.277+0000 1694f700 -1 osd.4 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:17.897288+0000 front 2019-12-09T19:31:17.921797+0000 (oldest deadline 2019-12-09T19:31:58.667740+0000) 2019-12-09T19:32:46.332 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:32:46.324+0000 1694f700 -1 osd.7 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.178024+0000 front 2019-12-09T19:31:16.407928+0000 (oldest deadline 2019-12-09T19:32:00.221831+0000) 2019-12-09T19:32:46.614 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:32:46.608+0000 1694f700 -1 osd.3 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:18.083594+0000 front 2019-12-09T19:31:18.161981+0000 (oldest deadline 2019-12-09T19:31:59.480697+0000) 2019-12-09T19:32:46.714 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:46.708+0000 1694f700 -1 osd.6 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:31:31.841140+0000 (oldest deadline 2019-12-09T19:32:11.841140+0000) 2019-12-09T19:32:46.715 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:32:46.711+0000 1694f700 -1 osd.6 392 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:113572 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e390) 2019-12-09T19:32:46.864 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:32:46.858+0000 1694f700 -1 osd.2 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:14.069268+0000 front 2019-12-09T19:31:14.189308+0000 (oldest deadline 2019-12-09T19:31:59.944055+0000) 2019-12-09T19:32:46.972 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:32:46.966+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e392 v392) 2019-12-09T19:32:47.116 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:32:47.111+0000 1694f700 -1 osd.5 392 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:31:16.941720+0000 front 2019-12-09T19:31:16.969395+0000 (oldest deadline 2019-12-09T19:32:01.156874+0000) 2019-12-09T19:33:43.787 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:28:04.846 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:33:43.803 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:28:04.858 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:33:43.804 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:28:04.838 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:33:43.805 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:28:04.863 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:33:43.808 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:28:04.867 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:33:43.809 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:28:04.843 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:33:44.034 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:28:05.093 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:33:44.045 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:28:05.103 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:33:44.069 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:28:05.103 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:34:21.473 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:21.468+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:22.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:22.421+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:22.485 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:22.478+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:23.284 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:23.280+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:23.442 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:23.437+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:23.470 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:23.452+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:23.548 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:23.542+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:24.209 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:24.205+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:24.283 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:24.278+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:24.438 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:24.433+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:24.510 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:24.506+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:24.519 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:24.516+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:24.908 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:24.899+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:25.194 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:25.189+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:25.295 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:25.288+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:25.478 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:25.473+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:25.502 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:25.498+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:25.537 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:25.532+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:25.952 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:25.948+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:26.172 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:26.166+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:26.297 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:26.293+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:26.475 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:26.470+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:26.538 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:26.534+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:26.540 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:26.533+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:26.917 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:26.911+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:27.222 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:27.216+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:27.325 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:27.321+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:27.454 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:27.449+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:27.514 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:27.509+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:27.582 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:27.579+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:27.926 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:27.922+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:28.207 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:28.203+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:28.328 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:28.324+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:28.467 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:28.462+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:28.541 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:28.535+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:28.601 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:28.597+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:28.885 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:28.879+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:29.224 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:29.220+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:29.342 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:29.338+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:29.425 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:29.420+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:29.588 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:29.584+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:29.616 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:29.612+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:29.901 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:29.897+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:30.258 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:30.254+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:30.358 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:30.354+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:30.427 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:30.423+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:30.555 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:30.551+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:30.577 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:30.572+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:30.934 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:30.929+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:31.180 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:31.176+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:31.308 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:31.305+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:31.366 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:31.363+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:31.459 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:31.449+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:31.584 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:31.579+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:31.585 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:31.579+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:31.929 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:31.913+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:32.156 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:32.146+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:32.329 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:32.324+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:32.336 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:32.331+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:32.510 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:32.502+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:32.577 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:32.573+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:32.598 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:32.592+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:32.964 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:32.959+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:33.159 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:33.154+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:33.312 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:33.308+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:33.327 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:33.323+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:33.499 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:33.492+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:33.615 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:33.611+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:33.626 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:33.622+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:33.921 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:33.916+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:34.131 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:34.127+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:34.359 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:34.355+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:34.371 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:34.367+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:34.458 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:34.452+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:34.598 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:34.594+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:34.627 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:34.623+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:34.960 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:34.954+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:35.169 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:35.165+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:35.331 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:35.327+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:35.411 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:35.397+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:35.480 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:35.475+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:35.612 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:35.608+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:35.631 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:35.628+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:35.976 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:35.971+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:36.175 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:36.171+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:36.303 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:36.298+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:36.447 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:36.436+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:36.447 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:36.436+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:36.660 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:36.656+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:36.664 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:36.659+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:37.005 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:37.000+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:37.188 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:37.184+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:37.270 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:37.267+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:37.432 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:37.417+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:37.483 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:37.480+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:37.651 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:37.647+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:37.665 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:37.654+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:38.004 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:37.999+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:38.215 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:38.211+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:38.262 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:38.258+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:38.475 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:38.469+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:38.529 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:38.525+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:38.621 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:38.617+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:38.699 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:38.694+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:38.996 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:38.990+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:39.219 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:39.215+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:39.255 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:39.251+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:39.487 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:39.482+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:39.504 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:39.499+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:39.662 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:39.659+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:39.674 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:39.668+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:40.035 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:40.030+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:40.225 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:40.221+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:40.243 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:40.239+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:40.531 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:40.527+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:40.554 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:40.549+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:40.661 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:40.657+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:40.710 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:40.705+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:41.028 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:41.023+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:41.271 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:41.268+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:41.277 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:41.274+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:41.512 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:41.507+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:41.556 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:41.552+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:41.698 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:41.695+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:41.742 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:41.737+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:42.033 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:42.030+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:42.264 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:42.260+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:42.309 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:42.305+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:42.523 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:42.518+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:42.602 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:42.599+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:42.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:42.703+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:42.708 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:42.703+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:43.085 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:43.080+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:43.265 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:43.261+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:43.298 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:43.294+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:43.541 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:43.536+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:43.560 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:43.556+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:43.676 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:43.672+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:43.681 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:43.678+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:44.056 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:44.049+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:44.233 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:44.229+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:44.313 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:44.308+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:44.563 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:44.559+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:44.573 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:44.568+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:44.637 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:44.632+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:44.690 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:44.686+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:45.055 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:45.050+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:45.244 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:45.239+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:45.267 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:45.263+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:45.559 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:45.551+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:45.567 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:45.561+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:45.653 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:45.650+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:45.687 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:45.683+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:46.022 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:46.012+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:46.222 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:46.219+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:46.312 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:46.308+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:46.560 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:46.556+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:46.585 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:46.579+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:46.650 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:46.646+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:46.691 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:46.687+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:47.054 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:47.050+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:47.255 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:47.251+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:47.308 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:47.304+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:47.553 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:47.549+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:47.587 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:47.583+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:47.619 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:47.616+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:47.743 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:47.738+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:48.020 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:48.015+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:48.284 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:48.280+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:48.295 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:48.291+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:48.587 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:48.582+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:48.595 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:48.591+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:48.614 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:48.609+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:48.706 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:48.701+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:48.993 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:48.988+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:49.242 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:49.237+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:49.268 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:49.263+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:49.603 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:49.598+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:49.605 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:49.601+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:49.608 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:49.603+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:49.709 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:49.703+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:49.969 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:49.964+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:50.217 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:50.213+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:50.253 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:50.248+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:50.567 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:50.562+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:50.619 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:50.615+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:50.650 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:50.647+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:50.693 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:50.688+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:51.012 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:51.008+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:51.223 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:51.218+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:51.272 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:51.267+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:51.564 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:51.558+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:51.609 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:51.603+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:51.652 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:51.647+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:51.702 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:51.698+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:52.005 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:51.999+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:52.178 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:52.173+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:52.261 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:52.257+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:52.553 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:52.549+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:52.635 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:52.629+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:52.636 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:52.633+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:52.690 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:52.685+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:52.965 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:52.961+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:53.225 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:53.217+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:53.231 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:53.226+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:53.529 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:53.523+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:53.599 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:53.593+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:53.632 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:53.627+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:53.727 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:53.723+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:53.955 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:53.951+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:54.235 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:54.230+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:54.251 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:54.246+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:54.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:54.563+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:54.600 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:54.595+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:54.611 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:54.607+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:54.696 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:54.692+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:54.916 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:54.912+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:55.219 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:55.215+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:55.233 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:55.229+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:55.543 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:55.538+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:55.587 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:55.581+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:55.622 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:55.618+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:55.651 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:55.646+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:55.926 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:55.922+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:56.264 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:56.259+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:56.266 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:56.261+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:56.536 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:34:56.531+0000 1694f700 -1 osd.5 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.736057+0000 front 2019-12-09T19:33:37.565475+0000 (oldest deadline 2019-12-09T19:34:21.454973+0000) 2019-12-09T19:34:56.593 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:56.581+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:56.595 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:56.591+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:34:56.667 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:34:56.659+0000 1694f700 -1 osd.3 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:38.684519+0000 front 2019-12-09T19:33:39.488852+0000 (oldest deadline 2019-12-09T19:34:23.976053+0000) 2019-12-09T19:34:56.967 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:34:56.962+0000 1694f700 -1 osd.7 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.498036+0000 front 2019-12-09T19:33:39.735850+0000 (oldest deadline 2019-12-09T19:34:24.110902+0000) 2019-12-09T19:34:57.226 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:34:57.221+0000 1694f700 -1 osd.0 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.271624+0000 front 2019-12-09T19:33:39.509858+0000 (oldest deadline 2019-12-09T19:34:23.174298+0000) 2019-12-09T19:34:57.250 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:34:57.245+0000 1694f700 -1 osd.2 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:37.345959+0000 front 2019-12-09T19:33:36.355344+0000 (oldest deadline 2019-12-09T19:34:30.813714+0000) 2019-12-09T19:34:57.407 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:34:57.401+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e397 v397) 2019-12-09T19:34:57.563 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:34:57.558+0000 1694f700 -1 osd.1 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:36.302548+0000 front 2019-12-09T19:33:36.277150+0000 (oldest deadline 2019-12-09T19:34:21.913973+0000) 2019-12-09T19:34:57.595 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:34:57.590+0000 1694f700 -1 osd.4 397 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:33:39.509759+0000 front 2019-12-09T19:33:38.955515+0000 (oldest deadline 2019-12-09T19:34:23.518182+0000) 2019-12-09T19:35:55.652 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:35:55.640+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:35:56.547 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:35:56.543+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:35:56.621 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:35:56.615+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:35:57.030 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:35:57.023+0000 1694f700 -1 osd.3 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.826219+0000 front 2019-12-09T19:35:13.886241+0000 (oldest deadline 2019-12-09T19:35:56.707197+0000) 2019-12-09T19:35:57.542 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:35:57.536+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:35:57.602 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:35:57.594+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:35:58.010 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:35:58.005+0000 1694f700 -1 osd.3 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.826219+0000 front 2019-12-09T19:35:13.886241+0000 (oldest deadline 2019-12-09T19:35:56.707197+0000) 2019-12-09T19:35:58.513 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:35:58.508+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:35:58.644 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:35:58.637+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:35:58.904 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:35:58.898+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:35:59.025 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:35:59.020+0000 1694f700 -1 osd.3 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.826219+0000 front 2019-12-09T19:35:13.886241+0000 (oldest deadline 2019-12-09T19:35:56.707197+0000) 2019-12-09T19:35:59.115 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:35:59.109+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:35:59.475 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:35:59.471+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:35:59.700 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:35:59.691+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:35:59.880 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:35:59.875+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:35:59.884 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:35:59.879+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:00.032 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:36:00.026+0000 1694f700 -1 osd.3 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.826219+0000 front 2019-12-09T19:35:13.886241+0000 (oldest deadline 2019-12-09T19:35:56.707197+0000) 2019-12-09T19:36:00.122 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:00.116+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:00.513 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:00.509+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:00.726 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:00.717+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:00.919 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:00.913+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:00.932 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:00.926+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:01.036 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:36:01.030+0000 1694f700 -1 osd.3 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.826219+0000 front 2019-12-09T19:35:13.886241+0000 (oldest deadline 2019-12-09T19:35:56.707197+0000) 2019-12-09T19:36:01.165 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:01.158+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:01.546 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:01.541+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:01.681 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:01.675+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:01.918 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:01.913+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:01.929 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:01.924+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:02.087 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:36:02.082+0000 1694f700 -1 osd.3 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.826219+0000 front 2019-12-09T19:35:13.886241+0000 (oldest deadline 2019-12-09T19:35:56.707197+0000) 2019-12-09T19:36:02.177 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:02.172+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:02.341 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:02.337+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:02.598 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:02.593+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:02.706 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:02.700+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:02.937 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:02.928+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:02.979 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:02.973+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:03.128 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:36:03.122+0000 1694f700 -1 osd.3 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.826219+0000 front 2019-12-09T19:35:13.886241+0000 (oldest deadline 2019-12-09T19:35:56.707197+0000) 2019-12-09T19:36:03.147 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:03.143+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:03.392 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:03.385+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:03.598 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:03.594+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:03.745 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:03.740+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:03.923 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:03.917+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:03.942 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:03.935+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:04.141 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:04.135+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:04.431 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:04.423+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:04.592 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:04.586+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:04.787 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:04.781+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:04.959 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:04.953+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:04.962 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:04.955+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:05.185 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:05.178+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:05.395 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:05.390+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:05.645 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:05.636+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:05.790 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:05.785+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:05.920 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:05.914+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:05.996 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:05.991+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:06.141 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:06.136+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:06.425 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:06.420+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:06.655 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:06.645+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:06.798 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:06.790+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:06.893 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:06.886+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:06.977 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:06.971+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:07.129 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:07.115+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:07.466 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:07.462+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:07.638 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:07.633+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:07.822 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:07.816+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:07.905 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:07.899+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:07.966 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:07.961+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:08.080 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:08.075+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:08.517 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:08.512+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:08.650 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:08.643+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:08.841 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:08.835+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:08.896 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:08.890+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:08.923 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:08.916+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:09.037 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:09.031+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:09.546 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:09.540+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:09.550 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:09.545+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:09.619 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:09.614+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:09.808 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:09.799+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:09.861 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:09.856+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:09.921 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:09.917+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:10.026 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:10.021+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:10.594 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:10.587+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:10.598 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:10.590+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:10.656 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:10.652+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:10.830 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:10.823+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:10.895 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:10.889+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:10.947 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:10.941+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:11.003 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:10.998+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:11.596 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:11.588+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:11.597 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:11.592+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:11.698 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:11.693+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:11.806 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:11.800+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:11.926 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:11.918+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:11.927 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:11.919+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:11.963 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:11.957+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:12.608 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:12.602+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:12.612 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:12.608+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:12.720 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:12.715+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:12.814 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:12.808+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:12.907 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:12.900+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:12.918 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:12.912+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:12.928 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:12.919+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:13.617 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:13.610+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:13.620 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:13.616+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:13.704 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:13.699+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:13.812 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:13.802+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:13.878 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:13.872+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:13.911 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:13.904+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:13.916 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:13.911+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:14.588 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:14.581+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:14.589 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:14.585+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:14.713 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:14.708+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:14.809 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:14.802+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:14.850 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:14.844+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:14.890 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:14.884+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:14.932 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:14.925+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:15.549 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:15.540+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:15.550 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:15.544+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:15.701 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:15.688+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:15.828 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:15.821+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:15.861 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:15.853+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:15.894 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:15.884+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:15.939 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:15.934+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:16.511 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:16.504+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:16.513 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:16.508+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:16.647 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:16.641+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:16.869 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:16.862+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:16.881 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:16.874+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:16.895 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:16.888+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:16.981 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:16.976+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:17.476 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:17.470+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:17.480 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:17.476+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:17.653 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:17.646+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:17.855 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:17.848+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:17.907 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:17.901+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:17.916 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:17.911+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:17.939 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:17.933+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:18.468 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:18.461+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:18.469 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:18.464+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:18.624 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:18.620+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:18.881 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:18.875+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:18.888 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:18.882+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:18.909 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:18.904+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:18.951 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:18.945+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:19.499 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:19.493+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:19.503 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:19.498+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:19.637 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:19.630+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:19.849 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:19.843+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:19.864 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:19.860+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:19.922 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:19.916+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:19.990 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:19.984+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:20.517 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:20.510+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:20.518 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:20.513+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:20.624 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:20.619+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:20.833 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:20.818+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:20.841 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:20.835+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:20.946 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:20.941+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:20.977 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:20.970+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:21.555 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:21.548+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:21.556 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:21.551+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:21.660 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:21.655+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:21.850 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:21.844+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:21.879 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:21.874+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:21.938 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:21.932+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:21.947 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:21.940+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:22.523 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:22.516+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:22.524 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:22.519+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:22.702 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:22.697+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:22.814 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:22.809+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:22.898 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:22.893+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:22.945 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:22.939+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:22.990 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:22.983+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:23.479 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:23.472+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:23.480 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:23.475+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:23.707 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:23.703+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:23.836 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:23.829+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:23.949 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:23.945+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:23.974 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:23.968+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:23.993 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:23.987+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:24.464 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:24.458+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:24.468 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:24.464+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:24.671 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:24.667+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:24.875 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:24.869+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:24.986 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:24.982+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:25.004 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:24.997+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:25.030 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:25.023+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:25.464 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:25.459+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:25.468 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:25.464+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:25.691 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:25.687+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:25.926 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:25.920+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:26.015 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:26.012+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:26.020 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:26.015+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:26.049 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:26.042+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:26.449 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:26.442+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:26.452 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:26.446+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:26.726 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:26.723+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:26.944 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:26.938+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:27.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:27.052+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:27.062 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:27.056+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:27.064 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:27.060+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:27.413 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:27.406+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:27.415 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:27.410+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:27.702 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:27.697+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:27.755 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:36:27.747+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e404 v404) 2019-12-09T19:36:27.971 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:27.965+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:28.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:28.050+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:28.087 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:28.082+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:28.103 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:28.100+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:28.459 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:28.452+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:28.460 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:28.455+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:28.728 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:28.723+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:28.957 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:28.950+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:29.038 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:29.032+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:29.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:29.055+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:29.082 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:29.078+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:29.497 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:29.491+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:29.501 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:29.497+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:29.704 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:29.699+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:29.912 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:29.905+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:30.042 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:30.037+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:30.095 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:30.089+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:30.100 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:30.094+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:30.531 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:30.524+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:30.532 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:30.527+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:30.682 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:30.678+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:30.963 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:30.957+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:31.015 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:31.009+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:31.102 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:31.096+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:31.114 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:31.108+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:31.489 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:31.482+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:31.490 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:31.485+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:31.663 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:31.660+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:32.005 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:31.996+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:32.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:32.060+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:32.100 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:32.094+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:32.111 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:32.107+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:32.473 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:32.466+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:32.474 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:32.469+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:32.687 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:32.683+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:32.769 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:36:32.762+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e404 v404) 2019-12-09T19:36:32.986 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:32.979+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:33.100 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:33.094+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:33.101 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:33.096+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:33.128 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:33.121+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:33.456 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:33.449+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:33.457 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:33.452+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:33.722 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:33.715+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:33.953 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:33.948+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:34.105 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:34.102+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:34.112 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:34.106+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:34.125 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:34.119+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:34.494 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:34.488+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:34.495 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:34.490+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:34.717 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:34.709+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:34.948 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:34.942+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:35.064 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:35.059+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:35.070 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:35.064+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:35.177 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:35.171+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:35.473 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:35.466+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:35.474 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:35.469+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:35.756 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:35.752+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:35.958 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:35.952+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:36.094 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:36.087+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:36.104 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:36.098+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:36.180 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:36.173+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:36.446 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:36.441+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:36.448 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:36.444+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:36.730 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:36.726+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:36.978 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:36.971+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:37.076 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:37.070+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:37.108 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:37.102+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:37.147 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:37.140+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:37.445 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:37.440+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:37.449 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:37.445+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:37.759 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:37.755+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:37.780 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:36:37.776+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e404 v404) 2019-12-09T19:36:38.019 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:38.014+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:38.044 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:38.040+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:38.120 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:38.115+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:38.160 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:38.156+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:38.435 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:38.426+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:38.436 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:38.430+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:38.791 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:38.787+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:39.038 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:39.032+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:39.055 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:39.050+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:39.154 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:39.149+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:39.174 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:39.161+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:39.473 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:39.468+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:39.477 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:39.473+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:39.769 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:39.766+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:40.008 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:40.002+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:40.047 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:40.042+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:40.114 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:40.107+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:40.134 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:40.128+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:40.453 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:40.446+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:40.455 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:40.449+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:40.743 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:40.737+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:41.032 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:41.026+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:41.038 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:41.033+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:41.086 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:41.081+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:41.090 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:41.084+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:41.464 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:41.456+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:41.466 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:41.460+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:41.722 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:41.718+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:41.992 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:41.987+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:42.010 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:36:42.004+0000 1694f700 -1 osd.4 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:09.710425+0000 front 2019-12-09T19:35:09.720035+0000 (oldest deadline 2019-12-09T19:35:54.964020+0000) 2019-12-09T19:36:42.078 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:36:42.071+0000 1694f700 -1 osd.7 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.652588+0000 front 2019-12-09T19:35:13.546740+0000 (oldest deadline 2019-12-09T19:35:59.421885+0000) 2019-12-09T19:36:42.093 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:42.087+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:36:42.495 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:42.488+0000 1694f700 -1 osd.6 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:35:29.398657+0000 (oldest deadline 2019-12-09T19:36:09.398657+0000) 2019-12-09T19:36:42.496 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:36:42.491+0000 1694f700 -1 osd.6 404 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-12-09T19:36:42.750 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:36:42.746+0000 1694f700 -1 osd.2 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:11.780653+0000 front 2019-12-09T19:35:11.606106+0000 (oldest deadline 2019-12-09T19:35:56.203165+0000) 2019-12-09T19:36:42.844 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:36:42.838+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e404 v404) 2019-12-09T19:36:42.960 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:36:42.956+0000 1694f700 -1 osd.1 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:13.146771+0000 front 2019-12-09T19:35:13.122126+0000 (oldest deadline 2019-12-09T19:35:58.969653+0000) 2019-12-09T19:36:43.094 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:36:43.089+0000 1694f700 -1 osd.5 404 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:35:14.714817+0000 front 2019-12-09T19:35:14.862957+0000 (oldest deadline 2019-12-09T19:35:58.559029+0000) 2019-12-09T19:37:28.059 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:31:49.118 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:28.093 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:31:49.151 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:28.095 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:31:49.130 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:28.100 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:31:49.158 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:28.112 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:31:49.170 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:28.119 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:31:49.153 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:28.278 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:31:49.336 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:28.313 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:31:49.371 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:28.329 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:31:49.363 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:43.193 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:32:04.251 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:43.200 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:32:04.259 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:43.206 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:32:04.241 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:43.207 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:32:04.265 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:43.210 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:32:04.269 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:43.212 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:32:04.247 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:43.238 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:32:04.296 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:43.241 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:32:04.300 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:37:43.247 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:32:04.281 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:38:13.621 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:13.616+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:14.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:14.130+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:14.647 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:14.642+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:14.706 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:14.701+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:15.094 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:15.089+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:15.657 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:15.652+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:15.723 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:15.718+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:16.016 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:16.011+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:16.065 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:16.060+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:16.597 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:16.591+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:16.648 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:16.642+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:16.765 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:16.757+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:17.001 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:16.997+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:17.056 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:17.050+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:17.239 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:17.234+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:17.531 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:17.527+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:17.623 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:17.617+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:17.680 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:17.676+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:17.764 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:17.751+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:18.012 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:18.007+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:18.087 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:18.082+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:18.238 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:18.233+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:18.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:18.500+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:18.634 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:18.630+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:18.638 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:18.634+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:18.790 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:18.784+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:19.045 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:19.040+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:19.136 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:19.131+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:19.261 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:19.256+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:19.502 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:19.497+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:19.634 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:19.629+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:19.655 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:19.650+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:19.800 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:19.794+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:20.040 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:20.037+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:20.114 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:20.109+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:20.304 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:20.299+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:20.552 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:20.547+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:20.663 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:20.658+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:20.675 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:20.670+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:20.846 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:20.840+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:21.017 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:21.012+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:21.069 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:21.065+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:21.292 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:21.286+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:21.526 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:21.519+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:21.664 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:21.658+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:21.706 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:21.701+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:21.836 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:21.831+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:22.036 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:22.031+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:22.041 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:22.036+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:22.326 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:22.320+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:22.564 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:22.556+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:22.630 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:22.624+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:22.749 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:22.744+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:22.829 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:22.824+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:22.999 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:22.994+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:23.033 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:23.029+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:23.309 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:23.305+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:23.553 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:23.548+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:23.653 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:23.646+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:23.766 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:23.761+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:23.786 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:23.781+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:24.017 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:24.011+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:24.042 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:24.035+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:24.277 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:24.272+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:24.539 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:24.533+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:24.673 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:24.668+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:24.720 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:24.715+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:24.743 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:24.739+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:25.023 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:25.017+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:25.025 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:25.020+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:25.328 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:25.323+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:25.501 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:25.493+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:25.639 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:25.634+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:25.710 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:25.705+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:25.753 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:25.747+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:25.979 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:25.976+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:26.041 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:26.035+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:26.306 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:26.302+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:26.515 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:26.510+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:26.603 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:26.598+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:26.680 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:26.675+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:26.718 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:26.714+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:26.996 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:26.992+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:27.013 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:27.008+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:27.343 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:27.338+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:27.553 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:27.548+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:27.563 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:27.558+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:27.696 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:27.690+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:27.763 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:27.758+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:28.017 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:28.013+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:28.041 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:28.037+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:28.396 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:28.385+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:28.535 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:28.530+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:28.617 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:28.612+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:28.738 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:28.733+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:28.779 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:28.774+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:28.981 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:28.976+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:29.053 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:29.047+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:29.429 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:29.423+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:29.566 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:29.561+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:29.572 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:29.567+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:29.756 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:29.751+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:29.832 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:29.826+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:30.008 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:30.003+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:30.019 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:30.014+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:30.437 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:30.433+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:30.551 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:30.545+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:30.610 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:30.605+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:30.795 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:30.790+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:30.796 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:30.790+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:31.033 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:31.028+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:31.045 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:31.040+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:31.477 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:31.472+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:31.524 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:31.519+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:31.663 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:31.658+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:31.761 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:31.757+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:31.840 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:31.833+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:32.035 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:32.032+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:32.078 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:32.073+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:32.434 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:32.430+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:32.519 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:32.514+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:32.668 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:32.663+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:32.793 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:32.788+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:32.797 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:32.793+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:33.069 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:33.065+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:33.081 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:33.078+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:33.460 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:33.455+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:33.522 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:33.517+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:33.641 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:33.636+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:33.757 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:33.752+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:33.802 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:33.798+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:34.035 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:34.030+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:34.057 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:34.052+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:34.502 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:34.499+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:34.570 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:34.565+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:34.644 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:34.640+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:34.730 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:34.725+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:34.846 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:34.841+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:35.000 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:34.995+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:35.109 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:35.106+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:35.509 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:35.505+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:35.578 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:35.573+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:35.611 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:35.606+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:35.749 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:35.745+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:35.855 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:35.848+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:36.028 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:36.023+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:36.132 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:36.127+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:36.515 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:36.512+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:36.567 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:36.562+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:36.623 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:36.618+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:36.753 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:36.744+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:36.861 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:36.858+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:37.074 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:37.068+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:37.161 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:37.157+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:37.498 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:37.494+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:37.587 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:37.582+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:37.604 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:37.600+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:37.710 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:37.707+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:37.850 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:37.846+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:38.113 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:38.108+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:38.171 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:38.166+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:38.480 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:38.476+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:38.599 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:38.593+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:38.630 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:38.624+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:38.704 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:38.700+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:38.899 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:38.896+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:39.147 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:39.142+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:39.161 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:39.157+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:39.518 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:39.514+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:39.614 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:39.609+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:39.651 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:39.646+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:39.722 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:39.719+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:39.922 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:39.917+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:40.183 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:40.178+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:40.197 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:40.194+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:40.533 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:40.528+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:40.592 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:40.587+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:40.650 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:40.644+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:40.695 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:40.692+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:40.912 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:40.907+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:41.205 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:41.201+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:41.213 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:41.208+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:41.502 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:41.499+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:41.601 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:41.596+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:41.639 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:41.634+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:41.700 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:41.696+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:41.899 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:41.895+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:42.175 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:42.170+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:42.218 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:42.215+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:42.545 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:42.541+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:42.561 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:42.555+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:42.620 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:42.615+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:42.667 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:42.664+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:42.946 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:42.942+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:43.187 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:43.183+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:43.221 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:43.216+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:43.558 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:43.554+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:43.563 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:43.559+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:43.593 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:43.588+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:43.675 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:43.669+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:43.936 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:43.932+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:44.217 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:44.213+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:44.268 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:44.263+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:44.574 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:44.569+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:44.581 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:44.574+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:44.592 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:44.587+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:44.649 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:44.645+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:44.925 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:44.921+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:45.222 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:45.219+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:45.247 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:45.242+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:45.560 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:45.556+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:45.571 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:45.566+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:45.581 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:45.576+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:45.617 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:45.613+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:45.907 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:45.904+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:46.245 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:46.241+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:46.261 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:46.257+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:46.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:46.564+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:46.575 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:46.572+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:46.601 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:46.598+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:46.644 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:46.640+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:46.937 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:46.933+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:47.259 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:47.255+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:47.291 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:47.286+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:47.529 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:47.525+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:47.566 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:47.562+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:47.622 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:47.618+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:47.679 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:47.674+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:47.935 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:47.930+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:48.230 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:48.226+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:48.263 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:38:48.259+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 45sec e409 v409) 2019-12-09T19:38:48.337 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:48.333+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:48.513 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:48.507+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:48.545 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:48.540+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:48.584 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:48.580+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:48.664 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:48.660+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:48.976 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:48.972+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:49.224 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:49.220+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:49.316 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:49.310+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:49.527 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:49.521+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:49.528 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:49.524+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:49.583 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:49.576+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:49.693 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:49.689+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:49.963 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:49.960+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:50.214 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:50.211+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:50.364 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:50.359+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:50.545 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:50.541+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:50.576 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:50.572+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:50.621 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:50.618+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:50.692 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:50.688+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:50.953 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:50.949+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:51.266 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:51.263+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:51.349 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:51.345+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:51.536 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:51.530+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:51.569 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:51.560+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:51.587 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:51.583+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:51.674 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:51.670+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:51.934 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:51.929+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:52.290 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:52.286+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:52.370 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:52.366+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:52.555 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:38:52.550+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:32.462594+0000 front 2019-12-09T19:37:32.460865+0000 (oldest deadline 2019-12-09T19:38:17.455904+0000) 2019-12-09T19:38:52.569 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:38:52.564+0000 1694f700 -1 osd.5 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.739327+0000 front 2019-12-09T19:37:33.552079+0000 (oldest deadline 2019-12-09T19:38:12.874454+0000) 2019-12-09T19:38:52.611 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:52.606+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:38:52.675 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:38:52.672+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:33.440249+0000 front 2019-12-09T19:37:33.647583+0000 (oldest deadline 2019-12-09T19:38:14.169941+0000) 2019-12-09T19:38:52.944 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:38:52.935+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.008301+0000 front 2019-12-09T19:37:31.950475+0000 (oldest deadline 2019-12-09T19:38:16.230933+0000) 2019-12-09T19:38:53.318 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:38:53.314+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:30.717870+0000 front 2019-12-09T19:37:30.654004+0000 (oldest deadline 2019-12-09T19:38:15.898076+0000) 2019-12-09T19:38:53.341 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:38:53.335+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:28.143096+0000 front 2019-12-09T19:37:29.373963+0000 (oldest deadline 2019-12-09T19:38:13.635880+0000) 2019-12-09T19:38:53.343 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:38:53.338+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 45sec e409 v409) 2019-12-09T19:38:53.644 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:38:53.641+0000 1694f700 -1 osd.2 409 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:37:31.888996+0000 front 2019-12-09T19:37:31.089014+0000 (oldest deadline 2019-12-09T19:38:16.691215+0000) 2019-12-09T19:39:51.391 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:39:51.386+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:39:52.187 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:39:52.177+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:39:52.359 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:39:52.354+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:39:52.539 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:39:52.532+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:39:53.206 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:39:53.200+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:39:53.322 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:39:53.317+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:39:53.533 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:39:53.527+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:39:54.255 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:39:54.248+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:39:54.303 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:39:54.300+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:39:54.492 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:39:54.482+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:39:54.862 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:39:54.856+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:39:54.905 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:39:54.901+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:39:55.287 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:39:55.280+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:39:55.334 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:39:55.326+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:39:55.489 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:39:55.482+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:39:55.682 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:39:55.678+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:39:55.883 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:39:55.878+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:39:55.921 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:39:55.914+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:39:56.339 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:39:56.332+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:39:56.366 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:39:56.360+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:39:56.458 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:39:56.452+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:39:56.729 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:39:56.724+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:39:56.886 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:39:56.880+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:39:56.936 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:39:56.927+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:39:57.315 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:39:57.307+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:39:57.320 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:39:57.315+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:39:57.510 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:39:57.504+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:39:57.734 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:39:57.730+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:39:57.941 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:39:57.935+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:39:57.988 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:39:57.979+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:39:58.286 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:39:58.281+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:39:58.343 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:39:58.333+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:39:58.467 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:39:58.461+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:39:58.767 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:39:58.762+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:39:58.909 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:39:58.900+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:39:58.987 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:39:58.982+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:39:59.288 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:39:59.283+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:39:59.360 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:39:59.353+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:39:59.479 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:39:59.466+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:39:59.818 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:39:59.814+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:39:59.898 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:39:59.892+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:39:59.970 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:39:59.967+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:00.285 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:00.280+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:00.327 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:00.315+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:00.459 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:00.453+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:00.795 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:00.790+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:00.902 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:00.897+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:00.968 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:00.962+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:01.267 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:01.262+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:01.325 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:01.321+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:01.345 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:01.338+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:01.500 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:01.493+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:01.798 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:01.794+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:01.934 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:01.924+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:01.949 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:01.946+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:02.275 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:02.269+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:02.338 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:02.334+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:02.379 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:02.374+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:02.525 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:02.520+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:02.791 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:02.787+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:02.895 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:02.889+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:02.938 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:02.929+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:03.318 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:03.312+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:03.357 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:03.352+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:03.407 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:03.397+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:03.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:03.511+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:03.806 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:03.801+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:03.881 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:03.875+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:03.953 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:03.949+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:04.356 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:04.351+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:04.372 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:04.366+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:04.408 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:04.404+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:04.512 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:04.501+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:04.832 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:04.828+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:04.878 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:04.873+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:04.931 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:04.927+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:05.337 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:05.333+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:05.384 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:05.379+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:05.389 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:05.383+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:05.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:05.457+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:05.845 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:05.840+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:05.893 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:05.887+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:05.962 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:05.957+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:06.328 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:06.324+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:06.362 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:06.356+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:06.365 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:06.361+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:06.371 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:06.365+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:06.436 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:06.431+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:06.803 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:06.800+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:06.929 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:06.922+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:07.009 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:07.004+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:07.310 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:07.306+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:07.319 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:07.312+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:07.319 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:07.314+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:07.407 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:07.398+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:07.415 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:07.408+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:07.771 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:07.765+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:07.976 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:07.967+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:08.001 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:07.996+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:08.328 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:08.323+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:08.359 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:08.351+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:08.366 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:08.357+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:08.430 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:08.424+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:08.447 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:08.438+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:08.797 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:08.794+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:08.969 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:08.963+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:08.985 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:08.979+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:09.326 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:09.321+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:09.393 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:09.386+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:09.394 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:09.389+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:09.451 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:09.445+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:09.460 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:09.454+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:09.850 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:09.846+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:09.943 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:09.935+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:09.968 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:09.963+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:10.281 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:10.277+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:10.356 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:10.349+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:10.357 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:10.352+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:10.441 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:10.434+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:10.506 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:10.499+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:10.835 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:10.831+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:10.944 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:10.927+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:10.980 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:10.975+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:11.267 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:11.262+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:11.325 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:11.319+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:11.326 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:11.321+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:11.408 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:11.402+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:11.546 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:11.540+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:11.858 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:11.854+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:11.945 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:11.940+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:11.977 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:11.973+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:12.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:12.225+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:12.332 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:12.326+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:12.335 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:12.331+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:12.402 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:12.390+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:12.548 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:12.541+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:12.865 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:12.860+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:12.915 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:12.909+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:12.975 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:12.971+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:13.269 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:13.265+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:13.369 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:13.362+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:13.370 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:13.365+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:13.378 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:13.372+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:13.537 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:13.530+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:13.886 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:13.882+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:13.948 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:13.940+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:14.014 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:14.010+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:14.225 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:14.220+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:14.377 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:14.366+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:14.377 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:14.368+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:14.408 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:14.402+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:14.515 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:14.508+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:14.920 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:14.914+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:14.937 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:14.933+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:15.047 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:15.043+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:15.226 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:15.223+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:15.406 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:15.400+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:15.426 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:15.420+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:15.427 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:15.422+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:15.481 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:15.474+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:15.894 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:15.888+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:15.924 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:15.917+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:16.046 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:16.042+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:16.237 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:16.227+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:16.361 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:16.355+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:16.456 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:16.447+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:16.456 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:16.450+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:16.492 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:16.486+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:16.855 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:16.848+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:16.967 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:16.962+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:17.081 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:17.075+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:17.209 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:17.198+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:17.385 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:17.368+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:17.476 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:17.469+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:17.477 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:17.472+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:17.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:17.489+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:17.860 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:17.854+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:17.969 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:17.961+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:18.071 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:18.066+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:18.190 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:18.185+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:18.405 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:18.399+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:18.441 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:18.435+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:18.449 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:18.442+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:18.505 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:18.499+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:18.820 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:18.815+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:18.996 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:18.990+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:19.059 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:19.055+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:19.214 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:19.208+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:19.380 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:19.375+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:19.490 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:19.483+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:19.492 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:19.485+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:19.494 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:19.490+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:19.834 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:19.828+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:20.017 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:20.012+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:20.053 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:20.048+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:20.210 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:20.204+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:20.366 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:20.361+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:20.501 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:20.493+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:20.501 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:20.495+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:20.505 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:20.501+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:20.856 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:20.850+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:20.985 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:20.978+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:21.009 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:21.003+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:21.173 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:21.167+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:21.355 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:21.348+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:21.464 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:21.457+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:21.466 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:21.460+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:21.510 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:21.503+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:21.846 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:21.839+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:21.976 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:21.971+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:21.982 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:21.977+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:22.136 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:22.127+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:22.353 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:22.347+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:22.466 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:22.460+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:22.469 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:22.465+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:22.506 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:22.499+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:22.865 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:22.857+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:22.964 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:22.957+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:23.000 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:22.993+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:23.148 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:23.142+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:23.330 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:23.322+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:23.448 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:23.441+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:23.449 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:23.444+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:23.484 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:23.478+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:23.585 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:40:23.579+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e414 v414) 2019-12-09T19:40:23.895 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:23.889+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:23.951 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:23.946+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:24.030 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:24.023+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:24.150 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:24.144+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:24.370 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:24.364+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:24.488 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:24.482+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:24.491 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:24.486+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:24.528 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:24.521+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:24.882 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:24.876+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:24.944 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:24.936+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:25.058 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:25.052+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:25.197 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:25.193+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:25.341 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:25.335+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:25.543 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:25.530+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:25.543 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:25.535+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:25.544 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:25.538+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:25.837 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:25.831+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:25.990 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:25.985+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:26.060 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:26.041+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:26.228 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:26.222+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:26.333 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:26.327+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:26.508 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:26.501+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:26.509 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:26.504+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:26.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:26.512+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:26.833 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:26.826+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:26.975 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:26.967+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:27.006 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:27.001+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:27.229 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:27.213+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:27.301 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:27.292+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:27.521 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:27.514+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:27.558 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:27.552+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:27.569 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:27.558+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:27.860 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:27.852+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:28.023 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:28.018+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:28.047 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:28.042+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:28.241 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:28.236+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:28.351 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:28.344+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:28.536 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:28.530+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:28.590 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:28.582+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:28.590 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:28.586+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:28.610 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:40:28.604+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e414 v414) 2019-12-09T19:40:28.889 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:28.880+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:29.001 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:28.995+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:29.059 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:29.055+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:29.282 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:29.277+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:29.366 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:29.360+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:29.584 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:29.577+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:29.585 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:29.580+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:29.590 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:29.583+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:29.848 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:29.842+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:30.049 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:30.044+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:30.108 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:30.099+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:30.321 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:30.316+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:30.400 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:30.395+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:30.556 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:30.550+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:30.561 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:30.555+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:30.610 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:30.604+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:30.804 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:30.797+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:31.083 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:31.076+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:31.122 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:31.116+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:31.351 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:31.343+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:31.437 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:31.431+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:31.543 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:31.535+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:31.543 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:31.539+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:31.568 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:31.561+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:31.787 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:31.781+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:32.058 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:32.054+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:32.074 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:32.070+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:32.339 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:32.332+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:32.393 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:32.387+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:32.591 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:32.584+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:32.595 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:32.589+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:32.611 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:32.604+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:32.814 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:32.808+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:33.055 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:33.046+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:33.087 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:33.080+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:33.339 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:33.333+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:33.395 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:33.388+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:33.579 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:33.573+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:33.627 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:40:33.620+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e414 v414) 2019-12-09T19:40:33.654 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:33.641+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:33.654 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:33.645+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:33.870 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:33.864+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:34.103 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:34.098+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:34.125 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:34.117+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:34.375 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:34.370+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:34.433 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:34.426+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:34.606 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:34.600+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:34.679 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:34.674+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:34.681 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:34.678+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:34.904 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:34.897+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:35.080 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:35.073+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:35.110 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:35.103+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:35.330 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:35.325+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:35.457 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:35.451+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:35.586 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:35.580+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:35.686 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:35.678+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:35.687 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:35.681+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:35.947 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:35.940+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:36.043 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:36.034+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:36.095 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:36.090+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:36.292 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:36.286+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:36.468 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:36.462+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:36.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:36.579+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:36.705 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:36.698+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:36.707 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:36.701+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:36.927 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:36.921+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:37.064 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:37.059+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:37.139 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:40:37.133+0000 1694f700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.349514+0000 front 2019-12-09T19:39:08.388028+0000 (oldest deadline 2019-12-09T19:39:54.189531+0000) 2019-12-09T19:40:37.246 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:37.240+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:37.461 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:37.453+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:37.614 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:37.606+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:37.736 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:37.729+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:37.737 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:37.732+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:40:37.924 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:40:37.917+0000 1694f700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:11.009097+0000 front 2019-12-09T19:39:10.866507+0000 (oldest deadline 2019-12-09T19:39:54.344999+0000) 2019-12-09T19:40:38.022 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:40:38.018+0000 1694f700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:08.907660+0000 front 2019-12-09T19:39:09.082909+0000 (oldest deadline 2019-12-09T19:39:54.773709+0000) 2019-12-09T19:40:38.201 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:40:38.196+0000 1694f700 -1 osd.3 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:06.810792+0000 front 2019-12-09T19:39:07.145166+0000 (oldest deadline 2019-12-09T19:39:50.894230+0000) 2019-12-09T19:40:38.419 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:40:38.414+0000 1694f700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:09.095332+0000 front 2019-12-09T19:39:08.982111+0000 (oldest deadline 2019-12-09T19:39:51.817805+0000) 2019-12-09T19:40:38.586 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:40:38.580+0000 1694f700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:39:10.540645+0000 front 2019-12-09T19:39:10.455203+0000 (oldest deadline 2019-12-09T19:39:52.089881+0000) 2019-12-09T19:40:38.689 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:40:38.680+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e414 v414) 2019-12-09T19:40:38.729 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:38.722+0000 1694f700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:39:26.106792+0000 (oldest deadline 2019-12-09T19:40:06.106792+0000) 2019-12-09T19:40:38.730 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:40:38.725+0000 1694f700 -1 osd.6 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-12-09T19:41:09.598 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:41:09.537+0000 31786700 -1 osd.6 418 build_incremental_map_msg missing incremental map 418 2019-12-09T19:41:09.753 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:41:09.591+0000 31f87700 -1 osd.6 418 build_incremental_map_msg missing incremental map 418 2019-12-09T19:41:09.818 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:41:09.592+0000 31f87700 -1 osd.6 418 build_incremental_map_msg missing incremental map 418 2019-12-09T19:41:09.879 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:41:09.629+0000 31786700 -1 osd.6 418 build_incremental_map_msg missing incremental map 418 2019-12-09T19:41:09.886 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:41:09.662+0000 35f8f700 -1 osd.6 418 build_incremental_map_msg missing incremental map 418 2019-12-09T19:41:09.913 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:41:09.767+0000 32788700 -1 osd.6 418 build_incremental_map_msg missing incremental map 418 2019-12-09T19:41:40.074 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:36:01.132 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:41:40.093 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:36:01.143 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:41:40.096 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:36:01.153 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:41:40.100 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:36:01.158 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:41:40.110 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:36:01.144 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:41:40.122 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:36:01.157 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:41:40.318 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:36:01.376 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:41:40.326 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:36:01.385 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:41:40.506 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:36:01.541 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:09.969 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:09.965+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:10.169 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:10.162+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:10.955 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:10.948+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:11.144 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:11.141+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:11.525 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:11.520+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:11.906 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:11.902+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:12.150 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:12.146+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:12.480 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:12.475+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:12.776 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:12.772+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:12.918 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:12.914+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:12.944 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:12.940+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:13.107 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:13.103+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:13.164 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:13.159+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:13.502 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:13.497+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:13.817 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:13.814+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:13.906 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:13.903+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:13.977 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:13.974+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:14.153 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:14.149+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:14.156 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:14.152+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:14.517 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:14.512+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:14.781 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:14.776+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:14.870 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:14.864+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:14.907 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:14.904+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:14.969 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:14.964+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:15.159 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:15.156+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:15.193 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:15.185+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:15.490 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:15.483+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:15.772 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:15.769+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:15.905 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:15.900+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:15.919 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:15.916+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:15.992 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:15.989+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:16.146 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:16.143+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:16.161 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:16.157+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:16.462 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:16.457+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:16.816 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:16.811+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:16.895 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:16.891+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:16.896 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:16.892+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:17.030 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:17.027+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:17.118 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:17.114+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:17.128 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:17.124+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:17.455 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:17.450+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:17.865 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:17.860+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:17.874 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:17.871+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:17.949 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:17.944+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:18.002 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:17.998+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:18.095 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:18.091+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:18.168 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:18.163+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:18.509 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:18.501+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:18.862 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:18.858+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:18.912 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:18.908+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:18.923 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:18.919+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:19.005 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:19.001+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:19.105 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:19.098+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:19.207 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:19.197+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:19.506 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:19.501+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:19.884 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:19.879+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:19.887 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:19.881+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:19.901 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:19.892+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:20.039 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:20.032+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:20.146 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:20.142+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:20.212 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:20.207+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:20.494 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:20.486+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:20.871 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:20.867+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:20.883 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:20.878+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:20.887 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:20.883+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:21.040 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:21.036+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:21.145 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:21.139+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:21.250 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:21.245+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:21.506 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:21.500+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:21.828 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:21.825+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:21.900 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:21.895+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:21.916 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:21.912+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:22.060 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:22.056+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:22.126 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:22.121+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:22.284 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:22.280+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:22.549 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:22.544+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:22.803 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:22.799+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:22.877 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:22.872+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:22.953 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:22.949+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:23.067 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:23.063+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:23.085 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:23.081+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:23.337 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:23.332+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:23.570 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:23.564+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:23.818 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:23.813+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:23.897 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:23.891+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:23.942 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:23.938+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:24.077 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:24.072+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:24.129 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:24.122+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:24.369 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:24.363+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:24.586 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:24.564+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:24.775 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:24.771+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:24.865 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:24.861+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:24.995 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:24.991+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:25.078 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:25.073+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:25.159 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:25.153+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:25.418 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:25.411+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:25.572 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:25.564+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:25.829 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:25.823+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:25.852 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:25.847+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:25.996 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:25.989+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:26.048 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:26.043+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:26.203 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:26.199+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:26.421 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:26.416+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:26.601 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:26.591+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:26.783 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:26.778+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:26.824 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:26.819+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:27.006 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:27.001+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:27.009 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:27.005+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:27.254 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:27.249+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:27.470 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:27.465+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:27.645 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:27.634+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:27.801 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:27.795+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:27.859 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:27.853+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:27.994 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:27.990+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:28.047 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:28.042+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:28.273 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:28.262+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:28.444 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:28.439+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:28.614 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:28.609+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:28.839 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:28.833+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:28.852 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:28.845+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:28.950 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:28.944+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:29.029 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:29.024+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:29.228 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:29.223+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:29.472 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:29.467+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:29.593 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:29.581+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:29.874 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:29.868+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:29.892 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:29.886+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:29.998 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:29.993+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:30.061 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:30.055+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:30.211 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:30.205+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:30.504 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:30.496+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:30.607 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:30.602+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:30.885 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:30.877+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:30.909 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:30.903+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:31.049 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:31.044+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:31.059 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:31.054+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:31.233 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:31.228+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:31.468 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:31.463+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:31.597 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:31.592+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:31.846 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:31.842+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:31.869 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:31.865+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:32.068 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:32.061+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:32.093 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:32.087+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:32.232 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:32.227+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:32.443 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:32.435+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:32.589 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:32.585+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:32.816 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:32.811+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:32.827 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:32.822+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:33.055 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:33.050+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:33.117 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:33.112+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:33.241 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:33.236+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:33.450 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:33.444+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:33.625 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:33.621+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:33.787 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:33.778+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:33.847 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:33.843+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:34.076 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:34.072+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:34.108 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:34.098+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:34.246 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:34.238+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:34.494 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:34.488+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:34.670 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:34.665+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:34.779 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:34.772+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:34.839 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:34.827+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:35.042 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:35.037+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:35.128 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:35.117+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:35.220 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:35.213+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:35.518 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:35.513+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:35.704 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:35.698+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:35.797 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:35.792+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:35.813 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:35.809+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:36.026 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:36.021+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:36.115 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:36.110+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:36.265 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:36.260+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:36.575 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:36.569+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:36.682 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:36.675+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:36.754 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:36.749+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:36.775 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:36.769+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:37.010 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:37.005+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:37.139 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:37.134+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:37.296 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:37.290+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:37.586 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:37.580+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:37.639 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:37.633+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:37.761 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:37.755+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:37.801 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:37.796+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:37.970 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:37.965+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:38.162 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:38.157+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:38.348 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:38.339+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:38.559 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:38.554+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:38.638 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:38.633+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:38.799 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:38.794+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:38.805 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:38.799+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:39.003 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:38.996+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:39.162 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:39.158+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:39.342 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:39.338+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:39.559 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:39.554+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:39.598 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:39.593+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:39.818 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:39.814+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:39.819 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:39.814+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:39.979 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:39.973+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:40.159 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:40.152+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:40.345 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:40.338+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:40.541 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:40.534+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:40.605 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:40.600+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:40.787 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:40.782+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:40.813 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:40.808+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:40.983 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:40.978+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:41.127 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:41.122+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:41.338 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:41.331+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:41.565 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:41.561+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:41.568 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:41.563+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:41.803 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:41.799+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:41.828 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:41.821+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:41.982 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:41.976+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:42.145 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:42.141+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:42.361 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:42.355+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:42.548 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:42.542+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:42.589 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:42.581+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:42.811 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:42.806+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:42.817 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:42.812+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:43.019 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:43.008+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:43.129 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:43.122+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:43.366 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:43.361+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:43.529 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:43.521+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:43.613 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:43.608+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:43.769 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:43.763+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:43.834 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:43.826+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:44.002 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:43.993+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:44.105 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:42:44.100+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e419 v419) 2019-12-09T19:42:44.134 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:44.129+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:44.336 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:44.331+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:44.528 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:44.523+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:44.613 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:44.606+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:44.801 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:44.793+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:44.863 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:44.858+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:44.960 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:44.952+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:45.135 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:45.130+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:45.344 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:45.339+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:45.493 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:45.486+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:45.610 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:45.606+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:45.821 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:45.815+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:45.899 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:45.896+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:45.959 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:45.955+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:46.118 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:46.113+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:46.336 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:46.331+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:46.529 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:46.521+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:46.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:46.623+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:46.787 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:46.779+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:46.922 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:46.916+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:46.947 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:46.943+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:47.085 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:47.079+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:47.342 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:47.335+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:47.480 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:47.476+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:47.634 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:47.630+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:47.808 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:47.802+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:47.899 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:47.895+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:47.969 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:47.957+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:48.132 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:48.128+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:48.386 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:42:48.380+0000 1694f700 -1 osd.3 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.803312+0000 front 2019-12-09T19:41:30.334528+0000 (oldest deadline 2019-12-09T19:42:10.108335+0000) 2019-12-09T19:42:48.522 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:42:48.515+0000 1694f700 -1 osd.4 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.796089+0000 front 2019-12-09T19:41:27.800320+0000 (oldest deadline 2019-12-09T19:42:12.147905+0000) 2019-12-09T19:42:48.648 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:42:48.641+0000 1694f700 -1 osd.5 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:26.938574+0000 front 2019-12-09T19:41:27.377896+0000 (oldest deadline 2019-12-09T19:42:10.964557+0000) 2019-12-09T19:42:48.789 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:42:48.785+0000 1694f700 -1 osd.7 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.391879+0000 front 2019-12-09T19:41:27.984322+0000 (oldest deadline 2019-12-09T19:42:13.859743+0000) 2019-12-09T19:42:48.935 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:42:48.931+0000 1694f700 -1 osd.0 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:28.013722+0000 front 2019-12-09T19:41:28.178934+0000 (oldest deadline 2019-12-09T19:42:09.899995+0000) 2019-12-09T19:42:49.003 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:42:48.999+0000 1694f700 -1 osd.2 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:27.802095+0000 front 2019-12-09T19:41:27.482474+0000 (oldest deadline 2019-12-09T19:42:12.012747+0000) 2019-12-09T19:42:49.172 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:42:49.169+0000 1694f700 -1 osd.1 419 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:41:29.377026+0000 front 2019-12-09T19:41:29.378723+0000 (oldest deadline 2019-12-09T19:42:12.111009+0000) 2019-12-09T19:42:49.177 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:42:49.174+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e419 v419) 2019-12-09T19:42:54.487 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:37:15.545 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:54.509 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:37:15.568 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:54.585 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:37:15.644 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:54.593 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:37:15.628 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:54.595 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:37:15.654 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:54.598 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:37:15.632 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:54.607 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:37:15.666 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:54.671 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:37:15.728 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:54.683 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:37:15.718 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:43:48.125 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:43:48.119+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:43:48.989 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:43:48.983+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:43:49.131 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:43:49.125+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:43:49.172 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:43:49.166+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:43:49.444 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:43:49.435+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:43:50.021 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:43:50.016+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:43:50.098 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:43:50.092+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:43:50.121 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:43:50.114+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:43:50.192 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:43:50.187+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:43:50.463 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:43:50.455+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:43:51.050 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:43:51.045+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:43:51.095 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:43:51.087+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:43:51.133 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:43:51.122+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:43:51.176 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:43:51.170+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:43:51.497 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:43:51.487+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:43:51.914 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:43:51.909+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:43:52.021 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:43:52.016+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:43:52.085 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:43:52.080+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:43:52.092 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:43:52.086+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:43:52.216 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:43:52.211+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:43:52.479 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:43:52.470+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:43:52.953 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:43:52.949+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:43:52.993 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:43:52.990+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:43:53.047 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:43:53.041+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:43:53.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:43:53.129+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:43:53.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:43:53.260+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:43:53.517 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:43:53.508+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:43:53.939 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:43:53.935+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:43:53.998 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:43:53.995+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:43:54.038 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:43:54.031+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:43:54.170 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:43:54.165+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:43:54.233 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:43:54.229+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:43:54.566 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:43:54.556+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:43:54.897 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:43:54.893+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:43:54.955 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:43:54.952+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:43:55.087 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:43:55.079+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:43:55.159 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:43:55.154+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:43:55.273 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:43:55.264+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:43:55.614 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:43:55.607+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:43:55.898 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:43:55.893+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:43:56.004 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:43:55.984+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:43:56.055 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:43:56.041+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:43:56.159 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:43:56.154+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:43:56.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:43:56.226+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:43:56.636 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:43:56.627+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:43:56.857 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:43:56.851+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:43:57.014 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:43:57.011+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:43:57.021 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:43:57.015+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:43:57.208 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:43:57.203+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:43:57.216 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:43:57.208+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:43:57.620 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:43:57.614+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:43:57.876 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:43:57.872+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:43:57.996 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:43:57.989+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:43:58.068 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:43:58.063+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:43:58.185 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:43:58.181+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:43:58.218 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:43:58.212+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:43:58.477 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:43:58.472+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:43:58.647 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:43:58.641+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:43:58.845 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:43:58.841+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:43:58.992 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:43:58.987+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:43:59.110 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:43:59.106+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:43:59.155 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:43:59.151+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:43:59.228 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:43:59.222+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:43:59.500 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:43:59.495+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:43:59.643 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:43:59.637+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:43:59.806 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:43:59.802+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:43:59.962 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:43:59.948+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:00.102 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:00.097+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:00.194 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:00.190+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:00.257 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:00.252+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:00.505 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:00.500+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:00.668 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:00.662+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:00.783 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:00.779+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:00.995 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:00.989+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:01.087 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:01.083+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:01.200 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:01.196+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:01.256 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:01.251+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:01.532 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:01.527+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:01.659 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:01.653+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:01.783 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:01.779+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:02.031 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:02.026+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:02.136 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:02.131+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:02.160 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:02.156+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:02.296 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:02.290+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:02.490 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:02.485+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:02.699 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:02.693+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:02.778 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:02.774+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:03.048 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:03.042+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:03.166 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:03.163+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:03.180 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:03.176+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:03.348 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:03.341+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:03.543 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:03.536+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:03.544 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:03.539+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:03.676 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:03.671+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:03.763 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:03.760+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:04.049 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:04.043+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:04.145 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:04.142+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:04.161 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:04.154+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:04.328 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:04.322+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:04.538 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:04.531+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:04.541 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:04.535+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:04.704 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:04.698+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:04.783 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:04.779+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:05.014 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:05.006+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:05.179 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:05.175+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:05.193 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:05.188+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:05.379 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:05.374+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:05.570 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:05.562+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:05.572 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:05.566+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:05.689 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:05.683+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:05.766 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:05.763+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:06.065 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:06.059+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:06.166 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:06.163+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:06.193 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:06.187+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:06.426 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:06.420+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:06.617 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:06.609+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:06.618 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:06.613+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:06.674 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:06.668+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:06.791 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:06.787+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:07.038 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:07.032+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:07.173 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:07.168+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:07.225 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:07.220+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:07.474 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:07.468+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:07.646 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:07.640+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:07.648 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:07.643+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:07.692 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:07.686+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:07.756 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:07.749+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:08.025 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:08.019+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:08.133 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:08.125+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:08.201 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:08.196+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:08.502 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:08.496+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:08.656 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:08.649+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:08.657 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:08.652+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:08.676 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:08.670+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:08.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:08.704+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:09.005 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:08.994+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:09.184 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:09.177+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:09.204 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:09.200+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:09.502 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:09.496+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:09.654 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:09.646+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:09.657 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:09.650+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:09.712 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:09.706+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:09.752 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:09.749+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:09.979 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:09.972+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:10.189 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:10.185+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:10.211 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:10.206+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:10.468 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:10.462+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:10.635 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:10.629+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:10.639 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:10.635+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:10.751 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:10.745+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:10.759 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:10.752+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:10.980 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:10.973+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:11.174 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:11.170+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:11.178 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:11.173+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:11.473 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:11.467+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:11.654 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:11.647+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:11.656 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:11.650+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:11.730 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:11.724+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:11.745 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:11.740+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:12.048 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:12.023+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:12.163 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:12.159+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:12.208 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:12.201+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:12.484 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:12.476+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:12.678 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:12.670+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:12.679 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:12.673+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:12.701 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:44:12.697+0000 1694f700 -1 osd.1 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:06.572048+0000 front 2019-12-09T19:43:06.573992+0000 (oldest deadline 2019-12-09T19:43:51.028102+0000) 2019-12-09T19:44:12.758 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:12.752+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:13.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:13.050+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:13.139 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:13.134+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:13.166 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:13.161+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:13.483 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:13.477+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:13.718 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:13.707+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:13.718 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:13.710+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:13.810 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:13.804+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:14.074 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:14.068+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:14.095 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:14.092+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:14.179 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:14.171+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:14.452 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:14.445+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:14.747 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:14.741+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:14.750 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:14.746+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:14.829 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:14.822+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:15.047 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:15.041+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:15.132 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:15.128+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:15.144 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:15.139+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:15.485 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:15.479+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:15.773 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:15.765+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:15.774 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:15.769+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:15.810 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:15.800+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:16.019 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:16.013+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:16.106 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:16.101+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:16.129 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:16.124+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:16.446 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:16.439+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:16.759 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:16.751+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:16.760 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:16.755+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:16.812 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:16.804+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:16.976 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:16.969+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:17.155 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:17.151+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:17.164 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:17.161+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:17.443 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:17.437+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:17.779 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:17.771+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:17.787 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:17.774+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:17.844 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:17.837+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:17.935 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:17.928+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:18.122 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:18.119+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:18.187 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:18.182+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:18.401 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:18.395+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:18.797 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:18.791+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:18.800 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:18.796+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:18.851 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:18.845+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:18.902 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:18.895+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:19.114 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:19.110+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:19.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:19.225+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:19.436 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:19.430+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:19.728 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:44:19.721+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e425 v425) 2019-12-09T19:44:19.818 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:19.811+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:19.841 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:19.836+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:19.844 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:19.840+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:19.913 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:19.908+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:20.093 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:20.087+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:20.204 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:20.198+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:20.448 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:20.442+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:20.807 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:20.801+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:20.866 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:20.859+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:20.867 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:20.862+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:20.897 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:20.891+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:21.138 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:21.134+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:21.182 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:21.179+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:21.443 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:21.437+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:21.851 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:21.844+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:21.852 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:21.846+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:21.898 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:21.891+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:21.899 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:21.894+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:22.124 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:22.119+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:22.182 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:22.177+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:22.486 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:22.479+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:22.828 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:22.821+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:22.888 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:22.882+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:22.893 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:22.888+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:22.896 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:22.890+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:23.123 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:23.119+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:23.145 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:23.139+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:23.461 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:23.455+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:23.845 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:23.839+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:23.845 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:23.841+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:23.878 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:23.866+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:23.887 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:23.882+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:24.117 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:24.113+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:24.173 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:24.170+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:24.483 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:24.474+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:24.734 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:44:24.731+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e425 v425) 2019-12-09T19:44:24.827 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:24.820+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:24.827 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:24.823+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:24.915 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:24.908+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:24.931 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:24.926+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:25.158 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:25.154+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:25.198 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:25.194+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:25.498 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:25.492+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:25.807 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:25.800+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:25.808 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:25.803+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:25.891 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:25.885+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:25.944 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:25.937+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:26.128 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:26.124+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:26.218 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:26.214+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:26.489 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:26.482+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:26.763 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:26.757+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:26.767 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:26.763+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:26.925 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:26.918+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:26.958 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:26.952+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:27.086 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:27.082+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:27.249 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:27.244+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:27.517 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:27.512+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:27.774 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:27.767+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:27.775 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:27.770+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:27.961 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:27.952+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:27.977 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:27.970+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:28.067 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:28.063+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:28.294 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:28.290+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:28.493 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:28.487+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:28.814 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:28.807+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:28.815 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:28.811+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:28.923 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:28.916+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:29.019 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:29.013+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:29.093 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:29.088+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:29.292 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:29.287+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:29.521 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:29.515+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:29.757 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:44:29.754+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e425 v425) 2019-12-09T19:44:29.866 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:29.861+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:29.868 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:29.863+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:29.893 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:29.883+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:30.010 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:30.005+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:30.085 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:30.080+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:30.269 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:30.263+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:30.575 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:30.569+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:30.829 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:30.822+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:30.831 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:30.825+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:30.867 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:30.860+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:31.039 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:31.034+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:31.098 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:31.094+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:31.316 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:31.312+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:31.564 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:31.559+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:31.789 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:31.783+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:31.793 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:31.789+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:31.837 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:31.830+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:32.018 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:32.013+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:32.138 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:32.135+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:32.362 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:32.357+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:32.526 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:32.520+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:32.805 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:32.798+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:32.807 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:32.802+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:32.842 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:32.836+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:32.992 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:32.986+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:33.154 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:33.150+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:33.407 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:33.402+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:33.555 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:33.548+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:33.817 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:33.805+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:33.820 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:33.814+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:33.840 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:33.833+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:34.024 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:44:34.011+0000 1694f700 -1 osd.5 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:04.782295+0000 front 2019-12-09T19:43:04.755135+0000 (oldest deadline 2019-12-09T19:43:48.233003+0000) 2019-12-09T19:44:34.125 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:34.118+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:44:34.393 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:44:34.387+0000 1694f700 -1 osd.3 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.767583+0000 front 2019-12-09T19:43:03.818625+0000 (oldest deadline 2019-12-09T19:43:47.571787+0000) 2019-12-09T19:44:34.531 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:44:34.523+0000 1694f700 -1 osd.4 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:05.039714+0000 front 2019-12-09T19:43:04.733173+0000 (oldest deadline 2019-12-09T19:43:49.398725+0000) 2019-12-09T19:44:34.802 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:44:34.798+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e425 v425) 2019-12-09T19:44:34.823 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:44:34.818+0000 1694f700 -1 osd.7 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.416740+0000 front 2019-12-09T19:43:03.321174+0000 (oldest deadline 2019-12-09T19:43:48.988183+0000) 2019-12-09T19:44:34.873 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:34.856+0000 1694f700 -1 osd.6 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:43:23.062600+0000 (oldest deadline 2019-12-09T19:44:03.062600+0000) 2019-12-09T19:44:34.873 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:44:34.858+0000 1694f700 -1 osd.6 425 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e423) 2019-12-09T19:44:35.078 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:44:35.073+0000 1694f700 -1 osd.2 425 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:43:03.766753+0000 front 2019-12-09T19:43:03.745837+0000 (oldest deadline 2019-12-09T19:43:48.150272+0000) 2019-12-09T19:45:08.528 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:45:08.448+0000 3578e700 -1 osd.0 430 build_incremental_map_msg missing incremental map 430 2019-12-09T19:45:09.144 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:45:09.072+0000 32788700 -1 osd.0 430 build_incremental_map_msg missing incremental map 430 2019-12-09T19:45:09.145 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:45:09.075+0000 32788700 -1 osd.0 430 build_incremental_map_msg missing incremental map 430 2019-12-09T19:45:10.380 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:45:10.317+0000 36f91700 -1 osd.0 430 build_incremental_map_msg missing incremental map 430 2019-12-09T19:45:44.226 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:40:05.284 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:44.236 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:40:05.295 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:44.249 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:40:05.280 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:44.251 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:40:05.285 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:44.252 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:40:05.310 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:44.261 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:40:05.315 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:44.424 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:40:05.483 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:44.515 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:40:05.573 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:44.550 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:40:05.584 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:50.330 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:40:11.389 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:50.337 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:40:11.396 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:50.344 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:40:11.403 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:50.347 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:40:11.406 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:50.350 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:40:11.385 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:50.354 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:40:11.413 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:50.359 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:40:11.394 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:50.371 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:40:11.430 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:50.387 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:40:11.420 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:46:06.123 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:06.118+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:07.133 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:07.128+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:08.087 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:08.084+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:08.277 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:08.272+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:09.140 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:09.137+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:09.264 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:09.259+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:09.833 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:09.822+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:10.094 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:10.089+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:10.121 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:10.116+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:10.245 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:10.237+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:10.421 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:10.418+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:10.803 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:10.798+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:11.102 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:11.097+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:11.120 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:11.116+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:11.281 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:11.276+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:11.448 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:11.444+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:11.765 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:11.761+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:11.793 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:11.789+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:12.085 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:12.080+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:12.094 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:12.090+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:12.257 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:12.254+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:12.267 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:12.262+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:12.406 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:12.402+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:12.757 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:12.749+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:12.815 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:12.809+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:13.089 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:13.078+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:13.124 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:13.121+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:13.229 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:13.224+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:13.253 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:13.248+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:13.437 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:13.433+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:13.788 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:13.782+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:13.804 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:13.799+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:14.054 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:14.049+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:14.102 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:14.098+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:14.256 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:14.250+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:14.289 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:14.283+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:14.457 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:14.453+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:14.817 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:14.814+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:14.829 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:14.823+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:15.056 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:15.052+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:15.088 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:15.081+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:15.260 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:15.255+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:15.287 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:15.281+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:15.420 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:15.416+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:15.782 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:15.779+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:15.787 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:15.783+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:16.053 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:16.050+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:16.070 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:16.065+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:16.251 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:16.242+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:16.282 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:16.276+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:16.433 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:16.429+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:16.761 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:16.756+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:16.788 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:16.784+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:17.081 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:17.069+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:17.105 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:17.101+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:17.217 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:17.212+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:17.313 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:17.308+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:17.462 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:17.459+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:17.756 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:17.752+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:17.819 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:17.816+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:18.074 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:18.069+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:18.129 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:18.123+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:18.181 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:18.176+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:18.268 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:18.262+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:18.491 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:18.487+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:18.741 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:18.738+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:18.804 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:18.801+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:19.116 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:19.112+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:19.148 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:19.145+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:19.191 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:19.186+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:19.231 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:19.227+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:19.542 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:19.534+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:19.705 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:19.698+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:19.793 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:19.789+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:20.074 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:20.069+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:20.110 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:20.106+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:20.233 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:20.229+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:20.263 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:20.257+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:20.503 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:20.499+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:20.681 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:20.657+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:20.824 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:20.820+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:21.078 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:21.074+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:21.082 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:21.078+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:21.278 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:21.273+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:21.287 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:21.283+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:21.512 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:21.505+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:21.631 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:21.627+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:21.818 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:21.814+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:22.074 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:22.070+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:22.093 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:22.085+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:22.317 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:22.307+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:22.340 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:22.335+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:22.478 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:22.474+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:22.633 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:22.628+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:22.794 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:22.784+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:23.048 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:23.044+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:23.075 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:23.069+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:23.271 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:23.266+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:23.358 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:23.354+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:23.462 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:23.458+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:23.645 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:23.641+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:23.835 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:23.831+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:24.020 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:24.015+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:24.040 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:24.036+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:24.291 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:24.285+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:24.353 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:24.348+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:24.422 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:24.417+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:24.602 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:24.598+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:24.804 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:24.800+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:25.003 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:24.999+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:25.073 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:25.069+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:25.275 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:25.269+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:25.355 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:25.350+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:25.396 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:25.388+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:25.644 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:25.641+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:25.788 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:25.784+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:26.016 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:26.013+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:26.081 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:26.065+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:26.310 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:26.305+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:26.314 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:26.309+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:26.387 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:26.383+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:26.686 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:26.682+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:26.823 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:26.817+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:27.013 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:26.981+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:27.115 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:27.110+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:27.292 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:27.282+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:27.297 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:27.289+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:27.438 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:27.435+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:27.643 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:27.639+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:27.868 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:27.865+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:27.975 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:27.970+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:28.098 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:28.093+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:28.256 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:28.252+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:28.318 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:28.314+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:28.407 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:28.403+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:28.607 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:28.603+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:28.891 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:28.884+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:28.956 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:28.953+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:29.107 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:29.099+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:29.269 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:29.256+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:29.309 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:29.298+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:29.402 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:29.398+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:29.578 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:29.560+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:29.875 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:29.871+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:29.958 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:29.955+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:30.139 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:30.135+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:30.294 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:30.289+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:30.340 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:30.334+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:30.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:30.422+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:30.582 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:30.579+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:30.892 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:30.889+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:30.978 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:30.975+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:31.194 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:31.188+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:31.254 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:31.249+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:31.326 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:31.320+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:31.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:31.413+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:31.618 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:31.613+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:31.876 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:31.872+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:31.954 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:31.950+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:32.149 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:32.144+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:32.226 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:32.222+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:32.296 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:32.292+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:32.373 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:32.368+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:32.647 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:32.643+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:32.879 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:32.875+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:32.945 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:32.942+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:33.155 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:33.151+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:33.257 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:33.253+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:33.297 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:33.291+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:33.368 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:33.361+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:33.689 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:33.684+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:33.841 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:33.837+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:33.944 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:33.941+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:34.162 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:34.157+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:34.223 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:34.218+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:34.315 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:34.310+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:34.400 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:34.394+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:34.738 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:34.735+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:34.829 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:34.824+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:34.934 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:34.930+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:35.173 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:35.166+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:35.187 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:35.181+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:35.365 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:35.359+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:35.376 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:35.372+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:35.778 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:35.774+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:35.884 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:35.877+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:35.963 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:35.959+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:36.164 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:36.159+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:36.199 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:36.195+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:36.379 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:36.373+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:36.401 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:36.393+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:36.790 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:36.785+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:36.929 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:36.920+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:36.950 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:36.943+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:37.150 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:37.144+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:37.162 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:37.156+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:37.342 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:37.338+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:37.428 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:37.423+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:37.774 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:37.769+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:37.907 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:37.902+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:37.954 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:37.951+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:38.117 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:38.112+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:38.184 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:38.177+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:38.313 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:38.309+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:38.470 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:38.463+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:38.799 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:38.796+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:38.944 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:38.940+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:38.944 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:38.940+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:39.079 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:39.074+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:39.218 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:39.212+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:39.275 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:39.271+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:39.481 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:39.470+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:39.803 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:39.799+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:39.954 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:39.950+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:40.049 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:39.978+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:40.078 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:40.073+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:40.179 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:40.173+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:40.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:40.260+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:40.454 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:40.449+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:40.459 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:46:40.456+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 49sec e430 v430) 2019-12-09T19:46:40.778 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:40.774+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:40.994 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:40.989+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:41.028 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:41.024+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:41.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:41.061+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:41.221 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:41.216+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:41.258 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:41.253+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:41.509 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:41.502+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:41.801 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:41.796+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:41.965 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:41.962+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:42.064 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:42.059+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:42.075 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:42.072+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:42.199 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:42.192+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:42.285 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:42.280+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:42.478 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:42.473+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:42.856 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:42.850+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:42.999 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:42.994+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:43.023 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:43.013+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:43.063 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:43.058+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:43.237 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:43.232+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:43.249 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:43.238+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:43.462 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:43.457+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:43.864 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:43.854+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:43.969 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:43.962+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:44.020 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:44.013+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:44.021 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:44.016+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:44.243 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:44.233+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:44.249 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:44.245+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:44.477 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:44.468+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:44.911 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:46:44.906+0000 1694f700 -1 osd.2 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.915370+0000 front 2019-12-09T19:45:26.452428+0000 (oldest deadline 2019-12-09T19:46:10.813171+0000) 2019-12-09T19:46:44.981 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:46:44.976+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:24.507342+0000 front 2019-12-09T19:45:24.764350+0000 (oldest deadline 2019-12-09T19:46:09.698208+0000) 2019-12-09T19:46:44.993 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:46:44.985+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.800920+0000 front 2019-12-09T19:45:25.923955+0000 (oldest deadline 2019-12-09T19:46:09.273758+0000) 2019-12-09T19:46:45.018 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:46:45.013+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:20.809931+0000 front 2019-12-09T19:45:20.862561+0000 (oldest deadline 2019-12-09T19:46:06.103745+0000) 2019-12-09T19:46:45.259 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:46:45.250+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.276612+0000 front 2019-12-09T19:45:25.243507+0000 (oldest deadline 2019-12-09T19:46:09.780929+0000) 2019-12-09T19:46:45.298 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:46:45.294+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:26.319314+0000 front 2019-12-09T19:45:24.954994+0000 (oldest deadline 2019-12-09T19:46:08.264955+0000) 2019-12-09T19:46:45.453 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:46:45.447+0000 1694f700 -1 osd.5 430 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:45:25.623744+0000 front 2019-12-09T19:45:25.785886+0000 (oldest deadline 2019-12-09T19:46:11.317302+0000) 2019-12-09T19:46:45.540 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:46:45.530+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 49sec e430 v430) 2019-12-09T19:47:23.632 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:23.611+0000 3378a700 -1 osd.6 435 build_incremental_map_msg missing incremental map 435 2019-12-09T19:47:23.841 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:23.806+0000 38794700 -1 osd.6 435 build_incremental_map_msg missing incremental map 435 2019-12-09T19:47:23.899 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:23.865+0000 31786700 -1 osd.6 435 build_incremental_map_msg missing incremental map 435 2019-12-09T19:47:23.967 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:23.885+0000 32788700 -1 osd.6 435 build_incremental_map_msg missing incremental map 435 2019-12-09T19:47:23.984 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:23.909+0000 35f8f700 -1 osd.6 435 build_incremental_map_msg missing incremental map 435 2019-12-09T19:47:43.561 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:43.556+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:44.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:44.247+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:44.418 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:44.413+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:44.571 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:44.564+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:44.613 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:44.609+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:44.773 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:44.766+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:45.221 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:45.215+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:45.283 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:45.277+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:45.448 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:45.443+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:45.603 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:45.596+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:45.631 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:45.627+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:45.770 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:45.764+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:46.271 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:46.265+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:46.283 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:46.279+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:46.427 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:46.422+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:46.607 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:46.599+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:46.659 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:46.653+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:46.797 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:46.787+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:47.281 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:47.276+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:47.282 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:47.276+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:47.434 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:47.427+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:47.578 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:47.572+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:47.676 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:47.671+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:47.825 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:47.819+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:48.289 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:48.282+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:48.296 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:48.290+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:48.484 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:48.479+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:48.561 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:48.556+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:48.706 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:48.701+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:48.860 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:48.854+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:49.305 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:49.298+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:49.337 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:49.331+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:49.471 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:49.465+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:49.532 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:49.525+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:49.741 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:49.732+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:49.905 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:49.899+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:50.341 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:50.334+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:50.391 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:50.380+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:50.428 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:50.423+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:50.549 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:50.542+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:50.700 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:50.695+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:50.921 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:50.915+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:51.357 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:51.350+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:51.386 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:51.381+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:51.461 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:51.456+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:51.517 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:51.505+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:51.725 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:51.720+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:51.884 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:51.878+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:52.384 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:52.377+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:52.384 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:52.378+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:52.465 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:52.460+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:52.476 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:52.469+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:52.682 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:52.678+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:52.878 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:52.872+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:53.350 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:53.345+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:53.410 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:53.404+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:53.479 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:53.472+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:53.500 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:53.492+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:53.678 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:53.670+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:53.702 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:53.697+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:47:53.879 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:53.873+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:54.370 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:54.364+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:54.384 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:54.378+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:54.490 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:54.485+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:54.493 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:54.487+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:54.687 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:54.682+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:47:54.717 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:54.710+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:54.834 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:54.828+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:55.338 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:55.331+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:55.404 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:55.399+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:55.452 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:55.448+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:55.511 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:55.506+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:55.686 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:55.681+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:55.728 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:55.721+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:47:55.806 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:55.801+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:56.333 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:56.327+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:56.382 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:56.375+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:56.494 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:56.489+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:56.546 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:56.539+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:56.720 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:56.715+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:47:56.739 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:56.729+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:56.770 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:56.765+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:57.373 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:57.367+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:57.375 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:57.370+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:57.470 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:57.463+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:57.559 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:57.553+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:57.701 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:57.696+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:47:57.704 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:57.696+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:57.755 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:57.749+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:58.372 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:58.366+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:58.378 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:58.375+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:58.452 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:58.446+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:58.549 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:58.543+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:58.679 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:58.674+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:58.743 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:58.737+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:47:58.745 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:58.739+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:47:59.337 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:47:59.331+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:47:59.343 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:47:59.338+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:47:59.463 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:47:59.456+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:47:59.569 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:47:59.563+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:47:59.649 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:47:59.642+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:47:59.704 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:59.695+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:47:59.705 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:47:59.698+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:47:59.733 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:47:59.727+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:00.337 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:00.331+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:00.377 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:00.372+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:00.428 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:00.423+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:00.605 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:00.598+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:00.606 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:00.601+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:00.718 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:00.711+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:00.719 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:00.714+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:00.732 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:00.725+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:01.297 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:01.290+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:01.358 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:01.348+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:01.453 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:01.441+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:01.573 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:01.568+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:01.640 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:01.627+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:01.744 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:01.728+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:01.767 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:01.761+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:01.768 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:01.763+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:02.302 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:02.295+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:02.397 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:02.391+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:02.488 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:02.482+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:02.540 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:02.534+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:02.598 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:02.591+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:02.689 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:02.683+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:02.804 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:02.791+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:02.804 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:02.795+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:03.259 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:03.253+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:03.447 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:03.441+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:03.495 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:03.490+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:03.582 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:03.576+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:03.593 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:03.587+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:03.694 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:03.686+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:03.783 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:03.776+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:03.791 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:03.784+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:04.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:04.301+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:04.459 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:04.454+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:04.465 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:04.461+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:04.633 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:04.627+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:04.640 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:04.635+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:04.701 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:04.695+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:04.760 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:04.755+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:04.763 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:04.759+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:05.306 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:05.299+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:05.447 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:05.439+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:05.476 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:05.469+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:05.629 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:05.615+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:05.664 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:05.655+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:05.670 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:05.662+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:05.764 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:05.757+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:05.765 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:05.760+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:06.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:06.301+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:06.460 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:06.453+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:06.530 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:06.524+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:06.652 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:06.645+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:06.664 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:06.658+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:06.690 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:06.684+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:06.737 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:06.729+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:06.740 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:06.735+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:07.299 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:07.293+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:07.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:07.477+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:07.486 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:07.481+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:07.660 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:07.654+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:07.700 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:07.692+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:07.703 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:07.693+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:07.703 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:07.698+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:07.704 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:07.695+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:08.322 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:08.316+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:08.502 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:08.497+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:08.521 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:08.517+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:08.654 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:08.647+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:08.690 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:08.682+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:08.690 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:08.685+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:08.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:08.714+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:08.754 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:08.748+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:09.375 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:09.368+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:09.516 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:09.510+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:09.545 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:09.529+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:09.702 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:09.697+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:09.732 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:09.725+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:09.733 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:09.728+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:09.746 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:09.740+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:09.783 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:09.778+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:10.404 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:10.396+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:10.507 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:10.504+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:10.565 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:10.560+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:10.723 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:10.716+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:10.730 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:10.723+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:10.760 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:10.753+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:10.781 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:10.773+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:10.782 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:10.776+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:11.419 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:11.412+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:11.557 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:11.551+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:11.557 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:11.553+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:11.733 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:11.716+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:11.737 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:11.731+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:11.792 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:11.788+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:11.794 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:11.787+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:11.795 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:11.790+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:12.430 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:12.422+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:12.551 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:12.544+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:12.584 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:12.579+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:12.741 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:12.735+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:12.764 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:12.758+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:12.787 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:12.783+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:12.838 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:12.828+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:12.840 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:12.831+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:13.429 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:13.420+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:13.567 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:13.560+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:13.576 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:13.572+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:13.723 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:13.715+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:13.743 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:13.738+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:13.818 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:13.812+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:13.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:13.846+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:13.854 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:13.849+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:14.395 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:14.386+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:14.608 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:14.601+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:14.625 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:14.616+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:14.715 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:14.709+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:14.733 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:14.727+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:14.828 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:14.823+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:14.887 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:14.881+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:14.889 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:14.884+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:15.363 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:15.357+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:15.569 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:15.565+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:15.610 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:15.604+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:15.737 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:15.730+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:15.769 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:15.763+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:15.779 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:48:15.771+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 41sec e436 v436) 2019-12-09T19:48:15.837 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:15.832+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:15.928 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:15.920+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:15.929 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:15.922+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:16.345 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:16.336+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:16.607 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:16.603+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:16.646 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:16.631+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:16.759 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:16.748+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:16.773 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:16.766+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:16.884 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:16.877+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:16.900 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:16.892+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:16.900 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:16.895+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:17.347 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:17.340+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:17.600 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:17.597+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:17.643 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:17.635+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:17.725 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:17.719+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:17.763 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:17.757+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:17.875 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:17.869+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:17.879 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:17.874+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:17.889 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:17.885+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:18.349 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:18.342+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:18.625 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:18.619+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:18.649 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:18.644+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:18.744 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:18.738+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:18.765 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:18.758+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:18.907 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:18.899+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:18.907 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:18.902+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:18.922 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:18.918+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:19.340 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:19.334+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:19.589 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:19.583+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:19.701 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:19.696+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:19.777 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:19.766+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:19.777 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:19.766+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:19.915 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:19.912+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:19.929 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:19.924+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:19.932 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:19.928+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:20.345 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:20.338+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:20.588 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:20.580+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:20.687 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:20.682+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:20.764 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:20.756+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:20.786 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:48:20.781+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 41sec e436 v436) 2019-12-09T19:48:20.815 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:20.808+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:20.911 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:20.906+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:20.912 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:20.908+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:20.953 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:20.950+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:21.391 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:21.385+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:21.613 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:21.609+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:21.683 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:21.678+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:21.740 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:21.732+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:21.825 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:21.819+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:21.891 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:21.885+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:21.892 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:21.888+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:21.922 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:21.918+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:22.412 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:22.406+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:22.605 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:22.600+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:22.674 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:22.671+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:22.748 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:22.742+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:22.873 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:22.868+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:22.897 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:22.889+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:22.897 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:22.891+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:22.972 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:22.967+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:23.432 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:23.424+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:23.640 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:23.635+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:23.691 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:23.680+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:23.769 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:23.764+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:23.840 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:23.834+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:23.865 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:23.859+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:23.865 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:23.861+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:24.014 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:24.010+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:24.438 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:24.432+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:24.662 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:24.658+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:24.683 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:24.678+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:24.783 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:24.777+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:24.844 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:24.837+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:24.858 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:24.843+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:24.874 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:24.867+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:24.983 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:24.979+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:25.443 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:25.432+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:25.642 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:25.637+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:25.660 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:25.653+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:25.769 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:25.759+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:25.798 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:48:25.793+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 41sec e436 v436) 2019-12-09T19:48:25.865 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:25.859+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:25.893 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:25.885+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:25.896 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:25.890+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:25.981 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:25.977+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:26.397 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:26.387+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:26.681 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:26.677+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:26.695 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:26.691+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:26.729 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:26.721+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:26.896 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:26.890+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:26.945 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:26.937+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:26.945 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:26.940+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:26.998 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:26.990+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:27.373 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:27.368+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:27.634 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:27.630+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:27.657 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:27.654+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:27.741 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:27.732+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:27.944 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:27.937+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:27.983 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:27.976+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:27.987 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:27.979+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:28.021 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:28.009+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:28.355 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:28.349+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:28.618 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:28.613+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:28.674 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:28.667+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:28.721 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:28.711+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:28.930 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:28.925+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:28.949 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:28.940+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:28.951 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:28.943+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:29.039 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:29.035+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:29.375 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:29.368+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:29.585 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:29.580+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:29.706 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:29.700+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:29.765 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:29.759+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:29.958 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:29.947+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:29.991 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:29.984+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:29.994 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:29.990+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:30.059 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:30.055+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:30.333 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:30.327+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:30.614 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:30.609+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:30.751 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:30.744+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:30.754 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:30.750+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:30.816 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:48:30.809+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 41sec e436 v436) 2019-12-09T19:48:30.934 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:30.926+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:30.959 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:30.952+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:30.960 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:30.955+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:31.038 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:31.033+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:31.336 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:31.329+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:31.611 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:31.605+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:31.718 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:31.711+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:31.773 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:31.769+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:31.946 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:31.940+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:31.994 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:31.988+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:31.997 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:31.993+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:32.079 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:32.075+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:32.326 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:32.316+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:32.615 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:32.610+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:32.687 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:32.681+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:32.797 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:32.794+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:32.926 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:32.920+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:32.968 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:32.960+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:32.970 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:32.963+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:33.061 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:33.058+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:33.335 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:33.329+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:33.647 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:33.641+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:33.665 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:33.661+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:33.768 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:33.764+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:33.962 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:33.954+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:33.965 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:33.960+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:33.977 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:33.970+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:34.040 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:34.035+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:34.331 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:34.325+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:34.608 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:34.602+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:34.675 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:34.670+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:34.817 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:34.813+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:34.934 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:34.928+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:34.938 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:34.934+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:34.998 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:34.991+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:35.016 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:35.011+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:35.368 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:48:35.362+0000 1694f700 -1 osd.7 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.133224+0000 front 2019-12-09T19:46:59.093433+0000 (oldest deadline 2019-12-09T19:47:43.779820+0000) 2019-12-09T19:48:35.597 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:48:35.591+0000 1694f700 -1 osd.4 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.318839+0000 front 2019-12-09T19:47:02.288350+0000 (oldest deadline 2019-12-09T19:47:43.970053+0000) 2019-12-09T19:48:35.697 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:48:35.694+0000 1694f700 -1 osd.3 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.865342+0000 front 2019-12-09T19:46:59.864550+0000 (oldest deadline 2019-12-09T19:47:43.889055+0000) 2019-12-09T19:48:35.847 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:48:35.842+0000 1694f700 -1 osd.2 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:59.869323+0000 front 2019-12-09T19:47:00.035164+0000 (oldest deadline 2019-12-09T19:47:45.138923+0000) 2019-12-09T19:48:35.866 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:48:35.858+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 41sec e436 v436) 2019-12-09T19:48:35.957 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:35.948+0000 1694f700 -1 osd.6 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:47:19.172031+0000 (oldest deadline 2019-12-09T19:47:59.172031+0000) 2019-12-09T19:48:35.958 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:35.953+0000 1694f700 -1 osd.6 436 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:116594 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e434) 2019-12-09T19:48:35.991 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:48:35.985+0000 1694f700 -1 osd.1 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:46:58.358563+0000 front 2019-12-09T19:46:58.229279+0000 (oldest deadline 2019-12-09T19:47:42.879825+0000) 2019-12-09T19:48:36.020 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:48:36.009+0000 1694f700 -1 osd.5 436 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:47:02.815206+0000 front 2019-12-09T19:47:03.190112+0000 (oldest deadline 2019-12-09T19:47:44.425928+0000) 2019-12-09T19:48:36.713 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:48:36.704+0000 34f8d700 -1 osd.6 437 build_incremental_map_msg missing incremental map 435 2019-12-09T19:49:03.349 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:49:03.210+0000 35f8f700 -1 osd.0 442 build_incremental_map_msg missing incremental map 442 2019-12-09T19:49:03.676 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:49:03.617+0000 34f8d700 -1 osd.0 442 build_incremental_map_msg missing incremental map 442 2019-12-09T19:49:04.634 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:49:04.564+0000 36f91700 -1 osd.0 442 build_incremental_map_msg missing incremental map 442 2019-12-09T19:49:39.930 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:44:00.989 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:49:39.947 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:44:01.005 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:49:39.955 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:44:00.990 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:49:39.963 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:44:01.022 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:49:39.964 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:44:00.996 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:49:39.970 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:44:01.028 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:49:40.174 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:44:01.233 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:49:40.224 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:44:01.259 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:49:40.279 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:44:01.337 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:49:59.989 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:49:59.979+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:00.003 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:49:59.998+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:00.149 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:00.144+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:00.987 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:00.982+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:01.038 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:01.033+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:01.127 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:01.120+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:01.635 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:01.630+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:01.734 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:01.729+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:01.999 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:01.994+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:02.053 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:02.044+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:02.127 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:02.122+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:02.332 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:02.327+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:02.600 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:02.596+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:02.708 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:02.703+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:03.018 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:03.011+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:03.081 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:03.074+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:03.155 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:03.149+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:03.332 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:03.328+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:03.586 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:03.579+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:03.695 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:03.690+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:04.002 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:03.998+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:04.119 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:04.114+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:04.121 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:04.116+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:04.196 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:04.192+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:04.353 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:04.343+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:04.579 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:04.573+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:04.653 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:04.649+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:05.017 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:05.010+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:05.082 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:05.076+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:05.084 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:05.079+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:05.230 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:05.225+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:05.374 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:05.369+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:05.621 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:05.615+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:05.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:05.622+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:06.017 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:06.005+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:06.056 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:06.048+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:06.125 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:06.117+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:06.186 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:06.182+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:06.348 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:06.344+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:06.597 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:06.591+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:06.643 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:06.637+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:07.023 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:07.019+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:07.071 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:07.065+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:07.095 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:07.090+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:07.195 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:07.191+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:07.362 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:07.357+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:07.561 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:07.557+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:07.673 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:07.669+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:08.065 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:08.060+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:08.074 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:08.069+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:08.097 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:08.093+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:08.157 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:08.152+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:08.370 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:08.365+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:08.533 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:08.529+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:08.631 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:08.626+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:09.073 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:09.068+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:09.121 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:09.113+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:09.143 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:09.138+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:09.161 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:09.155+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:09.417 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:09.412+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:09.493 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:09.487+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:09.660 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:09.656+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:10.030 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:10.025+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:10.076 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:10.072+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:10.120 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:10.115+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:10.126 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:10.121+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:10.453 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:10.447+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:10.463 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:10.458+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:10.642 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:10.636+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:11.058 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:11.052+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:11.079 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:11.075+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:11.133 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:11.128+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:11.172 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:11.166+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:11.440 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:11.436+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:11.512 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:11.503+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:11.677 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:11.671+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:12.070 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:12.065+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:12.081 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:12.076+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:12.109 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:12.104+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:12.171 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:12.165+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:12.414 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:12.409+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:12.561 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:12.556+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:12.725 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:12.720+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:13.040 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:13.032+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:13.080 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:13.075+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:13.135 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:13.130+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:13.155 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:13.150+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:13.420 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:13.415+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:13.532 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:13.527+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:13.763 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:13.758+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:14.091 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:14.086+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:14.113 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:14.108+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:14.132 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:14.127+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:14.140 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:14.134+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:14.397 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:14.391+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:14.541 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:14.536+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:14.787 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:14.782+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:15.107 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:15.100+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:15.127 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:15.122+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:15.148 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:15.141+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:15.157 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:15.151+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:15.365 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:15.355+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:15.593 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:15.577+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:15.760 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:15.756+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:16.095 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:16.090+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:16.136 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:16.132+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:16.174 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:16.169+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:16.192 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:16.187+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:16.330 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:16.324+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:16.634 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:16.629+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:16.791 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:16.773+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:17.112 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:17.107+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:17.138 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:17.133+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:17.153 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:17.148+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:17.185 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:17.179+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:17.329 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:17.323+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:17.593 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:17.587+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:17.809 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:17.803+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:18.097 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:18.088+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:18.132 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:18.126+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:18.208 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:18.202+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:18.208 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:18.202+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:18.310 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:18.304+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:18.640 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:18.634+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:18.781 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:18.776+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:19.095 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:19.089+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:19.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:19.129+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:19.189 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:19.185+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:19.230 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:19.227+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:19.315 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:19.312+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:19.599 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:19.593+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:19.754 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:19.749+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:20.131 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:20.126+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:20.146 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:20.143+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:20.186 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:20.182+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:20.281 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:20.277+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:20.319 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:20.315+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:20.569 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:20.565+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:20.783 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:20.778+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:21.114 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:21.109+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:21.163 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:21.157+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:21.241 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:21.233+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:21.242 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:21.238+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:21.285 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:21.280+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:21.552 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:21.546+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:21.819 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:21.803+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:22.140 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:22.136+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:22.162 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:22.158+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:22.205 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:22.201+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:22.248 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:22.245+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:22.280 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:22.275+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:22.577 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:22.572+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:22.812 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:22.808+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:23.099 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:23.094+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:23.205 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:23.201+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:23.220 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:23.217+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:23.243 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:23.238+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:23.260 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:23.256+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:23.558 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:23.553+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:23.807 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:23.802+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:24.072 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:24.068+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:24.186 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:24.181+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:24.244 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:24.240+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:24.275 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:24.271+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:24.296 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:24.290+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:24.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:24.570+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:24.822 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:24.819+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:25.076 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:25.073+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:25.181 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:25.177+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:25.260 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:25.256+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:25.293 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:25.290+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:25.331 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:25.327+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:25.558 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:25.553+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:25.798 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:25.794+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:26.039 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:26.035+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:26.205 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:26.202+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:26.274 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:26.271+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:26.318 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:26.303+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:26.326 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:26.319+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:26.593 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:26.588+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:26.851 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:26.846+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:27.084 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:27.079+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:27.183 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:27.178+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:27.273 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:27.269+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:27.297 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:27.294+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:27.364 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:27.357+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:27.629 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:27.623+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:27.826 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:27.821+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:28.086 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:28.082+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:28.160 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:28.155+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:28.229 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:28.225+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:28.341 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:28.337+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:28.406 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:28.401+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:28.611 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:28.605+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:28.798 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:28.792+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:29.051 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:50:29.046+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.771296+0000 front 2019-12-09T19:49:17.820467+0000 (oldest deadline 2019-12-09T19:50:03.328972+0000) 2019-12-09T19:50:29.181 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:29.177+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:29.263 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:29.260+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:29.365 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:29.361+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:29.372 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:29.367+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:29.599 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:29.594+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:29.836 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:29.831+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:30.145 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:30.142+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:30.245 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:30.240+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:30.389 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:30.372+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:30.413 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:30.403+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:30.659 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:30.652+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:30.801 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:30.793+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:31.103 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:31.098+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:31.229 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:31.225+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:31.384 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:31.380+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:31.418 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:31.413+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:31.696 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:31.685+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:31.849 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:31.840+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:32.091 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:32.087+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:32.203 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:32.199+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:32.382 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:32.378+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:32.392 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:32.388+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:32.699 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:32.694+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:32.893 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:32.889+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:33.047 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:33.042+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:33.215 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:33.211+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:33.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:33.331+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:33.416 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:33.413+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:33.681 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:33.675+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:33.860 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:33.855+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:34.077 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:34.073+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:34.176 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:34.172+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:34.385 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:34.375+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:34.411 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:34.408+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:34.724 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:34.718+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:34.887 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:34.879+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:35.097 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:35.092+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:35.195 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:35.190+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:35.338 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:35.334+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:35.434 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:35.430+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:35.758 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:50:35.753+0000 1694f700 -1 osd.5 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:19.265151+0000 front 2019-12-09T19:49:19.801581+0000 (oldest deadline 2019-12-09T19:50:01.421369+0000) 2019-12-09T19:50:35.861 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:50:35.855+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:16.862748+0000 front 2019-12-09T19:49:18.657764+0000 (oldest deadline 2019-12-09T19:50:01.143653+0000) 2019-12-09T19:50:36.119 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:50:36.115+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.551767+0000 front 2019-12-09T19:49:17.545154+0000 (oldest deadline 2019-12-09T19:49:59.951154+0000) 2019-12-09T19:50:36.235 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:50:36.231+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:17.584934+0000 front 2019-12-09T19:49:17.567457+0000 (oldest deadline 2019-12-09T19:49:59.751065+0000) 2019-12-09T19:50:36.380 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:50:36.375+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.294589+0000 front 2019-12-09T19:49:19.949196+0000 (oldest deadline 2019-12-09T19:49:59.920852+0000) 2019-12-09T19:50:36.412 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:50:36.409+0000 1694f700 -1 osd.2 442 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:49:18.778591+0000 front 2019-12-09T19:49:17.983877+0000 (oldest deadline 2019-12-09T19:50:02.053391+0000) 2019-12-09T19:50:36.430 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:50:36.424+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 43sec e442 v442) 2019-12-09T19:51:33.747 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:33.741+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:34.587 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:34.581+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:34.750 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:34.743+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:35.083 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:35.077+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:35.611 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:35.603+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:35.802 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:35.796+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:36.005 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:36.001+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:36.075 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:36.072+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:36.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:36.614+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:36.648 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:36.637+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:36.795 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:36.788+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:36.985 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:36.980+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:37.073 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:37.069+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:37.582 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:37.577+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:37.645 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:37.632+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:37.778 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:37.771+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:38.009 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:38.000+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:38.046 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:38.040+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:38.569 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:38.565+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:38.680 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:38.672+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:38.808 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:38.803+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:38.962 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:38.958+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:39.069 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:39.062+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:39.499 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:39.491+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:39.621 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:39.615+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:39.751 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:39.742+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:39.809 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:39.804+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:39.933 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:39.930+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:40.105 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:40.099+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:40.456 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:40.451+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:40.640 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:40.636+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:40.784 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:40.779+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:40.850 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:40.844+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:40.967 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:40.964+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:41.145 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:41.140+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:41.445 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:41.432+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:41.615 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:41.610+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:41.812 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:41.804+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:41.832 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:41.825+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:41.935 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:41.930+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:42.169 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:42.161+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:42.490 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:42.483+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:42.605 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:42.601+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:42.831 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:42.822+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:42.869 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:42.863+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:42.897 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:42.893+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:43.158 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:43.154+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:43.284 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:43.279+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:43.458 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:43.450+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:43.592 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:43.587+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:43.859 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:43.851+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:43.880 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:43.876+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:43.886 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:43.879+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:44.137 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:44.133+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:44.319 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:44.314+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:44.423 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:44.415+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:44.617 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:44.613+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:44.871 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:44.866+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:44.897 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:44.890+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:44.913 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:44.902+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:45.158 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:45.155+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:45.337 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:45.332+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:45.431 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:45.423+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:45.665 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:45.659+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:45.865 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:45.859+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:45.897 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:45.892+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:45.913 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:45.906+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:46.167 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:46.163+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:46.329 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:46.322+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:46.463 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:46.457+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:46.673 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:46.666+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:46.889 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:46.884+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:46.902 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:46.897+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:46.921 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:46.912+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:47.199 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:47.193+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:47.338 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:47.333+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:47.517 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:47.510+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:47.626 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:47.621+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:47.921 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:47.916+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:47.941 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:47.936+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:47.958 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:47.952+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:48.161 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:48.156+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:48.363 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:48.358+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:51:48.367 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:48.363+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:48.535 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:48.528+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:48.593 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:48.590+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:48.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:48.964+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:48.973 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:48.967+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:48.982 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:48.978+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:49.198 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:49.188+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:49.349 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:49.342+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:51:49.350 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:49.345+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:49.542 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:49.536+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:49.597 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:49.583+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:49.961 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:49.949+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:49.972 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:49.967+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:50.010 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:50.004+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:50.175 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:50.157+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:50.346 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:50.337+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:51:50.347 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:50.342+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:50.583 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:50.576+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:50.627 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:50.623+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:50.959 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:50.950+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:50.969 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:50.961+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:50.993 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:50.986+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:51.130 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:51.125+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:51.379 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:51.373+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:51:51.381 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:51.376+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:51.570 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:51.565+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:51.675 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:51.671+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:51.969 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:51.966+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:52.008 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:51.991+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:52.008 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:51.995+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:52.146 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:52.142+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:52.377 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:52.371+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:51:52.378 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:52.373+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:52.542 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:52.535+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:52.689 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:52.683+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:52.951 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:52.947+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:52.965 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:52.953+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:53.041 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:53.033+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:53.121 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:53.110+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:53.422 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:53.411+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:51:53.423 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:53.417+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:53.573 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:53.562+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:53.693 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:53.687+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:53.914 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:53.906+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:53.946 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:53.940+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:54.094 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:54.086+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:54.119 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:54.115+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:54.404 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:54.396+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:51:54.405 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:54.399+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:54.585 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:54.579+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:54.706 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:54.700+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:54.909 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:54.902+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:54.942 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:54.930+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:55.095 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:55.089+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:55.096 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:55.090+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:55.443 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:55.437+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:51:55.447 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:55.442+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:55.579 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:55.573+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:55.676 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:55.672+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:55.963 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:55.956+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:55.963 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:55.958+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:56.101 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:56.095+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:56.137 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:56.124+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:56.452 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:56.446+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:51:56.456 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:56.452+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:56.559 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:56.553+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:56.649 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:56.643+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:56.929 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:56.918+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:56.988 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:56.978+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:57.090 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:57.084+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:57.185 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:57.178+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:57.455 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:57.449+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:51:57.456 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:57.452+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:57.588 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:57.583+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:57.636 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:57.631+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:57.941 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:57.932+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:58.025 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:58.018+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:58.055 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:58.048+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:58.201 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:58.193+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:58.468 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:58.462+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:51:58.469 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:58.464+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:58.595 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:58.591+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:58.609 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:58.602+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:58.948 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:58.941+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:59.012 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:59.007+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:51:59.016 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:51:59.010+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:51:59.241 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:51:59.233+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:51:59.454 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:59.447+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:51:59.455 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:51:59.450+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:51:59.613 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:51:59.606+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:51:59.631 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:51:59.626+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:51:59.914 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:51:59.908+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:51:59.993 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:51:59.989+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:00.043 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:00.035+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:00.290 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:00.287+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:00.483 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:00.472+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:00.484 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:00.475+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:00.599 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:00.591+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:00.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:00.657+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:00.935 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:00.929+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:00.993 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:00.988+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:01.065 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:01.060+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:01.296 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:01.292+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:01.448 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:01.441+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:01.449 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:01.445+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:01.552 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:01.548+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:01.708 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:01.701+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:01.957 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:01.949+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:02.017 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:02.011+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:02.076 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:02.068+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:02.298 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:02.294+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:02.410 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:02.403+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:02.411 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:02.406+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:02.539 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:02.535+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:02.680 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:02.674+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:02.944 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:02.935+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:03.052 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:03.048+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:03.068 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:03.061+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:03.347 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:03.341+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:03.436 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:03.430+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:03.445 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:03.436+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:03.499 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:03.493+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:03.735 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:03.723+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:03.995 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:03.988+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:04.009 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:04.005+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:04.077 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:04.064+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:04.377 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:04.364+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:04.420 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:04.411+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:04.421 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:04.414+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:04.514 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:04.510+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:04.751 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:04.744+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:04.985 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:04.980+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:05.026 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:05.019+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:05.074 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:05.066+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:05.369 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:05.363+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:05.457 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:05.450+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:05.458 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:05.453+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:05.560 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:05.553+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:05.763 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:05.755+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:06.013 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:06.005+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:06.038 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:06.033+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:06.123 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:06.117+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:06.367 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:06.361+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:06.471 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:06.464+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:06.473 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:06.467+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:06.519 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:06.514+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:06.675 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:52:06.669+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e448 v448) 2019-12-09T19:52:06.733 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:06.727+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:07.018 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:07.011+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:07.070 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:07.065+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:07.156 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:07.149+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:07.336 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:07.330+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:07.489 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:07.483+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:07.493 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:07.489+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:07.528 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:07.522+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:07.784 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:07.778+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:08.022 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:08.016+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:08.041 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:08.036+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:08.191 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:08.185+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:08.355 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:08.346+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:08.471 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:08.466+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:08.473 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:08.470+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:08.495 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:08.491+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:08.819 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:08.812+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:08.983 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:08.976+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:09.077 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:09.070+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:09.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:09.216+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:09.384 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:09.378+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:09.461 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:09.453+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:09.462 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:09.457+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:09.469 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:09.463+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:09.790 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:09.783+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:10.032 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:10.022+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:10.086 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:10.081+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:10.250 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:10.243+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:10.419 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:10.414+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:10.429 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:10.423+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:10.429 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:10.420+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:10.429 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:10.422+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:10.829 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:10.823+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:11.012 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:11.006+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:11.086 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:11.079+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:11.223 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:11.216+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:11.386 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:11.381+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:11.418 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:11.413+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:11.432 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:11.423+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:11.433 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:11.427+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:11.689 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:52:11.681+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e448 v448) 2019-12-09T19:52:11.883 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:11.873+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:12.012 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:12.005+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:12.133 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:12.125+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:12.218 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:12.211+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:12.420 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:12.414+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:12.430 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:12.419+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:12.450 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:12.443+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:12.454 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:12.446+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:12.913 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:12.906+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:13.050 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:13.044+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:13.152 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:13.147+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:13.184 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:13.178+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:13.436 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:13.430+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:13.455 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:13.449+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:13.462 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:13.452+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:13.463 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:13.455+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:13.921 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:13.912+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:14.069 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:14.060+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:14.136 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:14.129+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:14.211 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:14.203+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:14.398 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:14.391+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:14.449 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:14.444+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:14.481 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:14.469+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:14.481 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:14.473+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:14.920 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:14.914+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:15.103 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:15.098+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:15.166 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:15.160+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:15.265 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:15.255+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:15.369 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:15.365+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:15.418 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:15.414+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:15.510 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:15.504+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:15.520 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:15.506+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:15.958 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:15.952+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:16.119 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:16.114+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:16.166 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:16.161+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:16.313 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:16.307+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:16.407 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:16.400+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:16.458 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:16.446+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:16.564 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:16.557+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:16.565 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:16.560+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:16.699 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:52:16.691+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e448 v448) 2019-12-09T19:52:16.922 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:16.917+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:17.148 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:17.143+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:17.158 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:17.153+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:17.319 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:17.309+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:17.385 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:17.379+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:17.496 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:17.489+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:17.587 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:17.579+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:17.587 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:17.582+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:17.967 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:17.958+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:18.157 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:18.148+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:18.182 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:18.177+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:18.325 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:18.318+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:18.399 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:18.394+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:18.480 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:18.476+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:18.585 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:18.580+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:18.587 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:18.583+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:18.994 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:18.978+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:19.159 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:19.152+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:19.197 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:19.191+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:19.306 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:19.298+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:19.375 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:19.370+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:19.462 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:19.456+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:19.613 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:19.607+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:19.615 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:19.610+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:19.961 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:19.955+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:20.179 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:20.167+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:20.218 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:20.214+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:20.336 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:20.330+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:20.356 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:20.349+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:20.458 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:20.453+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:20.644 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:20.636+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:20.645 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:20.640+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:21.015 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:52:21.009+0000 1694f700 -1 osd.4 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.364801+0000 front 2019-12-09T19:50:53.549352+0000 (oldest deadline 2019-12-09T19:51:39.202712+0000) 2019-12-09T19:52:21.181 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:52:21.169+0000 1694f700 -1 osd.3 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.067264+0000 front 2019-12-09T19:50:50.978997+0000 (oldest deadline 2019-12-09T19:51:35.602873+0000) 2019-12-09T19:52:21.193 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:52:21.184+0000 1694f700 -1 osd.5 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:51.470917+0000 front 2019-12-09T19:50:53.805919+0000 (oldest deadline 2019-12-09T19:51:33.732825+0000) 2019-12-09T19:52:21.347 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:52:21.341+0000 1694f700 -1 osd.7 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:52.828852+0000 front 2019-12-09T19:50:53.381555+0000 (oldest deadline 2019-12-09T19:51:33.906071+0000) 2019-12-09T19:52:21.411 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:52:21.406+0000 1694f700 -1 osd.1 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:53.545964+0000 front 2019-12-09T19:50:53.504272+0000 (oldest deadline 2019-12-09T19:51:35.824436+0000) 2019-12-09T19:52:21.470 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:21.465+0000 1694f700 -1 osd.2 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:50:49.280792+0000 front 2019-12-09T19:50:49.273017+0000 (oldest deadline 2019-12-09T19:51:35.076155+0000) 2019-12-09T19:52:21.662 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:21.654+0000 1694f700 -1 osd.6 448 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:51:08.148662+0000 (oldest deadline 2019-12-09T19:51:48.148662+0000) 2019-12-09T19:52:21.663 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:21.658+0000 1694f700 -1 osd.6 448 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e447) 2019-12-09T19:52:21.758 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:52:21.753+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e448 v448) 2019-12-09T19:52:52.973 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:52.773+0000 1694f700 -1 osd.6 451 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:118021 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 385731248 gen 105] snapc 0=[] ondisk+write+known_if_redirected e449) 2019-12-09T19:52:53.673 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:53.621+0000 3578e700 -1 osd.2 452 build_incremental_map_msg missing incremental map 452 2019-12-09T19:52:53.673 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:53.626+0000 3578e700 -1 osd.2 452 build_incremental_map_msg missing incremental map 452 2019-12-09T19:52:53.775 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:53.762+0000 35f8f700 -1 osd.6 452 build_incremental_map_msg missing incremental map 452 2019-12-09T19:52:53.791 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:53.740+0000 35f8f700 -1 osd.2 452 build_incremental_map_msg missing incremental map 452 2019-12-09T19:52:53.795 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:53.766+0000 35f8f700 -1 osd.6 452 build_incremental_map_msg missing incremental map 452 2019-12-09T19:52:53.840 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:53.766+0000 35f8f700 -1 osd.2 452 build_incremental_map_msg missing incremental map 452 2019-12-09T19:52:53.841 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:53.789+0000 35f8f700 -1 osd.6 452 build_incremental_map_msg missing incremental map 452 2019-12-09T19:52:53.869 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:53.767+0000 35f8f700 -1 osd.2 452 build_incremental_map_msg missing incremental map 452 2019-12-09T19:52:54.133 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:53.948+0000 33f8b700 -1 osd.6 452 build_incremental_map_msg missing incremental map 452 2019-12-09T19:52:54.154 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:52:54.056+0000 34f8d700 -1 osd.2 452 build_incremental_map_msg missing incremental map 452 2019-12-09T19:52:54.219 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:54.056+0000 31786700 -1 osd.6 452 build_incremental_map_msg missing incremental map 452 2019-12-09T19:52:54.396 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:52:54.388+0000 34f8d700 -1 osd.6 452 build_incremental_map_msg missing incremental map 452 2019-12-09T19:53:31.022 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:47:52.080 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:53:31.025 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:47:52.084 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:53:31.043 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:47:52.077 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:53:31.046 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:47:52.081 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:53:31.137 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:47:52.196 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:53:31.140 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:47:52.199 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:53:31.375 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:47:52.410 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:53:31.389 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:47:52.447 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:53:31.393 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:47:52.452 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:53:55.393 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:53:55.388+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:53:55.614 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:53:55.610+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:53:56.347 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:53:56.343+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:53:56.533 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:53:56.530+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:53:56.609 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:53:56.602+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:53:57.122 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:53:57.119+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:53:57.322 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:53:57.318+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:53:57.360 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:53:57.356+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:53:57.545 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:53:57.541+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:53:57.598 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:53:57.593+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:53:57.646 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:53:57.641+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:53:58.109 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:53:58.105+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:53:58.355 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:53:58.337+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:53:58.369 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:53:58.363+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:53:58.537 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:53:58.530+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:53:58.602 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:53:58.596+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:53:58.651 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:53:58.647+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:53:59.021 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:53:59.017+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:53:59.133 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:53:59.130+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:53:59.350 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:53:59.344+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:53:59.389 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:53:59.385+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:53:59.586 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:53:59.582+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:53:59.605 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:53:59.600+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:53:59.634 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:53:59.630+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:00.068 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:00.061+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:00.167 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:00.163+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:00.380 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:00.375+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:00.413 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:00.409+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:00.603 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:00.600+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:00.650 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:00.646+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:00.656 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:00.653+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:01.040 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:01.035+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:01.192 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:01.188+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:01.388 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:01.384+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:01.408 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:01.404+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:01.618 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:01.612+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:01.619 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:01.616+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:01.694 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:01.689+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:02.042 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:02.033+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:02.238 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:02.234+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:02.382 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:02.377+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:02.425 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:02.421+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:02.615 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:02.609+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:02.657 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:02.647+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:02.718 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:02.713+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:03.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:03.062+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:03.272 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:03.265+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:03.365 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:03.361+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:03.426 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:03.423+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:03.650 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:03.645+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:03.659 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:03.655+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:03.756 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:03.751+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:04.073 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:04.065+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:04.275 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:04.272+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:04.350 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:04.346+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:04.444 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:04.441+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:04.630 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:04.626+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:04.639 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:04.635+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:04.785 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:04.780+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:05.043 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:05.038+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:05.286 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:05.282+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:05.381 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:05.376+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:05.434 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:05.429+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:05.615 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:05.611+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:05.683 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:05.679+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:05.821 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:05.816+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:06.006 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:06.001+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:06.294 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:06.287+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:06.418 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:06.414+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:06.433 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:06.429+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:06.644 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:06.640+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:06.660 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:06.657+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:06.856 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:06.851+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:06.994 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:06.989+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:07.331 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:07.326+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:07.394 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:07.389+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:07.464 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:07.459+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:07.614 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:07.610+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:07.626 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:07.621+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:07.892 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:07.886+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:08.003 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:07.998+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:08.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:08.348+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:08.353 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:08.349+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:08.504 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:08.498+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:08.606 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:08.602+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:08.643 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:08.634+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:08.882 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:08.878+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:08.956 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:08.952+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:09.365 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:09.361+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:09.401 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:09.396+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:09.490 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:09.486+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:09.570 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:09.564+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:09.599 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:09.594+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:09.926 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:09.919+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:09.927 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:09.921+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:10.378 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:10.374+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:10.390 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:10.386+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:10.514 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:10.510+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:10.578 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:10.574+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:10.597 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:10.593+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:10.891 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:10.887+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:10.923 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:10.918+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:11.349 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:11.344+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:11.382 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:11.377+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:11.557 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:11.538+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:11.597 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:11.592+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:11.633 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:11.628+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:11.912 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:11.906+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:11.913 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:11.908+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:12.328 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:48:33.387 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:54:12.336 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:12.332+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:12.379 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:12.375+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:12.398 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:48:33.449 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:54:12.405 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:48:33.440 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:54:12.408 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:48:33.442 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:54:12.416 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:48:33.475 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:54:12.418 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:48:33.476 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:54:12.440 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:48:33.499 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:54:12.460 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:48:33.518 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:54:12.464 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:48:33.499 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:54:12.513 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:12.508+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:12.637 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:12.628+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:12.683 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:12.678+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:12.865 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:12.859+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:12.952 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:12.948+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:13.365 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:13.352+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:13.400 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:13.395+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:13.474 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:13.469+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:13.638 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:13.633+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:13.659 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:13.652+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:13.867 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:13.862+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:13.975 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:13.971+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:14.381 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:14.377+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:14.435 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:14.430+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:14.483 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:14.480+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:14.630 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:14.626+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:14.686 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:14.682+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:14.838 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:14.832+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:14.983 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:14.978+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:15.418 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:15.413+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:15.444 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:15.439+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:15.481 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:15.471+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:15.588 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:15.583+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:15.737 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:15.729+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:15.869 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:15.857+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:16.037 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:16.031+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:16.414 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:16.410+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:16.468 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:16.464+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:16.479 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:16.476+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:16.591 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:16.586+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:16.720 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:16.712+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:16.865 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:16.860+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:17.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:17.052+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:17.431 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:17.427+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:17.448 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:17.444+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:17.454 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:17.450+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:17.639 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:17.634+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:17.675 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:17.670+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:17.911 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:17.907+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:18.105 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:18.100+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:18.464 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:18.460+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:18.475 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:18.461+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:18.475 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:18.468+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:18.595 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:18.590+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:18.732 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:18.727+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:18.918 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:18.913+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:19.088 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:19.082+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:19.455 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:19.448+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:19.496 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:19.490+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:19.497 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:19.490+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:19.624 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:19.614+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:19.779 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:19.771+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:19.943 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:19.939+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:20.084 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:20.079+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:20.436 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:20.430+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:20.517 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:20.512+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:20.528 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:20.523+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:20.613 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:20.609+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:20.743 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:20.738+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:20.948 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:20.943+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:21.124 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:21.120+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:21.473 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:21.467+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:21.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:21.475+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:21.490 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:21.481+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:21.589 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:21.584+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:21.712 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:21.706+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:21.964 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:21.959+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:22.154 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:22.147+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:22.449 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:22.443+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:22.453 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:22.449+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:22.506 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:22.502+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:22.581 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:22.577+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:22.716 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:22.706+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:23.013 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:23.008+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:23.182 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:23.178+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:23.461 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:23.456+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:23.473 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:23.468+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:23.500 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:23.495+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:23.611 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:23.604+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:23.678 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:23.673+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:24.000 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:23.995+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:24.177 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:24.173+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:24.498 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:24.493+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:24.509 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:24.504+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:24.511 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:24.506+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:24.592 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:24.583+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:24.655 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:24.650+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:25.051 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:25.047+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:25.186 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:25.179+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:25.460 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:25.455+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:25.495 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:25.491+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:25.550 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:25.545+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:25.596 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:25.591+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:25.672 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:25.668+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:26.013 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:26.008+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:26.188 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:26.183+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:26.420 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:26.415+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:26.520 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:26.516+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:26.555 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:26.551+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:26.557 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:26.553+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:26.646 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:26.642+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:26.989 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:26.985+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:27.200 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:27.193+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:27.326 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:54:27.322+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 45sec e454 v454) 2019-12-09T19:54:27.405 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:27.400+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:27.481 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:27.475+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:27.519 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:27.514+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:27.578 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:27.573+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:27.689 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:27.684+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:27.964 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:27.959+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:28.189 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:28.184+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:28.456 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:28.452+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:28.459 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:28.455+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:28.548 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:28.543+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:28.604 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:28.599+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:28.684 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:28.679+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:29.023 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:29.010+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:29.158 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:29.153+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:29.423 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:29.419+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:29.481 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:29.476+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:29.559 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:29.554+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:29.568 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:29.563+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:29.646 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:29.641+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:30.023 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:30.018+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:30.152 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:30.147+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:30.468 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:30.463+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:30.527 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:30.522+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:30.552 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:30.547+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:30.561 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:30.556+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:30.694 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:30.690+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:31.070 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:31.066+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:31.152 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:31.147+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:31.493 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:54:31.489+0000 1694f700 -1 osd.3 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.486897+0000 front 2019-12-09T19:53:11.467491+0000 (oldest deadline 2019-12-09T19:53:54.875640+0000) 2019-12-09T19:54:31.512 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:31.506+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:31.534 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:54:31.529+0000 1694f700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.094270+0000 front 2019-12-09T19:53:12.262148+0000 (oldest deadline 2019-12-09T19:53:56.784578+0000) 2019-12-09T19:54:31.541 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:31.537+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:54:31.680 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:54:31.675+0000 1694f700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:12.139973+0000 front 2019-12-09T19:53:12.141843+0000 (oldest deadline 2019-12-09T19:53:57.411536+0000) 2019-12-09T19:54:32.029 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:54:32.024+0000 1694f700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.368436+0000 front 2019-12-09T19:53:11.373877+0000 (oldest deadline 2019-12-09T19:53:55.187557+0000) 2019-12-09T19:54:32.169 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:54:32.163+0000 1694f700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:13.035568+0000 front 2019-12-09T19:53:12.925768+0000 (oldest deadline 2019-12-09T19:53:58.779078+0000) 2019-12-09T19:54:32.398 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:54:32.385+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 45sec e454 v454) 2019-12-09T19:54:32.546 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:54:32.542+0000 1694f700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:10.973510+0000 front 2019-12-09T19:53:11.351390+0000 (oldest deadline 2019-12-09T19:53:56.221688+0000) 2019-12-09T19:54:32.587 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:54:32.579+0000 1694f700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:53:11.991764+0000 front 2019-12-09T19:53:11.989853+0000 (oldest deadline 2019-12-09T19:53:56.930888+0000) 2019-12-09T19:55:30.838 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:30.832+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:30.948 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:30.939+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:31.795 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:31.789+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:31.900 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:31.894+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:32.134 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:32.129+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:32.376 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:32.367+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:32.754 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:32.747+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:32.877 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:32.867+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:33.174 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:33.169+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:33.382 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:33.374+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:33.757 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:33.744+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:33.869 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:33.850+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:34.033 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:34.028+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:34.226 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:34.220+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:34.355 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:34.349+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:34.792 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:34.786+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:34.881 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:34.875+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:34.906 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:34.899+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:34.990 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:34.985+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:35.289 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:35.274+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:35.378 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:35.371+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:35.817 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:35.810+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:35.903 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:35.898+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:35.936 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:35.930+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:36.029 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:36.024+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:36.313 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:36.307+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:36.432 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:36.426+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:36.800 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:36.794+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:36.953 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:36.947+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:36.979 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:36.971+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:36.988 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:36.983+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:37.325 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:37.320+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:37.445 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:37.437+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:37.763 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:37.757+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:37.979 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:37.972+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:37.996 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:37.991+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:38.033 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:38.027+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:38.289 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:38.283+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:38.466 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:38.461+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:38.803 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:38.797+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:38.959 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:38.955+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:38.991 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:38.988+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:38.996 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:38.990+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:39.330 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:39.321+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:39.452 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:39.446+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:39.770 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:39.763+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:39.958 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:39.951+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:39.968 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:39.963+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:39.979 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:39.976+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:40.345 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:40.340+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:40.354 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:40.348+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:40.478 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:40.472+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:40.747 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:40.741+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:40.928 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:40.922+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:40.960 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:40.955+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:40.974 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:40.971+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:41.350 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:41.346+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:41.376 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:41.371+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:41.535 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:41.528+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:41.767 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:41.761+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:41.891 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:41.883+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:41.946 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:41.941+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:41.977 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:41.974+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:42.308 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:42.304+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:42.333 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:42.329+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:42.497 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:42.492+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:42.776 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:42.770+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:42.877 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:42.872+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:42.940 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:42.935+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:42.991 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:42.986+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:43.321 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:43.318+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:43.374 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:43.367+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:43.534 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:43.528+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:43.816 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:43.811+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:43.889 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:43.884+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:43.913 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:43.908+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:43.954 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:43.950+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:44.327 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:44.321+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:44.407 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:44.402+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:44.493 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:44.487+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:44.824 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:44.817+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:44.874 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:44.866+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:44.910 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:44.905+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:44.938 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:44.934+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:45.320 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:45.315+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:45.445 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:45.440+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:45.507 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:45.502+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:45.835 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:45.829+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:45.838 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:45.831+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:45.899 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:45.894+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:45.953 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:45.949+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:46.286 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:46.281+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:46.458 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:46.453+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:46.459 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:46.455+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:46.564 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:46.555+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:46.807 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:46.800+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:46.891 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:46.884+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:46.925 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:46.919+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:46.951 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:46.947+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:47.307 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:47.303+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:47.436 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:47.430+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:47.440 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:47.436+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:47.614 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:47.608+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:47.786 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:47.779+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:47.853 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:50:08.912 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:47.874 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:50:08.932 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:47.929 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:47.925+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:47.934 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:47.924+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:47.935 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:47.931+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:47.940 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:50:08.996 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:47.943 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:50:09.000 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:47.963 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:50:08.997 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:47.967 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:50:09.001 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:48.007 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:50:09.065 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:48.048 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:50:09.107 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:48.133 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:50:09.167 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:48.293 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:48.289+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:48.435 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:48.430+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:48.438 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:48.435+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:48.639 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:48.633+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:48.802 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:48.797+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:48.894 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:48.890+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:48.918 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:48.915+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:48.955 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:48.947+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:49.293 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:49.289+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:49.477 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:49.469+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:49.478 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:49.473+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:49.599 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:49.592+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:49.763 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:49.757+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:49.910 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:49.904+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:49.931 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:49.927+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:49.960 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:49.955+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:50.334 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:50.327+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:50.501 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:50.495+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:50.503 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:50.498+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:50.645 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:50.638+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:50.821 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:50.810+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:50.887 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:50.881+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:50.930 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:50.924+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:50.963 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:50.960+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:51.336 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:51.333+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:51.499 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:51.493+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:51.503 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:51.498+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:51.602 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:51.595+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:51.815 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:51.810+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:51.904 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:51.898+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:51.966 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:51.961+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:52.007 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:52.003+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:52.383 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:52.378+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:52.484 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:52.477+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:52.488 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:52.483+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:52.616 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:52.609+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:52.775 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:52.770+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:52.877 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:52.871+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:52.978 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:52.975+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:53.019 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:53.015+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:53.348 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:53.344+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:53.549 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:53.534+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:53.549 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:53.537+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:53.608 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:53.603+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:53.757 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:53.750+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:53.874 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:53.869+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:54.019 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:54.015+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:54.067 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:54.063+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:54.390 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:54.387+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:54.495 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:54.488+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:54.496 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:54.492+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:54.598 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:54.592+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:54.806 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:54.800+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:54.939 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:54.920+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:55.049 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:55.046+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:55.122 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:55.109+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:55.430 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:55.426+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:55.495 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:55.489+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:55.497 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:55.492+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:55.599 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:55.595+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:55.798 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:55.792+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:55.978 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:55.972+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:56.036 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:56.031+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:56.107 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:56.103+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:56.419 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:56.415+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:56.477 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:56.471+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:56.478 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:56.474+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:56.603 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:56.597+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:56.849 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:56.844+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:56.990 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:56.984+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:57.001 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:56.998+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:57.113 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:57.108+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:57.376 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:57.372+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:57.468 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:57.461+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:57.469 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:57.465+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:57.610 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:57.604+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:57.829 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:57.818+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:57.951 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:57.946+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:58.017 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:58.013+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:58.072 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:58.067+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:58.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:58.412+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:58.512 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:58.505+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:58.513 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:58.508+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:58.591 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:58.586+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:58.867 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:58.858+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:55:58.989 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:58.984+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:55:59.000 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:55:58.995+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:55:59.116 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:55:59.112+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:55:59.435 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:55:59.428+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:55:59.565 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:59.558+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:55:59.565 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:55:59.561+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:55:59.637 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:55:59.631+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:55:59.854 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:55:59.847+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:00.000 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:55:59.996+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:00.029 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:00.024+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:00.077 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:00.073+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:00.406 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:00.400+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:00.568 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:00.562+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:00.569 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:00.564+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:00.596 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:00.588+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:00.839 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:00.834+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:01.017 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:01.013+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:01.073 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:01.058+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:01.076 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:01.070+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:01.430 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:01.426+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:01.566 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:01.560+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:01.572 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:01.568+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:01.576 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:01.572+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:01.838 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:01.832+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:01.972 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:01.968+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:02.046 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:02.039+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:02.118 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:02.111+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:02.409 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:02.406+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:02.566 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:02.553+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:02.567 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:02.557+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:02.567 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:02.559+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:02.796 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:02.790+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:02.951 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:02.947+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:03.019 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:03.012+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:03.075 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:03.070+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:03.456 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:03.451+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:03.587 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:03.581+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:03.588 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:03.583+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:03.595 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:03.589+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:03.798 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:03.791+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:03.975 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:03.965+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:04.004 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:03.990+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:04.065 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:04.055+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:04.429 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:04.422+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:04.583 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:04.575+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:04.583 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:04.578+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:04.635 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:04.629+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:04.828 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:04.822+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:04.964 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:04.957+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:04.982 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:04.973+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:05.069 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:05.065+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:05.449 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:05.445+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:05.556 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:05.549+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:05.557 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:05.552+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:05.670 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:05.663+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:05.837 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:05.832+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:05.946 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:05.940+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:05.956 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:05.951+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:06.042 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:06.038+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:06.464 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:06.460+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:06.514 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:06.508+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:06.515 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:06.511+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:06.642 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:06.636+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:06.813 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:06.807+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:06.955 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:06.949+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:06.987 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:06.981+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:07.031 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:07.027+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:07.497 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:07.494+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:07.563 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:07.556+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:07.564 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:07.560+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:07.641 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:07.636+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:07.863 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:56:07.860+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 48sec e461 v461) 2019-12-09T19:56:07.873 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:07.862+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:07.950 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:07.940+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:07.993 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:07.990+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:08.038 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:08.034+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:08.458 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:08.455+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:08.615 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:08.609+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:08.616 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:08.611+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:08.682 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:08.676+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:08.912 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:08.904+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:08.929 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:08.922+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:09.006 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:09.001+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:09.070 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:09.066+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:09.486 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:09.482+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:09.599 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:09.592+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:09.600 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:09.595+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:09.731 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:09.725+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:09.892 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:09.886+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:09.991 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:09.983+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:10.015 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:10.011+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:10.035 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:10.031+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:10.540 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:10.536+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:10.577 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:10.570+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:10.578 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:10.573+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:10.757 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:10.750+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:10.878 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:10.872+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:10.994 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:10.989+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:11.047 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:11.042+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:11.048 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:11.044+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:11.567 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:11.563+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:11.586 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:11.579+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:11.587 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:11.582+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:11.769 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:11.764+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:11.920 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:11.913+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:12.029 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:12.024+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:12.040 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:12.034+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:12.083 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:12.077+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:12.535 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:12.531+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:12.634 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:12.629+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:12.639 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:12.633+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:12.785 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:12.778+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:12.875 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:56:12.873+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 48sec e461 v461) 2019-12-09T19:56:12.880 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:12.874+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:13.080 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:13.076+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:13.083 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:13.078+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:13.111 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:13.107+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:13.519 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:13.513+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:13.688 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:13.679+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:13.688 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:13.682+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:13.749 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:13.742+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:13.856 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:13.849+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:14.072 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:14.065+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:14.099 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:14.095+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:14.133 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:14.128+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:14.530 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:14.526+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:14.689 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:14.682+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:14.690 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:14.685+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:14.732 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:14.727+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:14.872 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:14.866+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:15.094 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:15.090+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:15.113 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:15.107+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:15.127 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:15.124+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:15.534 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:15.529+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:15.738 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:15.732+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:15.740 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:15.734+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:15.759 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:15.756+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:15.885 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:15.879+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:16.076 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:16.070+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:16.122 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:16.118+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:16.127 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:16.123+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:16.526 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:16.523+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:16.712 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:16.707+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:16.798 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:16.791+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:16.800 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:16.795+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:16.922 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:16.911+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:17.061 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:17.055+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:17.084 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:17.080+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:17.157 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:17.153+0000 1694f700 -1 osd.1 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.685536+0000 front 2019-12-09T19:54:49.573190+0000 (oldest deadline 2019-12-09T19:55:34.863574+0000) 2019-12-09T19:56:17.581 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:56:17.576+0000 1694f700 -1 osd.3 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.897319+0000 front 2019-12-09T19:54:48.408543+0000 (oldest deadline 2019-12-09T19:55:31.916034+0000) 2019-12-09T19:56:17.702 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:56:17.692+0000 1694f700 -1 osd.4 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:47.494130+0000 front 2019-12-09T19:54:47.091124+0000 (oldest deadline 2019-12-09T19:55:32.294789+0000) 2019-12-09T19:56:17.820 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:17.813+0000 1694f700 -1 osd.6 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:55:05.699359+0000 (oldest deadline 2019-12-09T19:55:45.699359+0000) 2019-12-09T19:56:17.822 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:56:17.817+0000 1694f700 -1 osd.6 461 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e458) 2019-12-09T19:56:17.924 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:56:17.918+0000 1694f700 -1 osd.5 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.495694+0000 front 2019-12-09T19:54:49.493360+0000 (oldest deadline 2019-12-09T19:55:30.399599+0000) 2019-12-09T19:56:17.946 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:56:17.941+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 48sec e461 v461) 2019-12-09T19:56:18.079 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:18.075+0000 1694f700 -1 osd.2 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:49.637860+0000 front 2019-12-09T19:54:49.933299+0000 (oldest deadline 2019-12-09T19:55:33.073425+0000) 2019-12-09T19:56:18.094 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:56:18.076+0000 1694f700 -1 osd.7 461 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:54:45.080826+0000 front 2019-12-09T19:54:45.124915+0000 (oldest deadline 2019-12-09T19:55:30.939695+0000) 2019-12-09T19:56:50.717 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:50.690+0000 31786700 -1 osd.1 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:56:50.721 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:50.711+0000 31786700 -1 osd.2 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:56:50.750 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:50.720+0000 31786700 -1 osd.2 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:56:50.805 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:50.708+0000 34f8d700 -1 osd.1 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:56:50.819 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:50.784+0000 31f87700 -1 osd.2 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:56:50.844 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:50.726+0000 30f85700 -1 osd.1 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:56:50.904 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:50.826+0000 31f87700 -1 osd.2 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:56:50.904 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:50.827+0000 31f87700 -1 osd.2 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:56:50.960 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:50.841+0000 35f8f700 -1 osd.1 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:56:51.006 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:50.909+0000 31f87700 -1 osd.1 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:56:51.122 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:50.977+0000 36f91700 -1 osd.1 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:56:51.236 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:56:51.220+0000 38f95700 -1 osd.2 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:56:51.333 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:56:51.152+0000 37792700 -1 osd.1 465 build_incremental_map_msg missing incremental map 465 2019-12-09T19:57:26.705 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:51:47.763 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:57:26.709 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:51:47.768 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:57:26.721 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:51:47.780 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:57:26.728 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:51:47.763 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:57:26.730 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:51:47.789 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:57:26.735 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:51:47.770 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:57:26.826 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:51:47.885 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T19:57:26.855 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:51:47.914 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T19:57:26.916 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:51:47.944 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T19:57:52.575 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:57:52.567+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:57:53.580 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:57:53.576+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:57:54.216 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:57:54.211+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:57:54.448 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:57:54.442+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:57:54.538 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:57:54.533+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:57:54.578 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:57:54.574+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:57:55.248 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:57:55.242+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:57:55.500 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:57:55.495+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:57:55.562 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:57:55.557+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:57:55.567 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:57:55.564+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:57:55.878 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:57:55.875+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:57:56.295 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:57:56.289+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:57:56.457 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:57:56.452+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:57:56.532 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:57:56.526+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:57:56.552 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:57:56.548+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:57:56.840 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:57:56.836+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:57:57.275 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:57:57.271+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:57:57.414 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:57:57.409+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:57:57.453 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:57:57.443+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:57:57.511 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:57:57.507+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:57:57.518 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:57:57.514+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:57:57.809 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:57:57.805+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:57:58.268 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:57:58.264+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:57:58.398 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:57:58.394+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:57:58.469 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:57:58.464+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:57:58.473 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:57:58.470+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:57:58.549 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:57:58.546+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:57:58.847 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:57:58.842+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:57:59.266 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:57:59.260+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:57:59.414 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:57:59.408+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:57:59.524 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:57:59.518+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:57:59.524 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:57:59.520+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:57:59.548 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:57:59.527+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:57:59.866 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:57:59.859+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:00.243 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:00.239+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:00.444 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:00.440+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:00.491 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:00.486+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:00.545 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:00.541+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:00.565 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:00.561+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:00.822 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:00.818+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:01.225 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:01.222+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:01.473 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:01.465+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:01.526 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:01.522+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:01.539 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:01.533+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:01.601 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:01.596+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:01.871 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:01.868+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:02.264 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:02.257+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:02.457 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:02.451+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:02.536 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:02.533+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:02.579 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:02.574+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:02.672 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:02.625+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:02.859 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:02.854+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:03.158 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:03.154+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:03.295 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:03.289+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:03.496 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:03.490+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:03.516 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:03.511+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:03.595 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:03.592+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:03.602 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:03.598+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:03.869 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:03.865+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:04.118 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:04.114+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:04.332 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:04.328+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:04.529 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:04.526+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:04.534 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:04.527+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:04.568 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:04.565+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:04.605 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:04.600+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:04.863 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:04.859+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:05.173 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:05.167+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:05.356 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:05.351+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:05.530 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:05.526+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:05.540 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:05.537+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:05.566 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:05.562+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:05.605 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:05.601+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:05.867 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:05.862+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:06.187 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:06.182+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:06.320 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:06.316+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:06.560 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:06.555+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:06.562 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:06.558+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:06.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:06.571+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:06.621 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:06.616+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:06.897 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:06.891+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:07.174 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:07.170+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:07.328 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:07.324+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:07.521 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:07.516+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:07.532 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:07.527+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:07.549 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:07.545+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:07.651 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:07.646+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:07.915 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:07.911+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:08.166 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:08.161+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:08.357 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:08.354+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:08.505 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:08.500+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:08.515 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:08.511+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:08.523 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:08.519+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:08.697 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:08.692+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:08.921 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:08.904+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:09.137 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:09.133+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:09.373 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:09.366+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:09.481 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:09.478+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:09.510 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:09.506+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:09.544 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:09.539+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:09.693 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:09.686+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:09.940 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:09.936+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:10.096 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:10.091+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:10.351 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:10.348+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:10.485 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:10.481+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:10.530 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:10.526+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:10.577 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:10.573+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:10.653 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:10.647+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:10.907 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:10.903+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:11.067 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:11.063+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:11.397 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:11.392+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:11.500 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:11.496+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:11.522 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:11.518+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:11.547 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:11.544+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:11.626 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:11.619+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:11.920 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:11.917+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:12.120 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:12.115+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:12.368 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:12.364+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:12.496 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:12.492+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:12.563 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:12.559+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:12.600 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:12.596+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:12.669 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:12.661+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:12.959 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:12.956+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:13.150 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:13.145+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:13.417 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:13.414+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:13.536 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:13.533+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:13.545 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:13.541+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:13.579 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:13.573+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:13.708 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:13.703+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:14.011 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:14.004+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:14.175 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:14.168+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:14.415 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:14.411+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:14.554 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:14.551+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:14.561 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:14.557+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:14.629 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:14.620+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:14.719 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:14.714+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:15.033 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:15.030+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:15.136 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:15.131+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:15.410 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:15.407+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:15.516 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:15.513+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:15.528 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:15.525+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:15.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:15.622+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:15.742 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:15.736+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:16.074 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:16.070+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:16.121 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:16.116+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:16.444 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:16.441+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:16.497 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:16.494+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:16.562 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:16.558+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:16.612 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:16.606+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:16.754 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:16.749+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:17.103 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:17.099+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:17.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:17.129+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:17.460 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:17.456+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:17.469 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:17.464+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:17.526 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:17.522+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:17.637 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:17.631+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:17.805 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:17.799+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:18.149 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:18.145+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:18.175 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:18.170+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:18.474 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:18.470+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:18.501 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:18.495+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:18.525 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:18.521+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:18.642 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:18.637+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:18.795 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:18.789+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:19.133 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:19.129+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:19.198 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:19.193+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:19.457 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:19.452+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:19.473 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:19.471+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:19.523 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:19.520+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:19.622 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:19.617+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:19.804 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:19.800+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:20.176 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:20.172+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:20.205 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:20.200+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:20.481 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:20.477+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:20.501 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:20.497+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:20.550 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:20.547+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:20.605 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:20.601+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:20.777 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:20.772+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:21.147 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:21.140+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:21.252 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:21.247+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:21.470 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:21.450+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:21.538 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:21.535+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:21.569 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:21.556+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:21.646 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:21.641+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:21.759 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:21.755+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:22.104 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:22.100+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:22.285 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:22.280+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:22.477 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:22.473+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:22.542 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:22.538+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:22.563 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:22.558+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:22.617 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:22.612+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:22.763 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:22.758+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:23.060 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:23.056+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:23.264 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:23.260+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:23.294 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:58:23.290+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e467 v467) 2019-12-09T19:58:23.505 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:23.501+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:23.582 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:23.578+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:23.588 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:23.584+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:23.617 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:23.612+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:23.815 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:23.808+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:24.102 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:24.099+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:24.276 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:24.272+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:24.505 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:24.501+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:24.565 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:24.561+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:24.581 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:24.572+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:24.585 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:24.578+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:24.809 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:24.803+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:25.144 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:25.140+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:25.327 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:25.323+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:25.511 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:25.507+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:25.542 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:25.537+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:25.546 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:25.543+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:25.558 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:25.554+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:25.837 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:25.823+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:26.146 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:26.142+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:26.361 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:26.356+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:26.477 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:26.473+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:26.519 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:26.511+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:26.537 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:26.533+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:26.564 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:26.559+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:26.818 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:26.813+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:27.162 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:27.158+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:27.318 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:27.313+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:27.521 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:27.516+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:58:27.523 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:27.519+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:27.530 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:27.525+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:27.584 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:58:27.578+0000 1694f700 -1 osd.2 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.953656+0000 front 2019-12-09T19:57:11.247021+0000 (oldest deadline 2019-12-09T19:57:54.384544+0000) 2019-12-09T19:58:27.786 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:58:27.782+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.746593+0000 front 2019-12-09T19:57:10.735964+0000 (oldest deadline 2019-12-09T19:57:56.586750+0000) 2019-12-09T19:58:28.184 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:58:28.180+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.443752+0000 front 2019-12-09T19:57:10.445582+0000 (oldest deadline 2019-12-09T19:57:55.446910+0000) 2019-12-09T19:58:28.361 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:58:28.354+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.611761+0000 front 2019-12-09T19:57:10.328605+0000 (oldest deadline 2019-12-09T19:58:02.146539+0000) 2019-12-09T19:58:28.364 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:58:28.352+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e467 v467) 2019-12-09T19:58:28.483 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:58:28.479+0000 1694f700 -1 osd.5 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:09.779175+0000 front 2019-12-09T19:57:10.054159+0000 (oldest deadline 2019-12-09T19:57:54.421284+0000) 2019-12-09T19:58:28.501 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:58:28.495+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.445273+0000 front 2019-12-09T19:57:10.444050+0000 (oldest deadline 2019-12-09T19:57:52.277133+0000) 2019-12-09T19:58:28.553 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T19:58:28.544+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T19:57:10.095615+0000 front 2019-12-09T19:57:10.080567+0000 (oldest deadline 2019-12-09T19:57:53.939031+0000) 2019-12-09T19:59:27.063 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:27.057+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:27.066 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:27.057+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:27.595 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:27.588+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:28.032 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:28.028+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:28.071 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:28.066+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:28.628 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:28.617+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:28.866 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:28.861+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:29.080 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:29.074+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:29.084 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:29.080+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:29.603 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:29.596+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:29.852 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:29.846+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:30.080 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:30.075+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:30.130 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:30.127+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:30.563 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:30.557+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:30.825 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:30.812+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:30.825 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:30.812+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:31.045 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:31.040+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:31.162 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:31.157+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:31.551 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:31.544+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:31.824 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:31.819+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:31.851 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:31.844+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:31.855 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:31.848+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:32.077 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:32.073+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:32.131 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:32.126+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:32.587 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:32.581+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:32.851 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:32.844+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:32.868 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:32.861+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:32.895 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:32.887+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:33.130 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:33.124+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:33.180 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:33.172+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:33.547 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:33.541+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:33.858 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:33.852+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:33.875 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:33.868+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:33.887 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:33.881+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:34.095 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:34.090+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:34.167 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:34.160+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:34.535 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:34.530+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:34.817 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:34.810+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:34.842 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:34.837+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:34.877 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:34.870+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:35.116 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:35.111+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:35.176 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:35.171+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:35.501 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:35.494+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:35.821 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:35.812+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:35.890 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:35.884+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:35.931 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:35.923+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:36.075 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:36.070+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:36.229 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:36.216+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:36.508 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:36.502+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:36.693 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:36.686+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:36.852 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:36.847+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:36.886 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:36.882+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:36.969 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:36.963+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:37.063 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:37.058+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:37.268 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:37.263+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:37.510 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:37.505+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:37.741 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:37.736+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:37.863 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:37.858+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:37.873 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:37.868+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:38.003 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:37.997+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:38.084 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:38.079+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:38.317 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:38.312+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:38.537 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:38.531+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:38.775 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:38.771+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:38.892 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:38.885+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:38.928 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:38.922+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:39.030 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:39.023+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:39.083 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:39.075+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:39.312 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:39.308+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:39.492 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:39.488+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:39.731 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:39.726+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:39.865 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:39.859+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:39.909 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:39.904+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:40.053 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:40.048+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:40.072 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:40.066+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:40.356 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:40.351+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:40.505 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:40.498+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:40.776 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:40.772+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:40.854 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:40.847+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:40.909 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:40.904+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:41.036 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:41.031+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:41.061 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:41.056+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:41.399 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:41.394+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:41.527 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:41.521+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:41.815 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:41.807+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:41.817 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:41.809+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:41.874 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:41.868+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:41.889 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:41.883+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:42.031 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:42.024+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:42.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:42.054+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:42.377 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:42.370+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:42.491 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:42.485+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:42.826 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:42.820+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:42.830 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:42.825+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:42.834 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:42.829+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:42.860 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:42.854+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:43.010 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:43.004+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:43.039 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:43.033+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:43.371 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:43.366+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:43.457 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:43.448+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:43.799 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:43.793+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:43.803 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:43.799+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:43.840 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:43.835+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:43.850 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:43.843+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:44.041 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:44.035+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:44.047 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:44.041+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:44.372 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:44.365+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:44.481 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:44.474+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:44.815 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:44.810+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:44.819 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:44.814+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:44.867 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:44.863+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:44.893 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:44.887+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:45.059 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:45.052+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:45.097 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:45.092+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:45.376 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:45.370+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:45.435 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:45.429+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:45.782 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:45.772+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:45.782 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:45.776+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:45.872 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:45.865+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:45.896 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:45.890+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:46.060 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:46.055+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:46.111 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:46.102+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:46.350 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:46.344+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:46.450 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:46.444+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:46.821 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:46.811+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:46.821 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:46.816+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:46.860 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:46.854+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:46.917 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:46.911+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:47.024 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:47.018+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:47.063 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:47.057+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:47.372 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:47.365+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:47.470 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:47.464+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:47.778 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:47.771+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:47.779 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:47.774+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:47.834 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:47.828+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:47.913 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:47.907+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:48.063 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:48.059+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:48.109 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:48.102+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:48.338 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:48.333+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:48.433 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:48.428+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:48.798 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:48.792+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:48.799 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:48.794+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:48.855 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:48.849+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:48.868 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:48.863+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:49.028 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:49.021+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:49.149 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:49.142+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:49.347 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:49.341+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:49.461 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:49.455+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:49.821 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:49.814+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:49.822 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:49.817+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:49.896 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:49.889+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:49.903 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:49.897+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:50.019 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:50.014+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:50.181 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:50.175+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:50.373 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:50.367+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:50.475 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:50.469+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:50.793 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:50.784+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:50.793 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:50.787+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:50.865 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:50.860+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:50.960 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:50.952+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:51.062 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:51.055+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:51.211 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:51.205+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:51.428 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:51.422+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:51.450 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:51.441+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:51.780 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:51.773+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:51.781 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:51.776+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:51.909 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:51.905+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:51.925 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:51.916+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:52.024 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:52.019+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:52.171 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:52.165+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:52.434 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:52.428+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:52.461 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:52.455+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:52.764 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:52.758+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:52.765 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:52.761+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:52.923 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:52.917+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:52.928 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:52.923+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:53.016 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:53.011+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:53.203 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:53.195+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:53.409 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:53.404+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:53.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:53.499+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:53.768 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:53.760+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:53.768 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:53.763+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:53.910 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:53.906+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:53.949 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:53.944+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:54.002 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:53.995+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:54.237 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:54.231+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:54.389 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:54.384+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:54.542 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:54.537+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:54.770 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:54.762+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:54.771 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:54.765+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:54.919 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:54.916+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:54.982 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:54.976+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:55.006 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:55.001+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:55.262 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:55.255+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:55.385 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:55.379+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:55.533 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:55.527+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:55.808 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:55.801+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:55.809 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:55.804+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:55.879 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:55.873+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:55.945 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:55.939+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:55.993 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:55.989+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:56.257 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:56.250+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:56.403 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:56.399+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:56.494 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:56.488+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:56.784 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:56.777+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:56.785 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:56.780+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:56.901 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:56.895+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:56.932 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:56.925+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:57.033 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:57.028+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:57.249 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:57.244+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:57.435 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:57.429+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:57.541 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:57.532+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:57.793 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:57.786+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:57.794 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:57.790+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:57.913 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:57.909+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:57.963 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:57.956+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:58.041 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:58.022+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:58.224 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:58.215+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:58.397 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:58.394+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:58.517 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:58.512+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:58.674 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T19:59:58.671+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e473 v473) 2019-12-09T19:59:58.807 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:58.800+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:58.808 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:58.803+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:58.894 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:58.889+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T19:59:58.922 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:58.916+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:59.080 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T19:59:59.073+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T19:59:59.179 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T19:59:59.173+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T19:59:59.430 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T19:59:59.424+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T19:59:59.559 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T19:59:59.552+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T19:59:59.824 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:59.818+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T19:59:59.828 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T19:59:59.824+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T19:59:59.891 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T19:59:59.884+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T19:59:59.905 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T19:59:59.901+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:00.127 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:00.121+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:00.169 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:00.164+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:00.426 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:00.421+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:00.575 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:00.570+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:00.818 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:00.812+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:00.821 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:00.817+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:00.901 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:00.895+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:00.956 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:00.951+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:01.137 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:01.132+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:01.161 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:01.154+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:01.397 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:01.391+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:01.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:01.583+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:01.781 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:01.775+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:01.782 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:01.778+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:01.882 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:01.877+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:01.944 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:01.940+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:02.119 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:02.114+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:02.153 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:02.146+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:02.399 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:02.394+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:02.645 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:02.638+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:02.831 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:02.825+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:02.835 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:02.831+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:02.869 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:02.858+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:02.977 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:02.972+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:03.142 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:03.138+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:03.169 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:03.164+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:03.393 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:03.388+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:03.669 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:03.664+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:03.691 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:00:03.689+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e473 v473) 2019-12-09T20:00:03.805 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:03.798+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:03.806 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:03.801+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:03.860 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:03.855+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:04.003 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:03.998+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:04.162 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:04.156+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:04.183 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:04.178+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:04.412 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:04.408+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:04.666 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:04.661+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:04.829 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:04.820+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:04.829 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:04.823+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:04.897 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:04.887+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:04.982 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:04.979+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:05.159 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:05.152+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:05.183 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:05.178+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:05.440 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:05.434+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:05.633 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:05.628+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:05.860 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:05.853+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:05.860 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:05.852+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:05.861 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:05.856+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:06.005 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:06.000+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:06.146 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:06.139+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:06.227 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:06.222+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:06.433 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:06.428+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:06.644 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:06.633+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:06.837 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:06.831+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:06.838 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:06.833+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:06.859 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:06.852+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:06.960 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:06.956+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:07.155 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:07.148+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:07.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:07.267+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:07.429 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:07.424+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:07.639 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:07.633+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:07.845 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:07.839+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:07.863 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:07.857+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:07.867 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:07.863+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:07.939 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:07.935+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:08.176 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:08.169+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:08.257 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:08.252+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:08.464 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:08.459+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:08.637 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:08.632+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:08.712 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:00:08.704+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e473 v473) 2019-12-09T20:00:08.802 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:08.795+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:08.896 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:08.891+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:08.899 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:08.895+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:08.978 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:08.974+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:09.175 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:09.170+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:09.295 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:09.291+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:09.443 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:09.439+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:09.663 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:09.657+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:09.818 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:09.813+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:09.950 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:09.943+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:09.960 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:09.946+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:10.031 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:10.025+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:10.197 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:10.191+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:10.298 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:10.293+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:10.475 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:10.471+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:10.668 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:10.653+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:10.788 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:10.781+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:10.974 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:10.967+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:10.975 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:10.970+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:11.012 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:11.008+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:11.159 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:11.153+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:11.288 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:11.283+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:11.458 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:11.454+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:11.667 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:11.659+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:11.823 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:11.817+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:11.942 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:11.929+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:11.943 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:11.932+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:11.989 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:11.984+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:12.202 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:12.195+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:12.262 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:12.258+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:12.512 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:12.507+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:12.684 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:12.679+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:12.796 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:12.789+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:12.981 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:12.974+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:12.982 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:12.977+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:13.023 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:13.014+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:13.161 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:13.151+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:13.270 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:13.265+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:13.498 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:13.493+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:13.684 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:13.677+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:13.719 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:00:13.714+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e473 v473) 2019-12-09T20:00:13.761 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:13.752+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:14.031 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:14.025+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:14.033 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:14.027+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:14.060 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:14.055+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:14.152 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:14.146+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:14.269 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:14.264+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:14.506 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:14.502+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:14.662 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:14.656+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:14.724 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:14.717+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:15.082 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:15.074+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:15.083 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:15.078+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:15.112 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:15.107+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:15.208 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:15.202+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:15.258 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:15.254+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:15.474 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:15.467+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:15.671 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:15.665+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:15.726 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:15.720+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:16.061 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:16.054+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:16.065 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:16.060+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:16.099 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:16.094+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:16.249 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:16.245+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:16.262 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:16.255+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:16.430 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:16.426+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:16.667 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:16.660+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:16.777 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:16.771+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:17.059 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:17.053+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:17.063 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:17.059+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:17.137 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:17.130+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:17.220 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:17.214+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:17.267 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:17.263+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:17.398 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:17.393+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:17.714 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:17.708+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:17.797 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:17.792+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:18.091 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:18.081+0000 1694f700 -1 osd.6 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T19:59:01.359090+0000 (oldest deadline 2019-12-09T19:59:41.359090+0000) 2019-12-09T20:00:18.091 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:18.084+0000 1694f700 -1 osd.6 473 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:18.178 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:00:18.173+0000 1694f700 -1 osd.3 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:43.606871+0000 front 2019-12-09T19:58:43.553836+0000 (oldest deadline 2019-12-09T19:59:28.241950+0000) 2019-12-09T20:00:18.232 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:18.227+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:18.248 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:00:18.241+0000 1694f700 -1 osd.5 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:45.579806+0000 front 2019-12-09T19:58:45.553417+0000 (oldest deadline 2019-12-09T19:59:31.298363+0000) 2019-12-09T20:00:18.364 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:00:18.359+0000 1694f700 -1 osd.1 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:42.911888+0000 front 2019-12-09T19:58:42.799719+0000 (oldest deadline 2019-12-09T19:59:26.850081+0000) 2019-12-09T20:00:18.744 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:00:18.737+0000 1694f700 -1 osd.7 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:41.835054+0000 front 2019-12-09T19:58:41.517304+0000 (oldest deadline 2019-12-09T19:59:26.609136+0000) 2019-12-09T20:00:18.760 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:00:18.756+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e473 v473) 2019-12-09T20:00:18.846 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:00:18.819+0000 1694f700 -1 osd.4 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:44.688195+0000 front 2019-12-09T19:58:44.035632+0000 (oldest deadline 2019-12-09T19:59:29.790350+0000) 2019-12-09T20:00:19.235 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:00:19.232+0000 1694f700 -1 osd.2 473 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T19:58:40.922204+0000 front 2019-12-09T19:58:40.957746+0000 (oldest deadline 2019-12-09T19:59:26.811083+0000) 2019-12-09T20:00:19.536 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:00:19.520+0000 1694f700 -1 osd.6 474 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e471) 2019-12-09T20:00:47.729 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:00:47.707+0000 31786700 -1 osd.0 478 build_incremental_map_msg missing incremental map 478 2019-12-09T20:00:47.773 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:00:47.722+0000 31786700 -1 osd.0 478 build_incremental_map_msg missing incremental map 478 2019-12-09T20:00:51.142 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:00:51.128+0000 36f91700 -1 osd.0 479 build_incremental_map_msg missing incremental map 478 2019-12-09T20:01:24.111 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:55:45.170 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:01:24.121 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:55:45.178 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:01:24.130 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:55:45.188 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:01:24.134 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:55:45.192 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:01:24.134 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:55:45.168 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:01:24.139 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:55:45.173 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:01:24.349 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:55:45.408 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:01:24.375 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:55:45.433 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:01:24.423 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:55:45.457 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:01:46.787 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:46.781+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:47.028 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:47.023+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:47.563 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:47.558+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:47.822 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:47.817+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:48.073 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:48.066+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:48.546 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:48.541+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:48.603 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:01:48.597+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:01:48.748 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:01:48.744+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:01:48.784 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:48.779+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:49.029 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:01:49.023+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:01:49.091 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:49.083+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:49.568 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:49.563+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:49.611 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:01:49.605+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:01:49.782 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:49.778+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:49.786 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:01:49.781+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:01:49.912 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:01:49.907+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:01:49.988 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:01:49.981+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:01:50.065 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:50.058+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:50.567 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:50.561+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:50.607 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:01:50.602+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:01:50.745 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:01:50.741+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:01:50.766 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:50.758+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:50.935 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:01:50.929+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:01:50.984 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:01:50.977+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:01:51.029 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:51.024+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:51.546 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:51.541+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:51.620 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:01:51.615+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:01:51.747 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:01:51.742+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:01:51.763 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:51.757+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:51.901 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:01:51.892+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:01:52.009 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:52.005+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:52.023 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:01:52.019+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:01:52.557 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:52.553+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:52.675 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:01:52.670+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:01:52.754 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:01:52.748+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:01:52.809 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:52.803+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:52.932 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:01:52.927+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:01:53.014 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:01:53.009+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:01:53.052 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:53.046+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:53.543 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:53.537+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:53.657 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:01:53.652+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:01:53.742 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:01:53.736+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:01:53.842 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:53.836+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:53.902 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:01:53.897+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:01:54.026 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:01:54.021+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:01:54.069 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:54.062+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:54.549 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:54.543+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:54.702 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:01:54.697+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:01:54.737 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:01:54.732+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:01:54.833 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:54.828+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:54.922 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:01:54.917+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:01:55.022 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:01:55.016+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:01:55.074 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:55.069+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:55.507 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:55.502+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:55.704 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:01:55.698+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:01:55.718 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:01:55.712+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:01:55.819 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:55.815+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:55.937 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:01:55.931+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:01:56.049 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:56.038+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:56.068 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:01:56.063+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:01:56.545 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:56.539+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:56.682 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:01:56.676+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:01:56.706 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:01:56.700+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:01:56.851 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:56.842+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:56.988 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:01:56.976+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:01:57.047 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:57.042+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:57.070 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:01:57.063+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:01:57.536 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:57.531+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:57.689 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:01:57.677+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:01:57.692 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:01:57.687+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:01:57.807 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:57.802+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:58.027 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:01:58.018+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:01:58.041 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:01:58.019+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:01:58.044 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:58.038+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:58.555 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:58.550+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:58.665 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:01:58.659+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:01:58.672 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:01:58.667+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:01:58.857 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:58.852+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:58.986 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:01:58.980+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:01:59.018 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:01:59.014+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:01:59.090 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:01:59.082+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:01:59.537 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:01:59.531+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:01:59.664 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:01:59.659+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:01:59.697 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:01:59.692+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:01:59.851 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:01:59.845+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:01:59.988 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:01:59.982+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:00.017 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:00.012+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:00.068 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:00.064+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:00.538 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:00.533+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:00.663 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:00.657+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:00.671 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:00.666+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:00.812 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:00.806+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:00.972 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:00.966+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:01.039 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:01.032+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:01.116 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:01.110+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:01.514 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:01.508+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:01.649 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:01.640+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:01.699 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:01.687+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:01.814 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:01.772+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:01.986 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:01.979+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:02.028 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:02.022+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:02.111 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:02.106+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:02.563 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:02.558+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:02.649 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:02.643+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:02.691 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:02.686+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:02.816 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:02.812+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:02.973 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:02.969+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:03.020 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:03.014+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:03.070 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:03.065+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:03.611 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:03.607+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:03.626 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:03.621+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:03.742 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:03.738+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:03.832 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:03.827+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:03.941 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:03.936+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:04.041 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:04.034+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:04.066 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:04.053+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:04.609 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:04.604+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:04.654 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:04.649+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:04.723 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:04.719+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:04.873 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:04.869+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:04.924 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:04.920+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:05.036 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:05.032+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:05.066 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:05.061+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:05.648 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:05.643+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:05.659 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:05.654+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:05.742 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:05.739+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:05.896 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:05.891+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:05.919 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:05.914+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:06.061 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:06.052+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:06.095 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:06.089+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:06.664 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:06.658+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:06.698 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:06.692+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:06.726 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:06.721+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:06.905 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:06.898+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:06.917 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:06.910+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:07.064 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:07.058+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:07.069 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:07.065+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:07.701 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:07.693+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:07.721 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:07.716+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:07.728 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:07.723+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:07.923 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:07.917+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:07.950 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:07.946+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:08.038 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:08.032+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:08.108 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:08.103+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:08.737 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:08.733+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:08.742 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:08.737+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:08.759 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:08.753+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:08.957 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:08.953+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:08.973 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:08.969+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:09.091 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:09.087+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:09.150 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:09.142+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:09.769 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:09.764+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:09.783 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:09.780+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:09.796 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:09.787+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:09.949 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:09.945+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:10.011 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:10.007+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:10.117 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:10.113+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:10.179 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:10.175+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:10.752 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:10.747+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:10.779 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:10.773+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:10.783 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:10.778+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:10.950 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:10.945+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:11.059 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:11.056+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:11.118 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:11.113+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:11.183 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:11.178+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:11.737 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:11.731+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:11.802 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:11.794+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:11.831 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:11.814+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:11.987 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:11.983+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:12.038 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:12.034+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:12.122 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:12.116+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:12.140 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:12.134+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:12.709 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:12.705+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:12.768 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:12.762+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:12.855 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:12.849+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:12.961 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:12.957+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:13.056 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:13.050+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:13.083 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:13.078+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:13.111 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:13.106+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:13.672 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:13.669+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:13.731 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:13.726+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:13.836 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:13.829+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:13.977 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:13.974+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:14.019 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:14.015+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:14.083 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:14.077+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:14.158 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:14.154+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:14.645 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:14.641+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:14.720 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:14.714+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:14.797 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:14.792+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:14.945 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:14.941+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:15.020 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:15.016+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:15.113 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:15.109+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:15.135 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:15.131+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:15.697 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:15.689+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:15.769 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:15.757+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:15.843 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:15.839+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:15.973 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:15.968+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:15.975 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:15.971+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:16.103 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:16.097+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:16.112 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:16.108+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:16.744 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:16.737+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:16.756 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:16.752+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:16.847 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:16.840+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:16.950 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:16.946+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:16.968 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:16.963+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:17.102 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:17.098+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:17.122 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:17.117+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:17.725 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:17.720+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:17.765 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:17.761+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:17.825 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:17.820+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:17.935 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:17.931+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:18.008 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:18.002+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:18.109 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:18.100+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:18.129 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:18.124+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:18.736 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:18.732+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:18.753 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:18.748+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:18.809 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:18.805+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:18.952 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:18.948+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:19.043 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:19.039+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:19.084 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:19.080+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:19.136 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:02:19.133+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 41sec e479 v479) 2019-12-09T20:02:19.160 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:19.155+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:19.763 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:19.758+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:19.774 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:19.769+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:19.804 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:19.792+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:19.950 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:19.946+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:20.078 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:20.072+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:20.116 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:20.112+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:20.165 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:20.160+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:20.767 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:20.762+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:20.811 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:20.806+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:20.826 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:20.821+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:20.923 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:20.917+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:21.119 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:21.106+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:21.155 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:21.151+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:21.176 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:21.171+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:21.733 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:21.729+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:21.797 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:21.791+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:21.829 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:21.825+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:21.881 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:21.877+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:22.084 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:22.081+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:22.176 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:22.171+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:22.203 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:22.199+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:22.711 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:22.707+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:22.764 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:22.759+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:22.789 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:22.785+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:22.887 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:22.883+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:23.040 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:23.036+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:23.176 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:23.170+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:23.194 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:23.190+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:23.725 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:02:23.721+0000 1694f700 -1 osd.4 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:01.914023+0000 front 2019-12-09T20:01:03.823044+0000 (oldest deadline 2019-12-09T20:01:47.006674+0000) 2019-12-09T20:02:23.729 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:02:23.725+0000 1694f700 -1 osd.2 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:04.690140+0000 front 2019-12-09T20:01:06.059747+0000 (oldest deadline 2019-12-09T20:01:48.055006+0000) 2019-12-09T20:02:23.781 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:02:23.773+0000 1694f700 -1 osd.7 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.949677+0000 front 2019-12-09T20:01:06.960442+0000 (oldest deadline 2019-12-09T20:01:48.342598+0000) 2019-12-09T20:02:23.928 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:02:23.924+0000 1694f700 -1 osd.0 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.850705+0000 front 2019-12-09T20:01:07.004303+0000 (oldest deadline 2019-12-09T20:01:46.302214+0000) 2019-12-09T20:02:24.035 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:02:24.030+0000 1694f700 -1 osd.3 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:02.441916+0000 front 2019-12-09T20:01:02.646968+0000 (oldest deadline 2019-12-09T20:01:48.154500+0000) 2019-12-09T20:02:24.165 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:02:24.161+0000 1694f700 -1 osd.5 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:06.076955+0000 front 2019-12-09T20:01:07.381472+0000 (oldest deadline 2019-12-09T20:01:46.843438+0000) 2019-12-09T20:02:24.207 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:02:24.201+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 41sec e479 v479) 2019-12-09T20:02:24.209 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:02:24.206+0000 1694f700 -1 osd.1 479 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:01:05.537404+0000 front 2019-12-09T20:01:04.673415+0000 (oldest deadline 2019-12-09T20:01:49.789028+0000) 2019-12-09T20:02:34.446 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:56:55.504 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:02:34.453 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:56:55.511 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:02:34.507 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:56:55.565 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:02:34.509 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:56:55.567 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:02:34.519 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:56:55.577 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:02:34.536 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:56:55.570 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:02:34.545 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:56:55.580 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:02:34.579 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:56:55.636 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:02:34.650 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:56:55.684 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:03:04.492 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:04.458+0000 31786700 -1 osd.6 484 build_incremental_map_msg missing incremental map 484 2019-12-09T20:03:23.226 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:23.220+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:23.390 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:23.385+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:24.189 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:24.182+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:24.396 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:24.390+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:24.405 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:24.400+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:25.097 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:25.094+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:25.151 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:25.145+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:25.396 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:25.389+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:25.431 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:25.427+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:26.141 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:26.136+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:26.198 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:26.192+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:26.414 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:26.408+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:26.424 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:26.420+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:26.632 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:26.628+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:26.653 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:26.646+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:27.105 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:27.102+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:27.246 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:27.241+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:27.395 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:27.389+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:27.415 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:27.406+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:27.601 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:27.597+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:27.673 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:27.667+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:28.081 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:28.077+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:28.206 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:28.200+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:28.375 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:28.369+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:28.431 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:28.424+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:28.632 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:28.627+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:28.683 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:28.667+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:29.075 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:29.071+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:29.219 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:29.213+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:29.356 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:29.352+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:29.466 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:29.461+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:29.635 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:29.631+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:29.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:29.713+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:30.051 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:30.046+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:30.174 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:30.167+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:30.322 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:30.318+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:30.429 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:30.423+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:30.604 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:30.599+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:30.749 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:30.743+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:31.045 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:31.040+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:31.184 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:31.178+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:31.371 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:31.367+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:31.430 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:31.424+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:31.621 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:31.617+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:31.797 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:31.792+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:32.039 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:32.033+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:32.201 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:32.196+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:32.360 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:32.354+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:32.404 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:32.398+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:32.652 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:32.649+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:32.797 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:32.788+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:33.079 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:33.075+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:33.217 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:33.210+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:33.398 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:33.393+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:33.435 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:33.430+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:33.616 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:33.612+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:33.835 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:33.827+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:34.043 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:34.037+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:34.231 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:34.225+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:34.399 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:34.394+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:34.439 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:34.433+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:34.652 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:34.647+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:34.866 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:34.861+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:35.052 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:35.046+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:35.229 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:35.225+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:35.268 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:35.263+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:35.427 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:35.422+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:35.437 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:35.428+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:35.655 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:35.650+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:35.898 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:35.891+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:36.031 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:36.026+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:36.193 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:36.189+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:36.314 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:36.309+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:36.397 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:36.393+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:36.429 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:36.424+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:36.670 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:36.667+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:36.891 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:36.886+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:36.996 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:36.991+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:37.182 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:37.177+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:37.303 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:37.297+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:37.449 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:37.444+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:37.485 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:37.479+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:37.705 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:37.699+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:37.893 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:37.887+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:38.032 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:38.028+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:38.175 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:38.170+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:38.315 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:38.309+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:38.488 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:38.483+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:38.522 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:38.516+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:38.682 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:38.676+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:38.904 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:38.898+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:39.023 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:39.019+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:39.182 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:39.177+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:39.301 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:39.295+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:39.470 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:39.464+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:39.554 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:39.548+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:39.728 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:39.723+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:39.928 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:39.922+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:40.068 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:40.064+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:40.209 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:40.204+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:40.265 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:40.259+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:40.435 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:40.431+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:40.523 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:40.517+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:40.699 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:40.694+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:40.952 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:40.946+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:41.126 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:41.119+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:41.165 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:41.158+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:41.166 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:41.161+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:41.222 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:41.216+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:41.468 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:41.464+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:41.501 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:41.494+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:41.718 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:41.714+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:41.977 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:41.970+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:42.130 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:42.123+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:42.137 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:42.126+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:42.172 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:42.166+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:42.228 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:42.221+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:42.465 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:42.460+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:42.525 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:42.518+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:42.719 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:42.714+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:42.950 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:42.943+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:43.100 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:43.095+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:43.104 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:43.100+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:43.187 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:43.182+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:43.197 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:43.191+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:43.473 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:43.468+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:43.494 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:43.488+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:43.692 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:43.686+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:43.976 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:43.970+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:44.076 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:44.068+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:44.078 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:44.072+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:44.144 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:44.140+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:44.193 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:44.187+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:44.429 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:44.425+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:44.538 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:44.532+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:44.699 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:44.696+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:44.955 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:44.948+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:45.076 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:45.069+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:45.077 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:45.072+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:45.169 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:45.165+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:45.204 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:45.198+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:45.426 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:45.423+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:45.495 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:45.490+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:45.752 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:45.747+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:46.010 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:45.991+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:46.123 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:46.117+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:46.124 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:46.120+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:46.157 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:46.154+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:46.172 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:46.166+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:46.445 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:46.433+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:46.517 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:46.511+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:46.764 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:46.759+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:46.967 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:46.960+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:47.166 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:47.153+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:47.166 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:47.156+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:47.184 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:47.179+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:47.204 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:47.199+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:47.473 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:47.467+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:47.498 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:47.492+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:47.732 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:47.726+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:47.976 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:47.969+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:48.130 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:48.123+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:48.132 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:48.127+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:48.142 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:48.136+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:48.242 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:48.238+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:48.496 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:48.492+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:48.533 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:48.526+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:48.710 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:48.705+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:48.950 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:48.943+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:49.154 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:49.148+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:49.163 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:49.157+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:49.165 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:49.160+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:49.250 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:49.244+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:49.463 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:49.457+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:49.488 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:49.481+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:49.703 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:49.698+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:49.980 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:49.974+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:50.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:50.128+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:50.188 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:50.181+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:50.190 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:50.185+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:50.274 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:50.268+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:50.482 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:50.476+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:50.507 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:50.501+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:50.697 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:50.692+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:50.990 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:50.984+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:51.168 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:51.161+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:51.235 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:51.228+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:51.242 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:51.235+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:51.243 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:51.238+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:51.466 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:51.460+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:51.494 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:51.489+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:51.702 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:51.697+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:51.999 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:51.993+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:52.173 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:52.168+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:52.254 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:52.249+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:52.255 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:52.251+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:52.281 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:52.276+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:52.468 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:52.463+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:52.510 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:52.505+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:52.734 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:52.729+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:53.053 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:53.047+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:53.183 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:53.177+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:53.260 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:53.256+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:53.280 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:53.276+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:53.285 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:53.280+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:53.475 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:53.468+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:53.511 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:53.506+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:53.715 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:53.708+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:54.092 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:54.087+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:54.170 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:54.164+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:54.287 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:54.281+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:54.307 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:54.301+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:54.310 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:54.305+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:54.436 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:54.427+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:54.517 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:54.510+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:54.623 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:03:54.618+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e485 v485) 2019-12-09T20:03:54.707 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:54.702+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:55.079 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:55.074+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:55.161 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:55.154+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:55.286 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:55.280+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:55.368 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:55.358+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:55.370 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:55.361+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:55.454 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:55.446+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:55.517 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:55.510+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:55.740 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:55.734+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:56.123 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:56.116+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:56.172 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:56.166+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:56.305 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:56.299+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:56.347 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:56.337+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:56.347 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:56.340+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:56.480 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:56.474+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:56.483 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:56.478+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:56.725 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:56.715+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:57.168 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:57.162+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:57.199 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:57.193+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:57.345 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:57.340+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:57.349 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:57.344+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:57.357 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:57.350+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:57.474 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:57.467+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:57.492 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:57.486+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:57.726 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:57.719+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:58.168 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:58.161+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:58.234 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:58.225+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:58.313 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:58.308+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:58.370 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:58.363+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:58.371 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:58.366+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:58.450 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:58.445+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:58.507 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:58.501+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:58.742 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:58.737+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:03:59.186 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:03:59.179+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:03:59.212 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:03:59.206+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:03:59.367 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:03:59.361+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:03:59.410 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:59.402+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:03:59.413 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:03:59.406+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:03:59.466 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:03:59.458+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:03:59.522 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:03:59.516+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:03:59.632 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:03:59.627+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e485 v485) 2019-12-09T20:03:59.775 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:03:59.769+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:00.144 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:00.138+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:00.243 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:00.236+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:00.364 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:00.356+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:00.406 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:00.400+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:00.410 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:00.406+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:00.445 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:00.440+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:00.511 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:00.505+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:00.793 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:00.787+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:01.181 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:01.174+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:01.244 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:01.238+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:01.387 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:01.374+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:01.404 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:01.398+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:01.408 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:01.403+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:01.412 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:01.408+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:01.466 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:01.460+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:01.749 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:01.743+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:02.139 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:02.133+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:02.288 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:02.282+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:02.367 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:02.360+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:02.417 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:02.410+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:02.418 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:02.413+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:02.429 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:02.423+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:02.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:02.511+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:02.777 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:02.771+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:03.145 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:03.138+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:03.250 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:03.244+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:03.377 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:03.371+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:03.415 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:03.409+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:03.470 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:03.464+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:03.474 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:03.470+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:03.555 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:03.549+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:03.771 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:03.764+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:04.165 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:04.159+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:04.221 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:04.214+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:04.337 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:04.332+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:04.443 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:04.436+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:04.495 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:04.489+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:04.499 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:04.495+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:04.548 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:04.542+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:04.650 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:04:04.643+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e485 v485) 2019-12-09T20:04:04.781 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:04.777+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:05.159 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:05.153+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:05.207 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:05.200+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:05.320 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:05.315+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:05.433 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:05.427+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:05.490 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:05.483+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:05.492 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:05.486+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:05.569 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:05.562+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:05.794 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:05.787+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:06.155 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:06.148+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:06.203 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:06.197+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:06.328 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:06.323+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:06.406 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:06.401+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:06.454 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:06.449+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:06.458 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:06.454+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:06.586 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:06.579+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:06.829 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:06.824+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:07.189 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:07.183+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:07.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:07.203+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:07.321 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:07.316+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:07.419 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:07.413+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:07.432 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:07.426+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:07.434 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:07.429+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:07.586 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:07.581+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:07.842 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:07.837+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:08.181 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:08.176+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:08.237 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:08.233+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:08.373 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:08.368+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:08.438 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:08.433+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:08.445 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:08.440+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:08.446 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:08.442+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:08.624 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:08.618+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:08.874 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:08.869+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:09.216 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:09.211+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:09.222 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:09.211+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:09.387 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:09.381+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:09.406 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:09.401+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:09.407 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:09.402+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:09.410 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:09.406+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:09.587 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:09.572+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:09.661 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:04:09.657+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e485 v485) 2019-12-09T20:04:09.892 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:09.887+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:10.205 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:10.199+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:10.247 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:10.240+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:10.377 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:10.371+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:10.384 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:10.374+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:10.387 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:10.380+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:10.415 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:10.410+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:10.598 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:10.591+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:10.866 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:10.859+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:11.171 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:11.165+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:11.272 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:11.266+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:11.378 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:11.373+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:11.381 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:11.371+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:11.383 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:11.376+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:11.438 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:11.434+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:11.621 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:11.616+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:11.897 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:11.892+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:12.152 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:12.146+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:12.232 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:12.226+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:12.405 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:12.400+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:12.412 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:12.405+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:12.413 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:12.408+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:12.423 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:12.418+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:12.669 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:12.662+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:12.886 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:12.880+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:13.184 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:13.177+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:13.285 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:13.278+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:13.392 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:13.387+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:13.410 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:13.407+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:13.462 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:13.455+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:13.463 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:13.458+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:13.631 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:13.624+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:13.874 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:04:13.869+0000 1694f700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.407180+0000 front 2019-12-09T20:02:40.492141+0000 (oldest deadline 2019-12-09T20:03:25.676588+0000) 2019-12-09T20:04:14.211 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:04:14.204+0000 1694f700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.005424+0000 front 2019-12-09T20:02:40.003556+0000 (oldest deadline 2019-12-09T20:03:22.694437+0000) 2019-12-09T20:04:14.278 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:04:14.272+0000 1694f700 -1 osd.5 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.986808+0000 front 2019-12-09T20:02:41.080261+0000 (oldest deadline 2019-12-09T20:03:26.501234+0000) 2019-12-09T20:04:14.433 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:04:14.429+0000 1694f700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:40.634836+0000 front 2019-12-09T20:02:40.172962+0000 (oldest deadline 2019-12-09T20:03:24.256890+0000) 2019-12-09T20:04:14.436 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:04:14.431+0000 1694f700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:38.253607+0000 front 2019-12-09T20:02:38.274223+0000 (oldest deadline 2019-12-09T20:03:22.936918+0000) 2019-12-09T20:04:14.497 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:14.491+0000 1694f700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:03:00.661327+0000 (oldest deadline 2019-12-09T20:03:40.661327+0000) 2019-12-09T20:04:14.502 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:04:14.497+0000 1694f700 -1 osd.6 485 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e484) 2019-12-09T20:04:14.623 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:04:14.617+0000 1694f700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:02:39.500366+0000 front 2019-12-09T20:02:39.460232+0000 (oldest deadline 2019-12-09T20:03:24.135864+0000) 2019-12-09T20:04:14.710 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:04:14.707+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e485 v485) 2019-12-09T20:05:22.952 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:59:44.010 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:05:22.961 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:59:44.020 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:05:22.967 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:59:44.026 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:05:22.968 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:59:44.002 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:05:22.971 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:59:44.030 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:05:22.973 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:59:44.007 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:05:23.171 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:08:59:44.224 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:05:23.172 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:08:59:44.206 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:05:23.182 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:08:59:44.241 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:05:39.934 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:39.927+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:40.174 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:40.171+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:40.921 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:40.915+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:41.139 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:41.135+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:41.550 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:41.546+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:41.966 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:41.961+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:42.104 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:42.100+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:42.121 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:42.110+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:42.533 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:42.529+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:42.871 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:42.867+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:43.017 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:43.008+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:43.133 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:43.126+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:43.160 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:43.156+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:43.526 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:43.521+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:43.842 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:43.837+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:43.934 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:43.930+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:44.041 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:44.033+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:44.126 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:44.121+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:44.158 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:44.153+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:44.550 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:44.546+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:44.817 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:44.813+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:44.825 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:44.821+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:44.891 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:44.887+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:45.022 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:45.016+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:45.133 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:45.129+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:45.165 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:45.160+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:45.581 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:45.577+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:45.800 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:45.795+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:45.804 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:45.800+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:45.865 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:45.859+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:46.010 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:46.005+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:46.121 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:46.112+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:46.169 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:46.162+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:46.558 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:46.554+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:46.833 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:46.827+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:46.854 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:46.850+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:46.870 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:46.866+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:46.992 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:46.988+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:47.105 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:47.102+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:47.136 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:47.132+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:47.541 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:47.537+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:47.851 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:47.847+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:47.854 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:47.847+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:47.858 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:47.854+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:47.998 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:47.992+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:48.110 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:48.105+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:48.156 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:48.150+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:48.497 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:48.493+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:48.833 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:48.826+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:48.833 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:48.829+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:48.915 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:48.905+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:48.973 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:48.968+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:49.113 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:49.108+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:49.168 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:49.163+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:49.490 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:49.486+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:49.816 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:49.810+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:49.871 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:49.868+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:49.927 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:49.924+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:50.005 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:50.000+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:50.075 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:50.071+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:50.130 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:50.125+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:50.487 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:50.483+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:50.773 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:50.768+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:50.839 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:50.835+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:50.927 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:50.923+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:51.000 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:50.995+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:51.102 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:51.098+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:51.175 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:51.170+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:51.466 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:51.463+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:51.816 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:51.811+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:51.825 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:51.821+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:51.887 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:51.883+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:52.036 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:52.031+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:52.144 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:52.140+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:52.203 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:52.198+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:52.483 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:52.478+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:52.825 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:52.820+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:52.863 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:52.859+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:52.900 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:52.895+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:53.063 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:53.058+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:53.107 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:53.103+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:53.232 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:53.226+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:53.506 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:53.503+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:53.876 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:53.871+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:53.893 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:53.889+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:53.939 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:53.935+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:54.089 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:54.084+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:54.131 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:54.126+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:54.258 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:54.253+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:54.493 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:54.486+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:54.852 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:54.847+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:54.909 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:54.903+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:54.911 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:54.907+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:55.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:55.061+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:55.106 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:55.103+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:55.213 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:55.207+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:55.545 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:55.541+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:55.814 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:55.809+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:55.891 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:55.886+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:55.961 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:55.956+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:56.045 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:56.040+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:56.158 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:56.155+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:56.212 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:56.207+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:56.598 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:56.594+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:56.847 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:56.843+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:56.876 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:56.870+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:56.919 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:56.914+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:57.092 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:57.086+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:57.177 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:57.173+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:57.189 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:57.185+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:57.564 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:57.559+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:57.844 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:57.840+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:57.897 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:57.892+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:57.939 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:57.934+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:58.073 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:58.068+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:58.153 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:58.149+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:58.213 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:58.204+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:58.521 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:58.514+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:58.850 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:58.845+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:58.878 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:58.874+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:58.979 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:58.973+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:05:59.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:05:59.062+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:05:59.205 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:05:59.195+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:05:59.222 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:05:59.215+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:05:59.566 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:05:59.560+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:05:59.863 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:05:59.858+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:05:59.904 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:05:59.899+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:05:59.935 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:05:59.930+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:00.032 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:00.028+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:00.179 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:00.174+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:00.201 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:00.194+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:00.577 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:00.572+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:00.907 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:00.902+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:00.927 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:00.922+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:00.936 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:00.929+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:01.071 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:01.066+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:01.156 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:01.152+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:01.211 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:01.207+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:01.549 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:01.544+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:01.923 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:01.918+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:01.946 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:01.942+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:01.993 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:01.980+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:02.086 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:02.082+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:02.122 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:02.116+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:02.240 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:02.235+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:02.566 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:02.561+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:02.920 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:02.916+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:02.939 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:02.935+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:02.956 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:02.952+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:03.125 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:03.120+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:03.134 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:03.129+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:03.214 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:03.210+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:03.530 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:03.525+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:03.928 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:03.923+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:03.931 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:03.927+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:03.932 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:03.927+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:04.127 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:04.123+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:04.162 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:04.156+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:04.204 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:04.198+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:04.553 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:04.548+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:04.898 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:04.894+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:04.912 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:04.907+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:04.926 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:04.922+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:05.131 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:05.127+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:05.198 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:05.192+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:05.231 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:05.225+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:05.606 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:05.602+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:05.935 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:05.929+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:05.938 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:05.933+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:05.959 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:05.954+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:06.103 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:06.099+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:06.244 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:06.238+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:06.247 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:06.242+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:06.599 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:06.593+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:06.889 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:06.884+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:06.931 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:06.926+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:06.941 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:06.937+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:07.063 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:07.058+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:07.253 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:07.248+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:07.296 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:07.291+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:07.554 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:07.548+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:07.873 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:07.867+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:07.921 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:07.915+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:07.937 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:07.932+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:08.101 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:08.095+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:08.281 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:08.276+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:08.340 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:08.334+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:08.524 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:08.518+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:08.916 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:08.911+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:08.920 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:08.914+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:08.939 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:08.934+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:09.060 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:09.055+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:09.299 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:09.294+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:09.381 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:09.376+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:09.570 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:09.564+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:09.894 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:09.889+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:09.929 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:09.925+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:09.942 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:09.937+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:10.083 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:10.077+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:10.321 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:10.316+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:10.428 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:10.423+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:10.539 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:10.533+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:10.893 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:10.886+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:10.974 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:10.968+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:10.990 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:10.986+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:11.136 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:11.130+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:11.322 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:11.317+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:11.423 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:11.418+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:11.499 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:11.492+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:11.864 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:11.858+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:11.965 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:11.960+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:12.031 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:12.026+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:12.180 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:12.175+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:12.308 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:12.303+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:12.417 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:12.412+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:12.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:12.478+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:12.841 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:12.837+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:12.973 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:12.966+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:13.081 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:13.076+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:13.142 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:13.138+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:13.318 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:13.312+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:13.391 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:13.386+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:13.506 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:13.501+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:13.886 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:13.882+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:13.997 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:13.992+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:14.110 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:14.105+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:14.197 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:14.191+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:14.296 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:14.290+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:14.416 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:14.411+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:14.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:14.476+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:14.914 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:14.909+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:15.021 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:15.016+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:15.040 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:06:15.036+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 46sec e490 v490) 2019-12-09T20:06:15.155 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:15.151+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:15.183 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:15.179+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:15.285 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:15.279+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:15.409 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:15.405+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:15.534 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:15.529+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:15.925 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:15.920+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:16.044 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:16.039+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:16.173 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:16.167+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:16.198 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:16.194+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:16.335 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:16.330+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:16.393 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:16.388+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:16.516 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:16.510+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:16.970 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:16.965+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:17.035 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:17.030+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:17.145 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:17.140+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:17.223 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:17.218+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:17.368 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:17.363+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:17.382 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:17.373+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:17.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:17.477+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:17.941 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:17.936+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:18.010 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:18.001+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:18.138 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:18.134+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:18.265 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:18.254+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:18.367 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:18.362+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:18.376 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:18.372+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:18.494 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:18.489+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:18.914 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:18.908+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:19.044 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:19.039+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:19.120 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:19.115+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:19.225 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:19.219+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:06:19.387 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:06:19.382+0000 1694f700 -1 osd.4 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.584355+0000 front 2019-12-09T20:04:55.931284+0000 (oldest deadline 2019-12-09T20:05:41.205289+0000) 2019-12-09T20:06:19.393 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:06:19.389+0000 1694f700 -1 osd.1 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:56.521284+0000 front 2019-12-09T20:04:55.915939+0000 (oldest deadline 2019-12-09T20:05:40.148244+0000) 2019-12-09T20:06:19.485 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:06:19.471+0000 1694f700 -1 osd.3 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:55.581392+0000 front 2019-12-09T20:04:55.582696+0000 (oldest deadline 2019-12-09T20:05:41.249539+0000) 2019-12-09T20:06:19.936 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:06:19.931+0000 1694f700 -1 osd.2 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:57.785938+0000 front 2019-12-09T20:04:57.824249+0000 (oldest deadline 2019-12-09T20:05:42.967338+0000) 2019-12-09T20:06:20.054 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:06:20.049+0000 1694f700 -1 osd.0 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:58.647547+0000 front 2019-12-09T20:04:58.571278+0000 (oldest deadline 2019-12-09T20:05:41.997677+0000) 2019-12-09T20:06:20.097 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:06:20.091+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 46sec e490 v490) 2019-12-09T20:06:20.154 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:06:20.148+0000 1694f700 -1 osd.7 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.956726+0000 front 2019-12-09T20:04:58.652441+0000 (oldest deadline 2019-12-09T20:05:39.910623+0000) 2019-12-09T20:06:20.269 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:06:20.264+0000 1694f700 -1 osd.5 490 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:04:59.451819+0000 front 2019-12-09T20:04:59.519368+0000 (oldest deadline 2019-12-09T20:05:43.888994+0000) 2019-12-09T20:07:19.111 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:19.105+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:19.627 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:19.622+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:19.806 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:19.799+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:20.017 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:20.010+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:20.104 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:20.099+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:20.221 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:20.215+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:20.228 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:20.221+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:20.621 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:20.612+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:20.790 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:20.783+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:21.006 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:20.999+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:21.120 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:21.115+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:21.202 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:21.194+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:21.261 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:21.254+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:21.573 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:21.568+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:21.826 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:21.818+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:22.049 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:22.043+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:22.160 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:22.154+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:22.166 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:22.160+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:22.312 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:22.306+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:22.619 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:22.614+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:22.796 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:22.788+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:23.102 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:23.095+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:23.167 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:23.155+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:23.219 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:23.212+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:23.290 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:23.284+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:23.616 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:23.611+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:23.760 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:23.752+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:24.089 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:24.081+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:24.141 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:24.136+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:24.176 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:24.169+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:24.255 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:24.249+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:24.581 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:24.576+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:24.620 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:24.613+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:24.726 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:24.718+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:25.117 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:25.110+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:25.138 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:25.133+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:25.192 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:25.185+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:25.251 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:25.245+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:25.569 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:25.561+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:25.650 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:25.644+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:25.709 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:25.694+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:26.096 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:26.090+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:26.135 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:26.130+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:26.168 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:26.158+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:26.244 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:26.239+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:26.527 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:26.522+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:26.691 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:26.687+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:26.693 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:26.687+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:27.094 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:27.089+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:27.147 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:27.141+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:27.164 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:27.158+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:27.259 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:27.254+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:27.488 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:27.483+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:27.684 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:27.675+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:27.726 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:27.720+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:28.095 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:28.088+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:28.142 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:28.137+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:28.170 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:28.164+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:28.243 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:28.239+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:28.542 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:28.537+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:28.647 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:28.642+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:28.681 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:28.675+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:29.107 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:29.100+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:29.123 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:29.119+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:29.207 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:29.203+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:29.214 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:29.208+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:29.511 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:29.506+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:29.628 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:29.623+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:29.678 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:29.672+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:30.113 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:30.106+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:30.138 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:30.131+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:30.164 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:30.159+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:30.202 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:30.195+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:30.492 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:30.484+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:30.492 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:30.488+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:30.680 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:30.676+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:30.701 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:30.686+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:31.102 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:31.095+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:31.108 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:31.102+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:31.165 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:31.159+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:31.169 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:31.165+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:31.526 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:31.513+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:31.526 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:31.516+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:31.655 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:31.651+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:31.679 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:31.673+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:32.069 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:32.062+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:32.082 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:32.077+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:32.152 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:32.146+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:32.165 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:32.161+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:32.502 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:32.496+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:32.506 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:32.502+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:32.664 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:32.658+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:32.703 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:32.696+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:33.120 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:33.115+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:33.122 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:33.117+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:33.131 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:33.124+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:33.145 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:33.141+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:33.557 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:33.549+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:33.559 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:33.553+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:33.619 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:33.613+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:33.754 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:33.749+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:34.121 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:34.114+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:34.129 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:34.125+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:34.135 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:34.129+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:34.151 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:34.146+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:34.589 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:34.575+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:34.589 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:34.579+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:34.617 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:34.613+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:34.801 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:34.794+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:35.107 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:35.101+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:35.168 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:35.163+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:35.171 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:35.165+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:35.172 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:35.168+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:35.622 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:35.617+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:35.627 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:35.622+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:35.664 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:35.659+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:35.837 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:35.831+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:36.126 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:36.120+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:36.166 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:36.160+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:36.197 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:36.190+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:36.211 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:36.207+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:36.638 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:36.633+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:36.666 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:36.659+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:36.667 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:36.662+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:36.833 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:36.823+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:37.088 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:37.081+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:37.184 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:37.179+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:37.196 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:37.190+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:37.201 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:37.195+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:37.674 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:37.670+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:37.700 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:37.694+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:37.701 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:37.696+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:37.797 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:37.791+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:38.083 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:38.076+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:38.207 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:38.202+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:38.217 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:38.210+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:38.219 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:38.212+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:38.652 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:38.647+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:38.677 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:38.670+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:38.679 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:38.675+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:38.753 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:38.748+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:39.069 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:39.060+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:39.198 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:39.194+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:39.202 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:39.198+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:39.248 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:39.241+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:39.652 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:39.645+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:39.653 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:39.648+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:39.697 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:39.693+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:39.792 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:39.786+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:40.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:40.059+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:40.183 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:40.171+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:40.212 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:40.207+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:40.259 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:40.253+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:40.672 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:40.666+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:40.677 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:40.672+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:40.677 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:40.670+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:40.782 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:40.776+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:41.042 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:41.036+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:41.152 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:41.148+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:41.261 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:41.255+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:41.292 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:41.285+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:41.707 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:41.702+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:41.711 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:41.703+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:41.712 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:41.707+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:41.833 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:41.827+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:42.049 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:42.042+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:42.166 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:42.162+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:42.262 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:42.259+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:42.270 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:42.264+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:42.727 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:42.720+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:42.728 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:42.722+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:42.738 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:42.731+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:42.816 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:42.809+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:43.049 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:43.043+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:43.137 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:43.133+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:43.247 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:43.243+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:43.285 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:43.279+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:43.759 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:43.752+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:43.760 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:43.755+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:43.760 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:43.755+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:43.828 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:43.823+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:44.070 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:44.063+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:44.182 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:44.177+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:44.225 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:44.221+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:44.291 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:44.285+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:44.737 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:44.733+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:44.740 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:44.735+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:44.741 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:44.737+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:44.869 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:44.864+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:45.086 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:45.080+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:45.170 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:45.163+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:45.253 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:45.248+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:45.254 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:45.248+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:45.707 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:45.700+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:45.708 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:45.703+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:45.718 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:45.714+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:45.847 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:45.841+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:46.052 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:46.046+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:46.139 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:46.133+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:46.242 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:46.235+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:46.305 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:46.299+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:46.729 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:46.724+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:46.735 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:46.728+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:46.736 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:46.731+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:46.882 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:46.876+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:47.021 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:47.015+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:47.173 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:47.158+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:47.257 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:47.249+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:47.271 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:47.266+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:47.685 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:47.680+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:47.707 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:47.699+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:47.708 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:47.703+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:47.915 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:47.900+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:48.061 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:48.054+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:48.190 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:48.184+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:48.235 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:48.229+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:48.289 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:48.279+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:48.709 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:48.699+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:48.709 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:48.701+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:48.737 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:48.732+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:48.892 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:48.886+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:49.065 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:49.056+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:49.147 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:49.142+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:49.279 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:49.272+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:49.303 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:49.298+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:49.726 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:49.721+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:49.730 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:49.723+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:49.732 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:49.727+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:49.858 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:49.851+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:50.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:50.051+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:50.193 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:50.188+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:50.301 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:50.294+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:50.308 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:50.304+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:50.378 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:07:50.375+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e496 v496) 2019-12-09T20:07:50.698 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:50.694+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:50.743 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:50.736+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:50.744 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:50.739+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:50.898 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:50.892+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:51.024 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:51.017+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:51.235 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:51.231+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:51.263 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:51.258+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:51.301 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:51.294+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:51.664 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:51.660+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:51.789 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:51.782+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:51.790 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:51.785+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:51.888 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:51.872+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:52.071 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:52.064+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:52.195 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:52.190+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:52.273 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:52.266+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:52.278 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:52.272+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:52.665 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:52.660+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:52.807 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:52.801+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:52.809 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:52.804+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:52.871 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:52.865+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:53.074 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:53.068+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:53.199 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:53.196+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:53.296 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:53.292+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:53.323 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:53.317+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:53.639 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:53.635+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:53.838 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:53.832+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:53.842 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:53.837+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:53.877 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:53.870+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:54.031 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:54.025+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:54.208 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:54.202+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:54.260 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:54.256+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:54.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:54.329+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:54.630 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:54.625+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:54.841 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:54.826+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:54.841 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:54.831+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:54.900 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:54.895+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:55.001 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:54.996+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:55.240 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:55.236+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:55.302 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:55.297+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:55.317 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:55.307+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:55.388 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:07:55.384+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e496 v496) 2019-12-09T20:07:55.632 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:55.629+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:55.888 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:55.879+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:55.888 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:55.881+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:55.892 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:55.888+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:56.016 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:56.010+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:56.257 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:56.252+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:56.278 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:56.273+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:56.284 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:56.277+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:56.683 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:56.680+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:56.864 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:56.857+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:56.865 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:56.860+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:56.875 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:56.869+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:56.987 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:56.981+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:57.282 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:57.278+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:57.298 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:57.293+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:57.308 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:57.301+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:57.670 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:57.665+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:57.905 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:57.899+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:57.905 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:57.901+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:57.919 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:57.914+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:57.946 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:57.941+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:58.252 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:58.249+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:58.285 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:58.276+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:58.352 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:58.340+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:58.707 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:58.697+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:58.897 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:58.891+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:58.927 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:58.919+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:58.934 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:58.922+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:58.955 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:58.948+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:07:59.259 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:07:59.255+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:07:59.293 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:07:59.284+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:07:59.364 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:07:59.355+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:07:59.657 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:07:59.653+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:07:59.926 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:07:59.920+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:07:59.952 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:59.945+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:07:59.953 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:07:59.948+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:07:59.994 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:07:59.983+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:08:00.243 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:08:00.239+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:08:00.310 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:08:00.305+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:08:00.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:08:00.329+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:08:00.422 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:08:00.416+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e496 v496) 2019-12-09T20:08:00.705 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:08:00.695+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:08:00.912 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:08:00.905+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:08:00.914 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:08:00.908+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:08:00.918 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:08:00.913+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:08:01.028 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:08:01.021+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:08:01.262 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:08:01.259+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:08:01.287 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:08:01.283+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:08:01.310 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:08:01.300+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:08:01.665 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:08:01.655+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:08:01.875 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:08:01.868+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:08:01.875 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:08:01.871+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:08:01.919 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:08:01.914+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:08:02.029 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:08:02.021+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:08:02.236 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:08:02.231+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:08:02.320 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:08:02.313+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:08:02.345 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:08:02.326+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:08:02.678 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:08:02.673+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:08:02.830 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:08:02.824+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:08:02.834 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:08:02.829+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:08:02.902 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:08:02.897+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:08:02.991 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:08:02.984+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:08:03.285 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:08:03.279+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:08:03.286 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:08:03.282+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:08:03.298 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:08:03.293+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:08:03.676 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:08:03.670+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:08:03.803 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:08:03.796+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:08:03.804 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:08:03.799+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:08:03.898 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:08:03.891+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:08:03.952 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:08:03.946+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:08:04.313 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:08:04.308+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:08:04.324 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:08:04.320+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:08:04.332 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:08:04.325+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:08:04.721 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:08:04.715+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.298226+0000 front 2019-12-09T20:06:37.366815+0000 (oldest deadline 2019-12-09T20:07:19.546710+0000) 2019-12-09T20:08:04.789 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:08:04.782+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:06:49.908286+0000 (oldest deadline 2019-12-09T20:07:29.908286+0000) 2019-12-09T20:08:04.790 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:08:04.785+0000 1694f700 -1 osd.6 496 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:08:04.877 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:08:04.870+0000 1694f700 -1 osd.5 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:36.481062+0000 front 2019-12-09T20:06:37.267625+0000 (oldest deadline 2019-12-09T20:07:19.142385+0000) 2019-12-09T20:08:04.961 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:08:04.955+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.443644+0000 front 2019-12-09T20:06:37.466219+0000 (oldest deadline 2019-12-09T20:07:19.124015+0000) 2019-12-09T20:08:05.307 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:08:05.302+0000 1694f700 -1 osd.2 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:37.285306+0000 front 2019-12-09T20:06:38.445650+0000 (oldest deadline 2019-12-09T20:07:20.117017+0000) 2019-12-09T20:08:05.319 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:08:05.315+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.946141+0000 front 2019-12-09T20:06:34.883042+0000 (oldest deadline 2019-12-09T20:07:18.219658+0000) 2019-12-09T20:08:05.343 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:08:05.336+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:06:34.593306+0000 front 2019-12-09T20:06:34.509547+0000 (oldest deadline 2019-12-09T20:07:19.791085+0000) 2019-12-09T20:08:05.499 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:08:05.492+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e496 v496) 2019-12-09T20:08:06.088 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:08:05.850+0000 1694f700 -1 osd.6 497 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e494) 2019-12-09T20:08:40.874 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:03:01.932 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:08:40.910 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:03:01.968 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:08:40.931 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:03:01.989 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:08:40.944 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:03:02.002 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:08:40.964 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:03:01.999 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:08:40.969 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:03:02.003 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:08:41.226 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:03:02.285 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:08:41.237 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:03:02.296 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:08:41.238 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:03:02.272 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:09:15.047 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:03:36.105 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:09:15.052 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:03:36.111 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:09:15.065 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:03:36.123 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:09:15.068 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:03:36.102 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:09:15.070 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:03:36.128 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:09:15.079 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:03:36.113 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:09:15.117 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:03:36.175 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:09:15.126 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:03:36.160 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:09:15.133 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:03:36.191 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:09:38.099 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:38.093+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:38.451 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:38.446+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:38.732 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:38.727+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:38.942 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:38.936+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:39.054 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:39.050+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:39.112 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:39.106+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:39.470 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:39.465+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:39.613 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:39.607+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:39.613 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:39.608+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:39.717 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:39.710+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:39.939 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:39.933+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:40.081 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:40.077+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:40.129 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:40.124+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:40.503 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:40.498+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:40.574 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:40.568+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:40.649 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:40.645+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:40.671 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:40.666+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:40.922 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:40.917+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:41.104 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:41.098+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:41.136 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:41.131+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:41.551 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:41.547+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:41.617 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:41.613+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:41.664 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:41.661+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:41.679 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:41.675+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:41.886 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:41.880+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:42.063 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:42.058+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:42.113 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:42.108+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:42.526 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:42.520+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:42.637 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:42.627+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:42.675 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:42.671+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:42.715 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:42.712+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:42.925 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:42.919+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:43.094 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:43.090+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:43.157 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:43.152+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:43.482 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:43.476+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:43.598 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:43.594+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:43.631 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:43.626+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:43.681 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:43.677+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:43.938 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:43.933+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:44.132 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:44.126+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:44.172 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:44.164+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:44.538 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:44.528+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:44.564 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:44.561+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:44.629 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:44.626+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:44.679 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:44.675+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:44.957 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:44.952+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:45.101 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:45.091+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:45.169 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:45.160+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:45.507 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:45.500+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:45.601 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:45.593+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:45.615 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:45.611+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:45.688 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:45.685+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:45.979 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:45.968+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:46.050 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:46.043+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:46.161 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:46.156+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:46.468 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:46.463+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:46.578 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:46.571+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:46.595 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:46.590+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:46.708 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:46.705+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:46.989 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:46.962+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:47.085 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:47.080+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:47.213 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:47.208+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:47.484 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:47.473+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:47.555 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:47.551+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:47.635 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:47.631+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:47.699 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:47.695+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:47.971 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:47.966+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:48.090 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:48.080+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:48.234 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:48.217+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:48.506 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:48.501+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:48.560 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:48.552+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:48.657 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:48.649+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:48.722 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:48.717+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:48.945 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:48.940+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:49.061 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:49.057+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:49.230 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:49.220+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:49.549 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:49.542+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:49.596 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:49.591+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:49.682 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:49.678+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:49.700 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:49.696+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:49.971 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:49.966+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:50.103 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:50.099+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:50.190 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:50.184+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:50.595 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:50.590+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:50.610 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:50.604+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:50.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:50.669+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:50.749 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:50.744+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:51.006 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:51.001+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:51.141 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:51.137+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:51.183 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:51.177+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:51.566 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:51.560+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:51.632 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:51.624+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:51.658 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:51.651+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:51.741 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:51.734+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:52.025 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:52.020+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:52.135 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:52.131+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:52.192 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:52.187+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:52.561 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:52.557+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:52.599 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:52.584+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:52.680 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:52.674+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:52.791 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:52.786+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:53.064 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:53.059+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:53.160 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:53.151+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:53.160 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:53.149+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:53.585 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:53.578+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:53.645 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:53.637+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:53.677 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:53.672+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:53.753 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:53.748+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:54.057 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:54.051+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:54.156 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:09:54.143+0000 1694f700 -1 osd.3 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.223199+0000 front 2019-12-09T20:08:56.224202+0000 (oldest deadline 2019-12-09T20:09:37.334366+0000) 2019-12-09T20:09:54.170 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:54.165+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:54.537 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:54.532+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:54.605 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:54.599+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:54.711 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:54.707+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:54.734 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:54.729+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:55.108 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:55.102+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:55.210 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:55.204+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:55.565 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:55.555+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:55.615 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:55.611+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:55.713 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:55.709+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:55.764 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:55.760+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:56.065 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:56.059+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:56.185 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:56.181+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:56.558 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:56.552+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:56.618 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:56.614+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:56.727 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:56.722+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:56.730 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:56.724+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:57.106 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:57.099+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:57.169 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:57.162+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:57.585 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:57.578+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:57.625 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:57.618+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:57.708 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:57.701+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:57.716 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:57.711+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:58.077 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:58.072+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:58.180 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:58.175+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:58.539 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:58.533+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:58.641 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:58.633+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:58.697 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:58.689+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:09:58.768 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:58.763+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:59.090 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:09:59.085+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:09:59.181 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:09:59.177+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:09:59.507 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:09:59.503+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:09:59.657 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:09:59.653+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:09:59.725 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:09:59.721+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:09:59.750 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:09:59.745+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:00.100 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:00.091+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:00.199 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:00.194+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:00.514 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:00.509+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:00.682 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:00.679+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:00.683 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:00.680+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:00.782 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:00.779+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:01.097 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:01.092+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:01.196 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:01.191+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:01.483 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:01.475+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:01.642 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:01.638+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:01.692 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:01.688+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:01.807 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:01.803+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:02.096 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:02.091+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:02.182 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:02.176+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:02.525 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:02.521+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:02.626 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:02.622+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:02.718 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:02.714+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:02.827 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:02.824+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:03.096 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:03.091+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:03.218 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:03.213+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:03.567 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:03.562+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:03.635 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:03.630+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:03.764 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:03.760+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:03.865 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:03.853+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:04.127 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:04.122+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:04.269 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:04.264+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:04.562 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:04.557+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:04.663 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:04.658+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:04.747 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:04.741+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:04.882 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:04.877+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:05.124 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:05.119+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:05.315 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:05.310+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:05.538 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:05.533+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:05.679 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:05.675+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:05.795 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:05.791+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:05.886 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:05.883+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:06.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:06.129+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:06.356 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:06.352+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:06.551 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:06.547+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:06.658 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:06.653+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:06.749 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:06.745+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:06.892 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:06.885+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:07.137 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:07.122+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:07.317 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:07.310+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:07.509 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:07.504+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:07.703 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:07.698+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:07.764 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:07.756+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:07.885 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:07.879+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:08.127 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:08.122+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:08.301 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:08.295+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:08.489 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:08.481+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:08.748 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:08.743+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:08.810 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:08.805+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:08.886 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:08.882+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:09.132 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:09.127+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:09.349 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:09.344+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:09.452 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:09.447+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:09.766 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:09.761+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:09.818 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:09.814+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:09.842 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:09.837+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:10.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:10.130+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:10.374 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:10.369+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:10.489 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:10.482+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:10.770 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:10.765+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:10.816 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:10.811+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:10.894 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:10.890+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:11.103 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:10:11.099+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 41sec e501 v501) 2019-12-09T20:10:11.110 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:11.105+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:11.392 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:11.387+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:11.514 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:11.509+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:11.774 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:11.770+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:11.855 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:11.850+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:11.884 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:11.879+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:12.129 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:12.124+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:12.407 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:12.402+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:12.505 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:12.499+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:12.743 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:12.740+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:12.885 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:12.881+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:12.896 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:12.891+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:13.139 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:13.134+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:13.449 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:13.445+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:13.513 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:13.502+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:13.760 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:13.756+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:13.872 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:13.867+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:13.928 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:13.923+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:14.165 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:14.160+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:14.464 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:14.458+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:14.493 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:14.485+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:14.788 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:14.784+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:14.906 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:14.903+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:14.979 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:14.976+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:15.174 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:15.170+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:15.427 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:10:15.420+0000 1694f700 -1 osd.5 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:51.692694+0000 front 2019-12-09T20:08:51.772081+0000 (oldest deadline 2019-12-09T20:09:37.472131+0000) 2019-12-09T20:10:15.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:10:15.510+0000 1694f700 -1 osd.7 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.658394+0000 front 2019-12-09T20:08:53.603926+0000 (oldest deadline 2019-12-09T20:09:38.664594+0000) 2019-12-09T20:10:15.758 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:10:15.753+0000 1694f700 -1 osd.2 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.509908+0000 front 2019-12-09T20:08:55.906200+0000 (oldest deadline 2019-12-09T20:09:38.813371+0000) 2019-12-09T20:10:15.901 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:10:15.897+0000 1694f700 -1 osd.1 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:54.198821+0000 front 2019-12-09T20:08:54.849127+0000 (oldest deadline 2019-12-09T20:09:38.688413+0000) 2019-12-09T20:10:15.939 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:10:15.935+0000 1694f700 -1 osd.0 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:56.496381+0000 front 2019-12-09T20:08:56.337126+0000 (oldest deadline 2019-12-09T20:09:38.621011+0000) 2019-12-09T20:10:16.170 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:10:16.165+0000 1694f700 -1 osd.4 501 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:08:55.921220+0000 front 2019-12-09T20:08:54.863175+0000 (oldest deadline 2019-12-09T20:09:38.378345+0000) 2019-12-09T20:10:16.176 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:10:16.171+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 41sec e501 v501) 2019-12-09T20:10:56.379 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:05:17.438 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:10:56.430 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:05:17.462 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:10:56.430 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:05:17.486 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:10:56.449 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:05:17.481 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:10:56.461 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:05:17.515 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:10:56.473 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:05:17.526 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:10:56.538 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:05:17.566 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:10:56.539 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:05:17.595 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:10:56.569 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:05:17.627 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:11:14.733 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:14.728+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:15.772 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:15.767+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:16.275 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:16.271+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:16.317 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:16.313+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:16.564 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:16.555+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:16.826 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:16.821+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:17.280 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:17.277+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:17.329 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:17.322+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:17.611 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:17.604+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:17.757 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:17.751+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:17.816 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:17.811+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:18.287 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:18.281+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:18.357 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:18.353+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:18.506 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:18.499+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:18.616 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:18.610+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:18.734 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:18.726+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:18.780 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:18.775+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:19.276 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:19.272+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:19.389 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:19.385+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:19.511 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:19.505+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:19.632 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:19.626+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:19.714 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:19.708+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:19.795 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:19.792+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:20.239 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:20.226+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:20.438 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:20.433+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:20.477 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:20.470+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:20.608 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:20.601+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:20.671 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:20.665+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:20.802 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:20.799+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:21.212 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:21.209+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:21.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:21.413+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:21.529 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:21.520+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:21.663 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:21.654+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:21.703 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:21.696+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:21.767 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:21.762+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:21.837 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:21.833+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:22.190 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:22.186+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:22.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:22.418+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:22.498 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:22.492+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:22.696 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:22.689+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:22.709 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:22.703+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:22.740 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:22.735+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:22.856 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:22.851+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:23.154 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:23.146+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:23.422 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:23.417+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:23.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:23.507+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:23.665 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:23.659+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:23.673 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:23.667+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:23.779 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:23.774+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:23.847 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:23.841+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:24.171 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:24.165+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:24.430 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:24.424+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:24.479 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:24.468+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:24.681 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:24.673+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:24.698 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:24.693+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:24.830 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:24.825+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:24.882 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:24.877+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:25.161 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:25.156+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:25.393 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:25.388+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:25.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:25.448+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:25.663 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:25.654+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:25.746 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:25.740+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:25.830 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:25.825+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:25.881 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:25.873+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:26.171 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:26.166+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:26.448 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:26.441+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:26.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:26.509+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:26.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:26.657+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:26.800 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:26.794+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:26.830 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:26.827+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:26.889 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:26.884+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:27.158 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:27.152+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:27.403 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:27.397+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:27.500 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:27.494+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:27.624 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:27.618+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:27.766 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:27.759+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:27.848 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:27.843+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:27.886 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:27.879+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:28.171 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:28.164+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:28.407 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:28.401+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:28.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:28.504+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:28.612 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:28.605+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:28.776 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:28.770+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:28.871 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:28.864+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:28.872 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:28.867+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:28.904 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:28.899+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:29.128 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:29.122+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:29.439 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:29.433+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:29.547 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:29.541+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:29.651 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:29.644+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:29.756 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:29.749+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:29.842 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:29.835+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:29.843 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:29.838+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:29.913 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:29.908+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:30.113 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:30.103+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:30.437 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:30.431+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:30.581 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:30.575+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:30.640 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:30.635+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:30.717 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:30.710+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:30.827 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:30.820+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:30.833 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:30.826+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:30.881 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:30.876+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:31.108 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:31.104+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:31.419 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:31.413+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:31.588 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:31.580+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:31.681 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:31.675+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:31.747 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:31.733+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:31.870 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:31.862+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:31.870 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:31.865+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:31.933 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:31.926+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:32.160 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:32.153+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:32.469 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:32.463+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:32.604 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:32.595+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:32.701 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:32.692+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:32.793 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:32.785+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:32.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:32.846+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:32.854 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:32.850+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:32.964 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:32.960+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:33.147 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:33.136+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:33.428 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:33.423+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:33.559 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:33.553+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:33.667 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:33.660+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:33.808 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:33.800+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:33.861 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:33.849+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:33.862 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:33.852+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:34.007 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:34.002+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:34.152 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:34.146+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:34.440 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:34.434+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:34.578 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:34.571+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:34.646 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:34.640+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:34.826 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:34.821+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:34.902 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:34.895+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:34.902 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:34.897+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:35.005 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:34.995+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:35.124 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:35.118+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:35.451 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:35.446+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:35.600 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:35.593+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:35.667 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:35.661+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:35.871 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:35.864+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:35.874 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:35.867+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:35.875 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:35.870+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:35.971 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:35.966+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:36.120 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:36.114+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:36.434 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:36.428+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:36.601 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:36.594+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:36.703 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:36.692+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:36.869 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:36.863+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:36.898 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:36.891+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:36.898 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:36.894+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:36.970 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:36.963+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:37.159 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:37.153+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:37.418 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:37.412+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:37.647 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:37.640+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:37.705 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:37.698+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:37.913 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:37.906+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:37.913 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:37.908+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:37.925 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:37.918+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:38.021 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:38.017+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:38.151 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:38.144+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:38.458 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:38.453+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:38.669 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:38.662+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:38.748 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:38.742+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:38.923 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:38.916+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:38.950 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:38.943+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:38.952 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:38.948+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:39.068 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:39.064+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:39.115 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:39.110+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:39.473 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:39.468+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:39.657 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:39.651+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:39.768 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:39.762+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:39.970 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:39.964+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:39.988 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:39.982+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:39.991 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:39.986+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:40.070 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:40.063+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:40.138 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:40.133+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:40.463 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:40.454+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:40.704 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:40.700+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:40.770 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:40.764+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:40.994 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:40.988+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:40.998 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:40.993+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:41.017 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:41.011+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:41.099 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:41.089+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:41.162 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:41.157+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:41.459 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:41.453+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:41.699 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:41.693+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:41.731 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:41.726+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:41.999 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:41.992+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:42.002 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:41.998+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:42.007 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:42.001+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:42.114 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:42.109+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:42.205 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:42.197+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:42.420 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:42.413+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:42.673 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:42.667+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:42.712 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:42.707+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:42.980 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:42.973+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:42.990 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:42.983+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:42.995 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:42.990+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:43.113 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:43.106+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:43.213 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:43.208+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:43.435 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:43.429+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:43.699 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:43.692+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:43.703 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:43.697+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:44.007 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:44.001+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:44.011 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:44.006+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:44.028 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:44.022+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:44.085 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:44.080+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:44.184 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:44.179+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:44.405 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:44.393+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:44.695 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:44.686+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:44.727 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:44.720+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:44.987 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:44.982+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:44.991 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:44.986+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:45.029 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:45.021+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:45.101 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:45.096+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:45.214 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:45.208+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:45.410 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:45.405+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:45.700 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:45.694+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:45.775 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:45.768+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:45.984 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:45.978+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:45.985 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:45.981+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:45.990 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:45.985+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:46.076 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:46.072+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:46.222 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:46.217+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:46.382 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:46.377+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:46.671 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:46.664+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:46.804 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:46.798+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:46.984 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:46.977+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:46.985 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:46.979+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:46.988 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:46.984+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:47.038 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:47.032+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:47.253 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:47.248+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:47.373 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:47.367+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:47.714 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:47.709+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:47.835 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:47.829+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:47.951 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:47.945+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:48.001 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:47.985+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:48.001 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:47.989+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:48.021 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:48.016+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:48.274 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:48.269+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:48.393 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:48.389+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:48.675 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:48.668+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:48.858 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:48.851+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:48.915 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:48.908+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:49.029 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:49.023+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:49.030 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:49.026+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:49.061 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:49.057+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:49.326 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:49.322+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:49.379 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:49.372+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:49.653 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:49.648+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:49.818 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:49.812+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:49.909 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:49.903+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:50.059 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:50.054+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:50.068 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:50.062+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:50.072 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:50.068+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:50.345 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:50.340+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:50.406 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:50.401+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:50.647 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:50.639+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:50.845 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:50.839+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:50.898 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:50.892+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:51.065 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:51.060+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:51.091 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:51.085+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:51.094 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:51.090+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:51.305 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:51.299+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:51.383 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:51.379+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:51.543 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:11:51.540+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e507 v507) 2019-12-09T20:11:51.628 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:51.621+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:51.889 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:51.882+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:51.934 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:51.928+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:52.067 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:52.061+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:52.143 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:52.137+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:52.150 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:52.145+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:52.354 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:52.350+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:52.390 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:52.386+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:52.635 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:52.629+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:52.880 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:52.874+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:52.936 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:52.923+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:53.055 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:53.051+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:53.153 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:53.146+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:53.154 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:53.149+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:53.364 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:53.359+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:53.407 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:53.398+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:53.632 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:53.625+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:53.844 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:53.836+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:53.911 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:53.906+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:54.042 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:54.036+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:54.107 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:54.102+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:54.111 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:54.107+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:54.334 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:54.330+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:54.384 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:54.380+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:54.591 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:54.584+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:54.839 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:54.833+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:54.956 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:54.950+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:55.082 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:55.077+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:55.156 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:55.149+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:55.157 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:55.152+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:55.291 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:55.286+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:55.343 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:55.338+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:55.625 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:55.619+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:55.824 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:55.818+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:55.927 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:55.921+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:56.138 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:56.132+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:56.149 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:56.142+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:56.150 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:56.145+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:56.286 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:56.282+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:56.386 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:56.381+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:56.552 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:11:56.550+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e507 v507) 2019-12-09T20:11:56.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:56.662+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:56.799 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:56.793+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:56.970 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:56.963+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:57.099 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:57.095+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:57.123 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:57.117+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:57.126 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:57.122+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:57.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:57.259+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:57.374 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:57.369+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:57.700 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:57.694+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:57.851 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:57.846+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:57.944 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:57.934+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:58.101 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:58.097+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:58.107 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:58.102+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:58.111 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:58.107+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:58.233 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:58.228+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:58.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:58.345+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:58.741 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:58.735+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:58.864 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:58.858+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:58.965 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:58.951+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:11:59.098 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:11:59.094+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:11:59.099 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:59.092+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:11:59.099 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:11:59.095+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:11:59.216 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:11:59.211+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:11:59.385 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:11:59.379+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:11:59.710 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:11:59.703+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:11:59.846 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:11:59.840+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:11:59.993 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:11:59.987+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:12:00.063 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:12:00.056+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:12:00.063 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:12:00.059+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:12:00.085 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:12:00.080+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:12:00.169 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:12:00.164+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:12:00.414 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:12:00.410+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:12:00.716 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:12:00.710+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:12:00.862 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:12:00.856+0000 1694f700 -1 osd.7 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.173482+0000 front 2019-12-09T20:10:33.170710+0000 (oldest deadline 2019-12-09T20:11:18.324749+0000) 2019-12-09T20:12:00.988 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:12:00.982+0000 1694f700 -1 osd.5 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:29.946361+0000 front 2019-12-09T20:10:29.977248+0000 (oldest deadline 2019-12-09T20:11:15.797703+0000) 2019-12-09T20:12:01.018 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:12:01.011+0000 1694f700 -1 osd.6 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:10:48.463685+0000 (oldest deadline 2019-12-09T20:11:28.463685+0000) 2019-12-09T20:12:01.028 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:12:01.014+0000 1694f700 -1 osd.6 507 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e505) 2019-12-09T20:12:01.061 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:12:01.055+0000 1694f700 -1 osd.1 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.739874+0000 front 2019-12-09T20:10:31.689081+0000 (oldest deadline 2019-12-09T20:11:13.968370+0000) 2019-12-09T20:12:01.135 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:12:01.131+0000 1694f700 -1 osd.3 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:30.632717+0000 front 2019-12-09T20:10:30.463339+0000 (oldest deadline 2019-12-09T20:11:15.672681+0000) 2019-12-09T20:12:01.396 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:12:01.391+0000 1694f700 -1 osd.2 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:33.761315+0000 front 2019-12-09T20:10:33.891538+0000 (oldest deadline 2019-12-09T20:11:16.030148+0000) 2019-12-09T20:12:01.621 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:12:01.608+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e507 v507) 2019-12-09T20:12:01.754 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:12:01.746+0000 1694f700 -1 osd.4 507 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:10:31.871779+0000 front 2019-12-09T20:10:31.844555+0000 (oldest deadline 2019-12-09T20:11:17.360760+0000) 2019-12-09T20:13:12.015 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:07:33.073 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:13:12.021 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:07:33.080 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:13:12.035 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:07:33.069 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:13:12.036 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:07:33.094 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:13:12.040 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:07:33.098 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:13:12.042 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:07:33.076 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:13:12.181 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:07:33.239 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:13:12.191 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:07:33.249 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:13:12.298 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:07:33.332 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:13:34.102 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:34.096+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:35.082 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:35.078+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:35.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:35.411+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:35.841 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:35.833+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:36.129 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:36.123+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:36.296 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:36.290+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:36.464 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:36.459+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:36.590 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:36.584+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:36.668 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:36.663+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:36.851 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:36.846+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:37.097 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:37.091+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:37.301 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:37.295+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:37.470 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:37.464+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:37.626 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:37.621+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:37.692 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:37.686+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:37.905 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:37.899+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:38.064 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:38.059+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:38.274 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:38.269+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:38.515 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:38.510+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:38.594 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:38.589+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:38.726 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:38.714+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:38.930 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:38.926+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:39.041 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:39.034+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:39.239 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:39.234+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:39.297 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:39.292+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:39.485 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:39.480+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:39.562 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:39.558+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:39.761 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:39.755+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:39.889 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:39.884+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:40.009 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:40.004+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:40.195 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:40.191+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:40.312 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:40.304+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:40.513 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:40.508+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:40.565 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:40.559+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:40.750 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:40.744+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:40.876 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:40.871+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:41.062 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:41.057+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:41.163 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:41.158+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:41.350 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:41.345+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:41.480 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:41.476+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:41.540 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:41.535+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:41.760 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:41.755+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:41.887 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:41.878+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:42.037 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:42.032+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:42.142 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:42.137+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:42.327 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:42.322+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:42.452 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:42.448+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:42.520 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:42.516+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:42.725 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:42.714+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:42.929 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:42.923+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:42.994 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:42.989+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:43.097 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:43.093+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:43.358 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:43.351+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:43.471 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:43.466+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:43.535 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:43.531+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:43.705 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:43.699+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:43.968 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:43.964+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:43.977 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:43.971+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:44.123 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:44.118+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:44.346 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:44.340+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:44.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:44.420+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:44.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:44.513+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:44.729 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:44.723+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:44.937 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:44.932+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:44.992 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:44.987+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:45.101 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:45.097+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:45.338 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:45.332+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:45.390 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:45.385+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:45.508 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:45.503+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:45.783 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:45.777+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:45.944 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:45.939+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:45.958 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:45.953+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:46.148 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:46.143+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:46.338 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:46.333+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:46.405 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:46.397+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:46.554 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:46.549+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:46.758 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:46.754+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:46.908 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:46.903+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:46.970 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:46.966+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:47.147 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:47.142+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:47.368 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:47.363+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:47.410 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:47.404+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:47.522 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:47.516+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:47.774 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:47.768+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:47.956 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:47.951+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:48.002 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:47.996+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:48.167 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:48.161+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:48.340 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:48.335+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:48.375 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:48.368+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:48.484 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:48.479+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:48.747 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:48.735+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:48.981 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:48.977+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:48.989 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:48.984+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:49.215 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:49.209+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:49.312 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:49.307+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:49.406 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:49.401+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:49.511 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:49.506+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:49.736 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:49.730+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:49.966 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:49.960+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:50.029 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:50.024+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:50.211 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:50.206+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:50.316 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:50.309+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:50.402 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:50.397+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:50.515 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:50.511+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:50.706 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:50.700+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:50.921 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:50.917+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:51.037 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:51.032+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:51.217 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:51.210+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:51.339 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:51.334+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:51.370 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:51.365+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:51.499 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:51.494+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:51.701 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:51.696+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:51.955 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:51.949+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:52.057 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:52.052+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:52.212 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:52.208+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:52.357 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:52.352+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:52.368 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:52.363+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:52.455 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:52.451+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:52.702 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:52.697+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:52.922 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:52.918+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:53.033 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:53.029+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:53.177 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:53.172+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:53.366 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:53.361+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:53.396 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:53.387+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:53.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:53.460+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:53.696 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:53.691+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:53.908 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:53.902+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:54.087 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:54.082+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:54.181 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:54.176+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:54.358 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:54.348+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:54.409 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:54.404+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:54.453 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:54.448+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:54.658 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:54.652+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:54.937 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:54.933+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:55.096 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:55.088+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:55.166 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:55.162+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:55.391 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:55.387+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:55.455 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:55.449+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:55.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:55.491+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:55.648 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:55.644+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:55.973 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:55.968+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:56.072 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:56.068+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:56.136 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:56.133+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:56.372 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:56.368+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:56.460 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:56.455+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:56.469 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:56.456+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:56.682 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:56.676+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:56.957 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:56.953+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:57.089 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:57.086+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:57.136 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:57.133+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:57.418 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:57.414+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:57.424 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:57.419+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:57.503 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:57.497+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:57.725 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:57.718+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:57.999 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:57.994+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:58.130 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:58.125+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:58.145 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:58.140+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:58.441 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:58.436+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:58.468 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:58.462+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:58.556 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:58.550+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:58.750 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:58.745+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:59.010 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:59.004+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:13:59.123 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:13:59.119+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:13:59.171 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:13:59.168+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:13:59.427 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:13:59.422+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:13:59.492 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:13:59.488+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:13:59.607 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:13:59.602+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:13:59.706 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:13:59.703+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:13:59.982 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:13:59.976+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:00.099 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:14:00.095+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:14:00.208 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:14:00.203+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:14:00.478 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:14:00.474+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:14:00.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:14:00.491+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:14:00.652 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:14:00.645+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:14:00.738 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:14:00.734+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:14:01.014 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:14:01.006+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:01.149 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:14:01.144+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:14:01.223 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:14:01.220+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:14:01.477 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:14:01.473+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:14:01.508 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:14:01.504+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:14:01.671 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:14:01.667+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:14:01.757 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:14:01.752+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:14:02.031 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:14:02.025+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:02.126 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:14:02.121+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:14:02.256 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:14:02.251+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:14:02.505 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:14:02.498+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:14:02.541 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:14:02.536+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:14:02.679 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:14:02.672+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:14:02.785 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:14:02.781+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:14:03.068 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:14:03.064+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:03.147 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:14:03.144+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:14:03.294 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:14:03.291+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:14:03.521 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:14:03.510+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:14:03.585 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:14:03.575+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:14:03.635 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:14:03.631+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:14:03.816 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:14:03.811+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:14:04.055 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:14:04.049+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:04.188 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:14:04.184+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:14:04.306 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:14:04.302+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:14:04.553 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:14:04.549+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:14:04.596 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:14:04.591+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:14:04.618 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:14:04.613+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:14:04.771 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:14:04.767+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:14:05.105 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:14:05.100+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:05.160 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:14:05.157+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:14:05.327 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:14:05.323+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:14:05.511 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:14:05.507+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:14:05.550 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:14:05.545+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:14:05.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:14:05.664+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:14:05.752 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:14:05.748+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:14:06.127 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:14:06.121+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:06.194 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:14:06.181+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:14:06.373 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:14:06.369+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:14:06.559 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:14:06.555+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:14:06.601 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:14:06.597+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:14:06.677 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:14:06.672+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:14:06.723 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:14:06.719+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:14:07.011 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:14:07.008+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 43sec e512 v512) 2019-12-09T20:14:07.085 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:14:07.079+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:07.236 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:14:07.231+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:14:07.422 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:14:07.418+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:14:07.606 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:14:07.602+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:14:07.648 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:14:07.642+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:14:07.686 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:14:07.680+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:14:07.691 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:14:07.687+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:14:08.059 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:14:08.051+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:08.247 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:14:08.242+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:14:08.423 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:14:08.418+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:14:08.603 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:14:08.599+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:14:08.658 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:14:08.653+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:14:08.660 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:14:08.655+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:14:08.679 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:14:08.674+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:14:09.039 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:14:09.034+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:09.285 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:14:09.277+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:14:09.442 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:14:09.437+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:14:09.641 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:14:09.637+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:14:09.668 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:14:09.663+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:14:09.686 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:14:09.682+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:14:09.715 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:14:09.710+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:14:10.075 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:14:10.070+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:10.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:14:10.269+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:14:10.432 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:14:10.429+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:14:10.650 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:14:10.646+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:14:10.681 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:14:10.676+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:14:10.714 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:14:10.709+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:14:10.738 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:14:10.734+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:14:11.043 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:14:11.038+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:11.290 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:14:11.287+0000 1694f700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.529097+0000 front 2019-12-09T20:12:53.082419+0000 (oldest deadline 2019-12-09T20:13:35.846827+0000) 2019-12-09T20:14:11.483 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:14:11.479+0000 1694f700 -1 osd.0 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:52.850278+0000 front 2019-12-09T20:12:52.027687+0000 (oldest deadline 2019-12-09T20:13:35.444568+0000) 2019-12-09T20:14:11.613 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:14:11.609+0000 1694f700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:49.758020+0000 front 2019-12-09T20:12:49.302106+0000 (oldest deadline 2019-12-09T20:13:34.984381+0000) 2019-12-09T20:14:11.669 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:14:11.665+0000 1694f700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:50.314070+0000 front 2019-12-09T20:12:50.581497+0000 (oldest deadline 2019-12-09T20:13:36.144342+0000) 2019-12-09T20:14:11.738 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:14:11.734+0000 1694f700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.599270+0000 front 2019-12-09T20:12:53.596706+0000 (oldest deadline 2019-12-09T20:13:36.200463+0000) 2019-12-09T20:14:11.752 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:14:11.748+0000 1694f700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:53.473761+0000 front 2019-12-09T20:12:53.293340+0000 (oldest deadline 2019-12-09T20:13:39.172770+0000) 2019-12-09T20:14:12.033 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:14:12.028+0000 1694f700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:12:54.095896+0000 front 2019-12-09T20:12:53.082052+0000 (oldest deadline 2019-12-09T20:13:33.795481+0000) 2019-12-09T20:14:12.057 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:14:12.055+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 43sec e512 v512) 2019-12-09T20:15:10.086 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:10.081+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:10.497 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:10.491+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:10.821 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:10.815+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:11.137 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:11.132+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:11.344 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:11.338+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:11.526 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:11.522+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:11.842 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:11.835+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:12.134 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:12.126+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:12.286 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:12.279+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:12.354 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:12.348+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:12.504 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:12.499+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:12.830 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:12.825+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:13.130 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:13.125+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:13.245 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:13.238+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:13.389 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:13.381+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:13.524 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:13.519+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:13.843 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:13.838+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:14.119 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:14.113+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:14.271 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:14.265+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:14.297 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:14.290+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:14.438 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:14.430+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:14.545 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:14.540+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:14.893 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:14.889+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:15.139 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:15.135+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:15.269 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:15.263+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:15.287 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:15.280+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:15.481 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:15.476+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:15.556 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:15.550+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:15.937 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:15.932+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:16.190 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:16.184+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:16.278 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:16.272+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:16.290 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:16.283+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:16.500 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:16.494+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:16.538 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:16.533+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:16.981 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:16.977+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:17.214 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:17.209+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:17.250 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:17.244+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:17.276 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:17.270+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:17.512 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:17.505+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:17.512 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:17.508+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:18.022 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:18.017+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:18.204 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:18.200+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:18.247 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:18.241+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:18.265 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:18.259+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:18.525 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:18.517+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:18.527 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:18.521+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:19.073 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:19.069+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:19.227 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:19.224+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:19.252 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:19.246+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:19.285 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:19.277+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:19.537 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:19.531+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:19.557 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:19.552+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:19.775 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:19.770+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:20.097 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:20.091+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:20.231 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:20.226+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:20.273 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:20.268+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:20.304 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:20.298+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:20.545 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:20.538+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:20.565 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:20.561+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:20.772 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:20.767+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:21.125 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:21.121+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:21.268 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:21.263+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:21.273 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:21.270+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:21.284 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:21.278+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:21.505 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:21.499+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:21.542 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:21.538+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:21.735 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:21.731+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:22.126 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:22.122+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:22.269 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:22.262+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:22.272 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:22.266+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:22.281 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:22.276+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:22.527 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:22.521+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:22.536 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:22.532+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:22.761 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:22.756+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:23.106 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:23.101+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:23.274 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:23.268+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:23.278 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:23.273+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:23.324 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:23.320+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:23.553 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:23.550+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:23.577 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:23.570+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:23.815 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:23.811+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:24.066 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:24.060+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:24.254 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:24.248+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:24.311 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:24.307+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:24.329 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:24.323+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:24.535 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:24.528+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:24.598 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:24.594+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:24.805 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:24.800+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:25.019 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:25.014+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:25.242 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:25.236+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:25.302 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:25.296+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:25.337 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:25.331+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:25.567 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:25.561+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:25.598 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:25.591+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:25.803 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:25.799+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:26.006 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:26.002+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:26.242 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:26.235+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:26.345 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:26.340+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:26.365 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:26.359+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:26.592 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:26.586+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:26.604 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:26.599+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:26.789 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:26.781+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:26.789 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:26.784+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:27.019 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:27.016+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:27.287 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:27.281+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:27.321 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:27.317+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:27.408 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:27.402+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:27.548 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:27.541+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:27.560 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:27.555+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:27.825 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:27.817+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:27.827 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:27.821+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:28.004 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:28.000+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:28.282 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:28.277+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:28.321 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:28.316+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:28.394 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:28.383+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:28.510 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:28.504+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:28.593 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:28.588+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:28.818 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:28.811+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:28.819 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:28.814+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:29.038 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:29.034+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:29.258 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:29.251+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:29.370 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:29.364+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:29.426 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:29.421+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:29.551 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:29.544+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:29.552 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:29.544+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:29.801 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:29.794+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:29.802 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:29.797+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:30.091 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:30.086+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:30.211 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:30.207+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:30.403 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:30.396+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:30.418 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:30.411+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:30.531 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:30.526+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:30.535 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:30.529+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:30.839 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:30.833+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:30.844 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:30.840+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:31.123 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:31.120+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:31.213 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:31.209+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:31.388 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:31.382+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:31.413 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:31.408+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:31.530 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:31.520+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:31.551 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:31.546+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:31.843 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:31.838+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:31.847 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:31.843+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:32.151 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:32.146+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:32.189 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:32.183+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:32.352 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:32.343+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:32.392 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:32.384+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:32.516 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:32.510+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:32.533 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:32.527+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:32.899 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:32.892+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:32.900 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:32.896+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:33.129 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:33.123+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:33.189 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:33.184+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:33.336 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:33.331+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:33.361 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:33.354+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:33.535 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:15:33.529+0000 1694f700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:26.433264+0000 front 2019-12-09T20:14:26.373004+0000 (oldest deadline 2019-12-09T20:15:10.451073+0000) 2019-12-09T20:15:33.561 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:33.554+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:33.948 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:33.941+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:33.949 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:33.944+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:34.141 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:34.137+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:34.156 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:34.152+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:34.341 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:34.334+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:34.412 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:34.405+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:34.557 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:34.553+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:34.967 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:34.960+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:34.968 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:34.964+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:35.134 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:35.128+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:35.153 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:35.149+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:35.331 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:35.324+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:35.424 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:35.416+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:35.561 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:35.556+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:35.988 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:35.981+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:35.989 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:35.984+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:36.097 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:36.093+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:36.181 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:36.171+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:36.290 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:36.284+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:36.428 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:36.423+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:36.549 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:36.544+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:36.973 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:36.965+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:36.973 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:36.968+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:37.074 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:37.070+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:37.201 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:37.197+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:37.305 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:37.299+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:37.454 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:37.447+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:37.508 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:37.504+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:37.931 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:37.924+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:37.931 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:37.927+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:38.045 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:38.040+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:38.219 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:38.215+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:38.344 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:38.338+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:38.485 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:38.479+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:38.540 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:38.536+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:38.916 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:38.905+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:38.922 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:38.918+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:39.097 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:39.092+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:39.259 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:39.255+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:39.313 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:39.307+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:39.490 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:39.484+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:39.520 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:39.516+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:39.913 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:39.908+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:39.914 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:39.910+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:40.092 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:40.088+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:40.225 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:40.221+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:40.343 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:40.338+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:40.498 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:40.491+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:40.532 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:40.527+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:40.875 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:40.868+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:40.876 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:40.871+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:41.050 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:41.046+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:41.213 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:41.209+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:41.324 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:41.318+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:41.489 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:41.484+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:41.538 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:41.532+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:41.922 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:41.916+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:41.925 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:41.921+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:42.068 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:42.063+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:42.189 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:42.182+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:42.367 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:15:42.361+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e518 v518) 2019-12-09T20:15:42.368 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:42.362+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:42.457 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:42.451+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:42.593 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:42.588+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:42.886 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:42.881+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:42.890 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:42.886+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:43.088 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:43.081+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:43.222 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:43.207+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:43.378 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:43.371+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:43.489 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:43.482+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:43.614 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:43.608+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:43.884 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:43.878+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:43.889 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:43.884+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:44.119 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:44.113+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:44.212 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:44.205+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:44.403 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:44.397+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:44.480 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:44.467+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:44.654 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:44.647+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:44.880 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:44.873+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:44.881 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:44.876+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:45.082 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:45.078+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:45.226 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:45.221+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:45.369 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:45.360+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:45.471 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:45.466+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:45.628 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:45.621+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:45.868 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:45.860+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:45.868 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:45.863+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:46.050 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:46.044+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:46.271 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:46.265+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:46.401 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:46.394+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:46.481 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:46.477+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:46.593 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:46.586+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:46.889 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:46.883+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:46.890 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:46.886+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:47.074 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:47.069+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:47.313 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:47.308+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:47.361 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:47.354+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:47.391 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:15:47.372+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e518 v518) 2019-12-09T20:15:47.500 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:47.494+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:47.553 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:47.545+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:47.883 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:47.874+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:47.885 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:47.877+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:48.112 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:48.106+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:48.316 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:48.310+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:48.350 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:48.345+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:48.513 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:48.507+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:48.532 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:48.524+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:48.920 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:48.913+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:48.921 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:48.916+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:49.104 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:49.097+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:49.319 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:49.313+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:49.381 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:49.375+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:49.481 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:49.473+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:49.522 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:49.510+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:49.963 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:49.957+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:49.970 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:49.962+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:50.154 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:50.146+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:50.319 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:50.313+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:50.350 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:50.345+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:50.493 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:50.487+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:50.524 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:50.517+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:50.940 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:50.934+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:50.943 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:50.940+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:51.165 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:51.160+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:51.324 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:51.316+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:51.400 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:51.394+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:51.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:51.491+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:51.511 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:51.506+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:51.966 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:51.959+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:51.967 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:51.962+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:52.152 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:52.147+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:52.336 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:52.330+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:52.394 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:15:52.388+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e518 v518) 2019-12-09T20:15:52.430 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:52.425+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:52.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:52.458+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:52.490 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:52.486+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:52.950 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:52.943+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:52.951 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:52.946+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:53.147 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:53.143+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:53.353 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:53.347+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:53.460 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:53.455+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:53.500 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:53.494+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:53.541 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:53.536+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:53.904 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:53.899+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:53.907 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:53.903+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:54.149 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:54.143+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:54.364 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:54.358+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:54.454 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:54.448+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:54.494 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:54.489+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:54.525 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:54.516+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:54.867 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:54.861+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:54.873 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:54.866+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:55.172 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:55.165+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:55.396 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:55.390+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:55.442 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:55.436+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:55.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:55.452+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:55.535 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:55.530+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:55.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:55.847+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:55.854 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:55.849+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:56.221 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:56.216+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:56.437 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:56.422+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:56.445 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:56.434+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:56.454 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:56.442+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:56.501 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:56.490+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:56.859 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:56.850+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:56.875 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:56.860+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:57.199 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:57.194+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:57.411 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:15:57.402+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e518 v518) 2019-12-09T20:15:57.448 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:57.442+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:57.473 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:57.462+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:57.474 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:57.458+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:57.492 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:57.485+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:57.909 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:57.902+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:57.910 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:57.905+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:58.189 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:58.178+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:58.434 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:58.428+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:58.448 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:58.442+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:58.451 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:58.446+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:58.463 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:58.458+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:58.943 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:58.936+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:58.946 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:58.941+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:15:59.176 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:15:59.167+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:15:59.434 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:15:59.428+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:15:59.436 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:15:59.432+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:15:59.447 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:15:59.441+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:15:59.496 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:15:59.492+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:15:59.945 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:59.939+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:15:59.949 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:15:59.945+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:16:00.200 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:16:00.183+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:16:00.425 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:16:00.410+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:16:00.439 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:16:00.433+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:16:00.459 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:16:00.452+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:16:00.476 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:16:00.471+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:16:00.982 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:16:00.974+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:16:00.984 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:16:00.980+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:16:01.226 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:16:01.220+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:16:01.448 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:16:01.442+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:16:01.473 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:16:01.469+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:16:01.517 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:16:01.508+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:16:01.527 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:16:01.520+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:16:01.970 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:16:01.964+0000 1694f700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:14:46.318174+0000 (oldest deadline 2019-12-09T20:15:26.318174+0000) 2019-12-09T20:16:01.974 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:16:01.969+0000 1694f700 -1 osd.6 518 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:16:02.259 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:16:02.253+0000 1694f700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:25.399298+0000 front 2019-12-09T20:14:25.606814+0000 (oldest deadline 2019-12-09T20:15:10.688331+0000) 2019-12-09T20:16:02.473 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:16:02.469+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e518 v518) 2019-12-09T20:16:02.481 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:16:02.473+0000 1694f700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:29.110819+0000 front 2019-12-09T20:14:29.376038+0000 (oldest deadline 2019-12-09T20:15:13.801896+0000) 2019-12-09T20:16:02.483 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:16:02.478+0000 1694f700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.993870+0000 front 2019-12-09T20:14:24.247957+0000 (oldest deadline 2019-12-09T20:15:09.897705+0000) 2019-12-09T20:16:02.484 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:16:02.479+0000 1694f700 -1 osd.3 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:24.752674+0000 front 2019-12-09T20:14:25.137772+0000 (oldest deadline 2019-12-09T20:15:09.934063+0000) 2019-12-09T20:16:02.484 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:16:02.478+0000 1694f700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:14:28.495298+0000 front 2019-12-09T20:14:28.489655+0000 (oldest deadline 2019-12-09T20:15:11.925000+0000) 2019-12-09T20:16:03.097 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:16:03.006+0000 1694f700 -1 osd.6 519 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:119227 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-12-09T20:17:07.793 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:11:28.851 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:17:07.831 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:11:28.853 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:17:07.831 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:11:28.862 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:17:07.832 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:11:28.874 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:17:07.832 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:11:28.878 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:17:07.847 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:11:28.878 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:17:08.032 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:11:29.090 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:17:08.092 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:11:29.151 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:17:08.105 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:11:29.138 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:17:28.541 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:28.536+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:28.947 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:28.941+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:29.350 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:29.344+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:29.485 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:29.481+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:29.549 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:29.546+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:29.851 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:29.847+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:29.914 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:29.908+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:30.369 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:30.364+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:30.496 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:30.492+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:30.510 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:30.506+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:30.593 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:30.587+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:30.868 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:30.865+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:30.947 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:30.942+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:31.062 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:31.056+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:31.347 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:31.343+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:31.547 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:31.542+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:31.551 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:31.546+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:31.634 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:31.630+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:31.913 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:31.909+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:31.927 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:31.921+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:32.065 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:32.060+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:32.375 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:32.371+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:32.515 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:32.507+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:32.596 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:32.591+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:32.650 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:32.646+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:32.909 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:32.903+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:32.949 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:32.936+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:33.089 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:33.080+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:33.341 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:33.337+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:33.520 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:33.516+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:33.562 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:33.557+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:33.606 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:33.602+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:33.921 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:33.911+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:33.934 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:33.930+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:34.085 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:34.079+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:34.311 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:34.306+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:34.540 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:34.536+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:34.563 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:34.558+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:34.585 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:34.580+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:34.871 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:34.867+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:34.986 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:34.982+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:35.116 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:35.111+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:35.333 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:35.328+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:35.499 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:35.495+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:35.584 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:35.579+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:35.599 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:35.593+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:35.834 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:35.830+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:36.037 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:36.032+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:36.144 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:36.139+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:36.381 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:36.376+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:36.465 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:36.459+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:36.566 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:36.562+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:36.583 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:36.580+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:36.836 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:36.830+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:37.027 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:37.020+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:37.153 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:37.145+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:37.431 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:37.425+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:37.485 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:37.477+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:37.546 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:37.542+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:37.547 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:37.542+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:37.812 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:37.808+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:38.030 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:38.024+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:38.126 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:38.121+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:38.409 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:38.403+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:38.522 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:38.514+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:38.539 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:38.534+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:38.578 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:38.574+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:38.782 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:38.772+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:39.074 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:39.069+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:39.122 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:39.118+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:39.418 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:39.413+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:39.535 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:39.530+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:39.561 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:39.538+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:39.562 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:39.549+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:39.738 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:39.734+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:40.042 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:40.036+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:40.145 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:40.137+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:40.413 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:40.406+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:40.549 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:40.544+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:40.574 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:40.569+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:40.590 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:40.586+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:40.767 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:40.763+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:41.022 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:41.018+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:41.112 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:41.107+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:41.463 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:41.458+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:41.557 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:41.549+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:41.563 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:41.558+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:41.610 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:41.606+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:41.757 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:41.752+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:42.027 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:42.022+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:42.072 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:42.067+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:42.416 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:42.412+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:42.546 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:42.542+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:42.590 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:42.585+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:42.601 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:42.596+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:42.812 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:42.804+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:42.994 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:42.989+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:43.036 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:43.030+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:43.451 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:43.446+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:43.548 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:43.544+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:43.592 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:43.588+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:43.594 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:43.590+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:43.777 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:43.771+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:44.005 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:44.000+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:44.017 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:44.011+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:44.469 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:44.461+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:44.577 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:44.572+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:44.607 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:44.602+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:44.636 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:44.631+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:44.792 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:44.788+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:44.967 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:44.962+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:44.989 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:44.984+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:45.473 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:45.468+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:45.581 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:45.577+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:45.599 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:45.595+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:45.662 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:45.657+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:45.839 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:45.835+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:45.929 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:45.924+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:46.012 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:46.004+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:46.476 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:46.471+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:46.535 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:46.531+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:46.611 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:46.607+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:46.705 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:46.702+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:46.872 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:46.867+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:46.938 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:46.933+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:47.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:47.057+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:47.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:47.491+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:47.562 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:47.558+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:47.603 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:47.600+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:47.688 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:47.685+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:47.830 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:47.826+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:47.920 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:47.913+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:48.057 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:48.052+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:48.532 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:48.528+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:48.532 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:48.528+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:48.636 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:48.632+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:48.658 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:48.655+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:48.822 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:48.818+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:48.888 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:48.883+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:49.049 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:49.045+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:49.555 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:49.551+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:49.576 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:49.572+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:49.650 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:49.645+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:49.672 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:49.668+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:49.805 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:49.801+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:49.887 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:49.882+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:50.009 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:50.003+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:50.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:50.513+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:50.620 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:50.615+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:50.659 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:50.655+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:50.674 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:50.665+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:50.776 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:50.772+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:50.912 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:50.908+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:50.979 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:50.974+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:51.488 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:51.483+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:51.604 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:51.597+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:51.625 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:51.620+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:51.631 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:51.626+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:51.765 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:51.759+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:51.959 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:51.953+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:51.993 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:51.987+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:52.486 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:52.481+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:52.618 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:52.613+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:52.639 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:52.635+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:52.657 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:52.652+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:52.737 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:52.731+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:52.916 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:52.911+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:53.041 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:53.036+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:53.462 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:53.458+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:53.615 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:53.610+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:53.655 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:53.650+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:53.677 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:53.673+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:53.702 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:53.697+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:53.885 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:53.880+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:54.021 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:54.016+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:54.501 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:54.492+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:54.635 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:54.630+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:54.637 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:54.632+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:54.646 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:54.642+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:54.703 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:54.697+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:54.896 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:54.891+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:55.018 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:55.014+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:55.533 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:55.528+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:55.639 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:55.634+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:55.644 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:55.639+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:55.650 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:55.646+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:55.752 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:55.746+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:55.939 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:55.934+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:55.983 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:55.976+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:56.560 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:56.555+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:56.610 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:56.604+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:56.645 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:56.640+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:56.658 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:56.651+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:56.798 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:56.793+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:56.908 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:56.902+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:56.971 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:56.966+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:57.555 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:57.550+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:57.620 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:57.614+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:57.650 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:57.645+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:57.654 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:57.650+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:57.767 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:57.762+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:57.944 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:57.939+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:57.947 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:57.942+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:58.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:58.584+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:58.651 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:58.647+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:58.653 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:58.648+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:58.661 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:58.655+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:58.733 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:58.727+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:58.948 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:58.943+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:17:58.986 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:58.982+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:17:59.616 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:17:59.609+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:17:59.631 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:17:59.626+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:17:59.665 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:17:59.660+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:17:59.708 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:17:59.703+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:17:59.741 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:17:59.736+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:17:59.913 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:17:59.908+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:18:00.001 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:17:59.996+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:18:00.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:18:00.582+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:18:00.640 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:18:00.635+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:18:00.698 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:18:00.693+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:18:00.705 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:18:00.700+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:18:00.773 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:18:00.768+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:18:00.949 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:18:00.943+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:18:01.019 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:18:01.007+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:18:01.558 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:18:01.553+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:18:01.685 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:18:01.678+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:18:01.691 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:18:01.683+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:18:01.723 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:18:01.718+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:18:01.796 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:18:01.791+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:18:01.937 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:18:01.932+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:18:02.034 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:18:02.025+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:18:02.575 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:18:02.570+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:18:02.665 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:18:02.660+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:18:02.672 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:18:02.668+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:18:02.722 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:18:02.717+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:18:02.787 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:18:02.782+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:18:02.827 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:18:02.821+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e524 v524) 2019-12-09T20:18:02.979 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:18:02.974+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:18:03.017 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:18:03.011+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:18:03.559 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:18:03.551+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:18:03.620 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:18:03.616+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:18:03.695 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:18:03.689+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:18:03.698 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:18:03.692+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:18:03.820 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:18:03.814+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:18:03.987 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:18:03.982+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:18:03.995 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:18:03.990+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:18:04.583 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:18:04.579+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:18:04.622 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:18:04.618+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:18:04.662 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:18:04.657+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:18:04.740 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:18:04.736+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:18:04.784 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:18:04.779+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:18:04.977 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:18:04.972+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:18:05.037 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:18:05.028+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:18:05.614 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:18:05.610+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:18:05.655 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:18:05.650+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:18:05.666 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:18:05.661+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:18:05.777 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:18:05.770+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:18:05.788 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:18:05.783+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:18:05.968 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:18:05.964+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:18:05.995 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:18:05.990+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:18:06.586 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:18:06.582+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:18:06.628 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:18:06.622+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:18:06.665 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:18:06.660+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:18:06.768 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:18:06.764+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:18:06.784 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:18:06.780+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:18:06.979 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:18:06.975+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:18:06.994 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:18:06.990+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:18:07.592 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:18:07.588+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.194106+0000 front 2019-12-09T20:16:48.508965+0000 (oldest deadline 2019-12-09T20:17:29.236173+0000) 2019-12-09T20:18:07.656 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:18:07.651+0000 1694f700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.950590+0000 front 2019-12-09T20:16:45.834284+0000 (oldest deadline 2019-12-09T20:17:27.945383+0000) 2019-12-09T20:18:07.705 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:18:07.697+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:46.430271+0000 front 2019-12-09T20:16:46.431229+0000 (oldest deadline 2019-12-09T20:17:29.888419+0000) 2019-12-09T20:18:07.752 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:18:07.747+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:48.504483+0000 front 2019-12-09T20:16:47.580317+0000 (oldest deadline 2019-12-09T20:17:29.389536+0000) 2019-12-09T20:18:07.831 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:18:07.826+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:44.107904+0000 front 2019-12-09T20:16:44.114820+0000 (oldest deadline 2019-12-09T20:17:28.964786+0000) 2019-12-09T20:18:07.883 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:18:07.877+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e524 v524) 2019-12-09T20:18:07.967 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:18:07.959+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:45.978114+0000 front 2019-12-09T20:16:45.888522+0000 (oldest deadline 2019-12-09T20:17:28.784470+0000) 2019-12-09T20:18:08.008 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:18:08.003+0000 1694f700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:16:47.654854+0000 front 2019-12-09T20:16:47.190120+0000 (oldest deadline 2019-12-09T20:17:30.999922+0000) 2019-12-09T20:18:43.136 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:18:43.033+0000 32788700 -1 osd.6 530 build_incremental_map_msg missing incremental map 530 2019-12-09T20:18:43.142 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:18:43.035+0000 32788700 -1 osd.6 530 build_incremental_map_msg missing incremental map 530 2019-12-09T20:18:43.142 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:18:43.037+0000 32788700 -1 osd.6 530 build_incremental_map_msg missing incremental map 530 2019-12-09T20:18:43.237 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:18:43.175+0000 37f93700 -1 osd.6 530 build_incremental_map_msg missing incremental map 530 2019-12-09T20:18:43.334 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:18:43.307+0000 31f87700 -1 osd.6 530 build_incremental_map_msg missing incremental map 530 2019-12-09T20:18:43.353 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:18:43.339+0000 3578e700 -1 osd.6 530 build_incremental_map_msg missing incremental map 530 2019-12-09T20:19:06.053 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:06.044+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:06.250 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:06.244+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:06.384 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:06.378+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:06.934 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:06.927+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:07.046 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:07.040+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:07.300 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:07.294+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:07.398 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:07.393+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:07.972 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:07.967+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:08.090 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:08.084+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:08.303 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:08.297+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:08.381 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:08.375+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:09.018 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:09.011+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:09.131 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:09.124+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:09.265 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:09.258+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:09.379 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:09.374+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:09.458 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:09.453+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:10.047 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:10.036+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:10.139 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:10.131+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:10.236 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:10.229+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:10.409 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:10.402+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:10.506 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:10.499+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:11.062 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:11.057+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:11.120 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:11.116+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:11.287 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:11.280+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:11.432 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:11.427+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:11.532 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:11.526+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:11.967 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:11.962+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:12.059 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:12.052+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:12.111 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:12.105+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:12.264 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:12.258+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:12.291 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:12.284+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:12.453 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:12.449+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:12.582 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:12.574+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:13.011 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:13.006+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:13.088 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:13.082+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:13.108 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:13.101+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:13.248 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:13.243+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:13.292 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:13.286+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:13.478 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:13.472+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:13.585 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:13.572+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:14.002 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:13.998+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:14.046 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:14.040+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:14.102 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:14.096+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:14.264 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:14.258+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:14.277 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:14.272+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:14.494 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:14.487+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:14.577 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:14.570+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:14.990 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:14.985+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:15.069 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:15.063+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:15.107 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:15.101+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:15.243 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:15.237+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:15.253 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:15.248+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:15.530 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:15.523+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:15.554 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:15.547+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:16.049 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:16.044+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:16.067 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:16.061+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:16.139 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:16.134+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:16.241 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:16.234+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:16.294 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:16.288+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:16.557 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:16.550+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:16.568 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:16.562+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:17.035 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:17.027+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:17.083 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:17.077+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:17.172 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:17.166+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:17.267 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:17.261+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:17.309 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:17.302+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:17.582 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:17.575+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:17.604 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:17.599+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:17.998 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:17.992+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:18.135 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:18.129+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:18.171 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:18.165+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:18.227 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:13:39.285 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:18.234 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:13:39.292 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:18.273 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:13:39.332 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:18.278 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:13:39.337 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:18.284 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:18.277+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:18.292 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:13:39.327 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:18.301 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:13:39.336 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:18.308 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:18.303+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:18.358 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:13:39.417 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:18.412 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:13:39.470 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:18.470 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:13:39.504 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:18.543 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:18.538+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:18.629 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:18.618+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:19.037 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:19.023+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:19.037 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:19.027+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:19.101 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:19.089+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:19.202 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:19.195+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:19.291 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:19.285+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:19.317 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:19.309+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:19.498 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:19.493+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:19.637 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:19.634+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:20.023 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:20.013+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:20.023 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:20.017+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:20.091 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:20.087+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:20.238 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:20.233+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:20.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:20.268+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:20.343 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:20.336+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:20.510 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:20.504+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:20.650 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:20.645+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:21.020 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:21.014+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:21.021 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:21.017+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:21.141 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:21.137+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:21.248 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:21.243+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:21.265 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:21.259+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:21.371 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:21.363+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:21.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:21.512+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:21.626 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:21.621+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:22.043 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:22.036+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:22.046 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:22.039+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:22.103 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:22.099+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:22.235 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:22.230+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:22.266 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:22.259+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:22.396 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:22.390+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:22.497 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:22.492+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:22.611 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:22.606+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:23.069 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:23.062+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:23.070 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:23.065+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:23.108 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:23.104+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:23.245 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:23.241+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:23.280 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:23.274+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:23.349 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:23.344+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:23.468 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:23.457+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:23.595 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:23.591+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:24.109 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:24.104+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:24.109 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:24.103+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:24.113 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:24.109+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:24.205 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:24.200+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:24.324 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:24.318+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:24.344 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:24.338+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:24.442 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:24.435+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:24.626 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:24.621+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:25.079 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:25.073+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:25.085 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:25.078+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:25.155 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:25.147+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:25.193 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:25.187+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:25.313 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:25.307+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:25.345 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:25.338+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:25.467 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:25.459+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:25.584 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:25.580+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:26.115 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:26.111+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:26.131 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:26.125+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:26.133 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:26.128+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:26.183 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:26.178+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:26.293 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:26.287+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:26.343 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:26.335+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:26.480 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:26.474+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:26.635 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:26.630+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:27.128 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:27.119+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:27.129 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:27.121+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:27.143 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:27.134+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:27.184 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:27.180+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:27.341 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:27.330+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:27.374 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:27.363+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:27.448 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:27.441+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:27.675 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:27.669+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:28.098 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:28.094+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:28.131 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:28.125+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:28.135 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:28.131+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:28.173 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:28.167+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:28.362 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:28.352+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:28.362 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:28.356+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:28.441 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:28.434+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:28.713 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:28.710+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:29.069 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:29.063+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:29.126 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:29.122+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:29.161 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:29.154+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:29.162 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:29.157+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:29.364 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:29.357+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:29.409 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:29.403+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:29.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:29.451+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:29.699 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:29.695+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:30.089 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:30.083+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:30.133 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:30.126+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:30.174 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:30.167+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:30.175 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:30.170+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:30.337 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:30.330+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:30.378 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:30.371+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:30.487 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:30.480+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:30.680 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:30.676+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:31.119 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:31.115+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:31.171 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:31.165+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:31.171 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:31.168+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:31.182 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:31.177+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:31.371 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:31.367+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:31.392 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:31.388+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:31.487 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:31.482+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:31.725 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:31.718+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:32.110 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:32.104+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:32.154 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:32.149+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:32.156 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:32.152+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:32.194 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:32.189+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:32.348 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:32.341+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:32.377 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:32.371+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:32.512 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:32.507+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:32.689 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:32.685+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:33.084 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:33.079+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:33.167 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:33.158+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:33.168 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:33.164+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:33.240 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:33.234+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:33.348 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:33.342+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:33.355 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:33.349+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:33.556 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:33.544+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:33.687 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:33.683+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:34.092 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:34.087+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:34.182 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:34.176+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:34.185 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:34.181+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:34.211 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:34.205+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:34.395 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:34.388+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:34.395 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:34.390+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:34.509 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:34.502+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:34.715 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:34.711+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:35.082 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:35.074+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:35.189 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:35.182+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:35.192 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:35.185+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:35.205 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:35.199+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:35.384 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:35.377+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:35.398 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:35.391+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:35.522 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:35.517+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:35.696 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:35.692+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:36.112 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:36.107+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:36.161 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:36.156+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:36.242 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:36.236+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:36.246 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:36.242+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:36.345 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:36.339+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:36.412 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:36.406+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:36.561 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:36.554+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:36.654 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:36.647+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:37.135 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:37.130+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:37.150 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:37.145+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:37.244 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:37.236+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:37.245 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:37.239+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:37.390 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:37.384+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:37.463 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:37.456+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:37.562 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:37.556+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:37.606 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:37.602+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:38.141 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:38.136+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:38.164 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:38.158+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:38.246 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:38.238+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:38.247 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:38.241+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:38.256 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:19:38.249+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 47sec e530 v530) 2019-12-09T20:19:38.406 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:38.400+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:38.418 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:38.412+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:38.529 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:38.524+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:38.568 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:38.564+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:39.124 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:39.119+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:39.178 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:39.173+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:39.299 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:39.291+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:39.301 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:39.295+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:39.387 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:39.382+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:39.431 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:39.422+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:39.583 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:39.576+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:39.600 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:39.594+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:40.158 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:40.153+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:40.164 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:40.159+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:40.327 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:40.320+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:40.328 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:40.323+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:40.348 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:40.342+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:40.470 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:40.464+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:40.595 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:40.590+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:40.637 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:40.632+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:41.125 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:41.121+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:41.145 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:41.141+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:41.313 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:41.306+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:41.314 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:41.309+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:41.354 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:41.345+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:41.434 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:41.428+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:41.580 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:41.575+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:41.623 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:41.619+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:42.094 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:42.090+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:42.193 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:42.189+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:42.297 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:42.282+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:42.297 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:42.284+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:42.341 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:42.335+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:42.457 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:42.451+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:42.574 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:42.568+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:42.644 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:42.639+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:43.091 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:43.086+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:43.202 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:43.198+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:43.286 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:43.279+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:43.287 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:43.282+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:43.288 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:19:43.282+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 47sec e530 v530) 2019-12-09T20:19:43.351 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:43.345+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:43.473 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:43.467+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:43.610 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:43.604+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:43.678 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:43.674+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:44.109 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:44.105+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:44.198 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:44.193+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:44.318 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:44.311+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:44.319 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:44.314+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:44.377 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:44.371+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:44.428 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:44.422+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:44.576 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:44.569+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:44.728 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:44.725+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:45.071 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:45.067+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:45.213 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:45.209+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:45.369 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:45.363+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:45.372 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:45.368+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:45.380 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:45.374+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:45.423 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:45.416+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:45.607 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:45.601+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:45.747 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:45.743+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:46.086 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:46.081+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:46.251 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:46.240+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:46.331 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:46.323+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:46.332 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:46.327+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:46.406 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:46.400+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:46.436 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:46.429+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:46.610 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:46.603+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:46.730 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:46.726+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:47.060 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:47.055+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:47.262 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:47.258+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:47.297 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:47.292+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:47.298 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:47.294+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:47.395 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:47.391+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:47.477 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:19:47.470+0000 1694f700 -1 osd.4 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.615538+0000 front 2019-12-09T20:18:23.744622+0000 (oldest deadline 2019-12-09T20:19:06.491301+0000) 2019-12-09T20:19:47.618 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:47.612+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:47.684 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:19:47.680+0000 1694f700 -1 osd.1 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.891200+0000 front 2019-12-09T20:18:20.197994+0000 (oldest deadline 2019-12-09T20:19:06.004784+0000) 2019-12-09T20:19:48.082 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:19:48.078+0000 1694f700 -1 osd.3 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:20.007107+0000 front 2019-12-09T20:18:20.076199+0000 (oldest deadline 2019-12-09T20:19:05.889334+0000) 2019-12-09T20:19:48.296 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:19:48.291+0000 1694f700 -1 osd.2 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:22.877175+0000 front 2019-12-09T20:18:23.042406+0000 (oldest deadline 2019-12-09T20:19:11.485931+0000) 2019-12-09T20:19:48.298 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:48.292+0000 1694f700 -1 osd.6 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:18:38.102491+0000 (oldest deadline 2019-12-09T20:19:18.102491+0000) 2019-12-09T20:19:48.302 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:48.298+0000 1694f700 -1 osd.6 530 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-12-09T20:19:48.342 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:19:48.337+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 47sec e530 v530) 2019-12-09T20:19:48.377 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:19:48.371+0000 1694f700 -1 osd.5 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:24.130784+0000 front 2019-12-09T20:18:25.842648+0000 (oldest deadline 2019-12-09T20:19:05.821026+0000) 2019-12-09T20:19:48.627 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:19:48.622+0000 1694f700 -1 osd.7 530 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:18:23.911075+0000 front 2019-12-09T20:18:23.913478+0000 (oldest deadline 2019-12-09T20:19:09.108588+0000) 2019-12-09T20:19:49.156 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:19:49.151+0000 38f95700 -1 osd.6 531 build_incremental_map_msg missing incremental map 530 2019-12-09T20:20:56.193 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:20:56.189+0000 1694f700 -1 osd.0 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:120729 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 385731248 gen 136] snapc 0=[] ondisk+write+known_if_redirected e534) 2019-12-09T20:20:57.221 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:20:57.218+0000 1694f700 -1 osd.0 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:120729 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 385731248 gen 136] snapc 0=[] ondisk+write+known_if_redirected e534) 2019-12-09T20:20:58.254 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:20:58.250+0000 1694f700 -1 osd.0 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:120729 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 385731248 gen 136] snapc 0=[] ondisk+write+known_if_redirected e534) 2019-12-09T20:21:07.427 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:15:28.484 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:21:07.431 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:15:28.489 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:21:07.448 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:15:28.502 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:21:07.448 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:15:28.504 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:21:07.449 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:15:28.474 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:21:07.449 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:15:28.477 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:21:07.557 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:15:28.613 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:21:07.560 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:15:28.618 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:21:07.573 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:15:28.607 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:21:26.270 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:26.265+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:26.276 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:26.268+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:26.568 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:26.563+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:27.276 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:27.270+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:27.278 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:27.274+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:27.410 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:27.404+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:27.554 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:27.550+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:28.254 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:28.248+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:28.317 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:28.310+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:28.422 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:28.417+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:28.444 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:28.440+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:28.560 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:28.555+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:29.233 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:29.227+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:29.319 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:29.314+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:29.389 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:29.383+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:29.466 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:29.460+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:29.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:29.513+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:29.583 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:29.580+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:30.275 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:30.270+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:30.330 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:30.326+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:30.427 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:30.422+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:30.498 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:30.493+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:30.519 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:30.515+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:30.597 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:30.594+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:30.934 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:30.930+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:31.311 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:31.307+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:31.346 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:31.341+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:31.393 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:31.388+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:31.480 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:31.476+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:31.483 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:31.477+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:31.646 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:31.637+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:31.898 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:31.893+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:32.296 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:32.291+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:32.304 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:32.299+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:32.401 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:32.396+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:32.496 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:32.476+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:32.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:32.489+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:32.694 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:32.690+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:32.947 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:32.943+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:33.279 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:33.274+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:33.357 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:33.346+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:33.381 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:33.377+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:33.444 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:33.440+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:33.455 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:33.450+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:33.724 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:33.718+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:33.919 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:33.914+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:34.261 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:34.257+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:34.364 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:34.360+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:34.375 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:34.370+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:34.466 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:34.463+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:34.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:34.485+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:34.763 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:34.758+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:34.896 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:34.892+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:35.224 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:35.213+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:35.329 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:35.324+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:35.358 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:35.354+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:35.452 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:35.447+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:35.487 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:35.482+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:35.806 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:35.801+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:35.876 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:35.871+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:36.179 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:36.174+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:36.368 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:36.363+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:36.396 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:36.393+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:36.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:36.421+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:36.512 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:36.507+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:36.856 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:36.852+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:36.868 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:36.864+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:37.185 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:37.180+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:37.373 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:37.364+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:37.376 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:37.372+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:37.422 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:37.419+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:37.555 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:37.551+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:37.879 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:37.875+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:37.905 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:37.902+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:38.146 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:38.141+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:38.354 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:38.349+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:38.391 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:38.386+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:38.462 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:38.457+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:38.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:38.585+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:38.865 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:38.862+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:38.929 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:38.921+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:39.197 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:39.192+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:39.342 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:39.338+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:39.375 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:39.372+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:39.444 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:39.439+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:39.584 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:39.579+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:39.853 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:39.849+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:39.900 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:39.896+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:40.255 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:40.244+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:40.305 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:40.301+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:40.368 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:40.364+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:40.445 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:40.440+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:40.578 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:40.573+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:40.863 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:40.860+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:40.880 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:40.877+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:41.208 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:41.203+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:41.311 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:41.306+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:41.338 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:41.334+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:41.462 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:41.457+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:41.576 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:41.571+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:41.859 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:41.855+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:41.901 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:41.897+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:42.193 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:42.188+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:42.280 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:42.274+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:42.384 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:42.380+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:42.488 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:42.485+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:42.584 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:42.579+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:42.861 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:42.857+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:42.874 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:42.870+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:43.196 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:43.190+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:43.299 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:43.294+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:43.364 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:43.360+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:43.451 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:43.447+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:43.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:43.582+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:43.853 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:43.849+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:43.919 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:43.916+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:44.239 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:44.234+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:44.309 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:44.299+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:44.400 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:44.396+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:44.432 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:44.426+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:44.627 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:44.621+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:44.818 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:44.813+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:44.951 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:44.947+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:45.194 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:45.189+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:45.285 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:45.280+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:45.391 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:45.388+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:45.439 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:45.435+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:45.646 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:45.642+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:45.861 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:45.856+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:45.927 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:45.922+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:46.178 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:46.174+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:46.322 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:46.318+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:46.410 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:46.406+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:46.427 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:46.423+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:46.702 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:46.696+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:46.846 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:46.841+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:46.979 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:46.974+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:47.179 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:47.174+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:47.353 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:47.347+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:47.395 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:47.391+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:47.458 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:47.455+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:47.716 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:47.711+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:47.817 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:47.813+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:47.947 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:47.937+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:48.232 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:48.227+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:48.338 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:48.333+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:48.420 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:48.415+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:48.448 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:48.443+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:48.681 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:48.675+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:48.859 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:48.855+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:48.913 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:48.909+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:49.232 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:49.226+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:49.328 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:49.323+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:49.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:49.420+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:49.452 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:49.448+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:49.692 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:49.687+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:49.866 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:49.862+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:49.879 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:49.876+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:50.221 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:50.213+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:50.373 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:50.367+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:50.430 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:50.425+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:50.442 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:50.438+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:50.664 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:50.660+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:50.902 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:50.898+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:50.903 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:50.899+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:51.262 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:51.256+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:51.338 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:51.334+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:51.421 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:51.417+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:51.452 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:51.448+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:51.641 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:51.635+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:51.900 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:51.897+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:51.953 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:51.947+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:52.263 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:52.258+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:52.360 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:52.355+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:52.469 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:52.465+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:52.470 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:52.465+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:52.678 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:52.674+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:52.896 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:52.893+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:52.939 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:52.934+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:53.310 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:53.304+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:53.336 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:53.332+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:53.432 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:53.429+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:53.462 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:53.458+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:53.668 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:53.663+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:53.886 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:53.882+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:53.906 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:53.903+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:54.315 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:54.310+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:54.359 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:54.354+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:54.417 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:54.414+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:54.517 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:54.512+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:54.654 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:54.649+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:54.848 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:54.844+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:54.949 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:54.944+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:55.361 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:55.357+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:55.395 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:55.388+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:55.415 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:55.411+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:55.567 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:55.563+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:55.623 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:55.618+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:55.874 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:55.870+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:55.913 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:55.909+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:56.359 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:56.354+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:56.418 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:56.413+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:56.429 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:56.426+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:56.571 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:56.567+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:56.605 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:56.601+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:56.895 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:56.890+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:56.929 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:56.919+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:57.342 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:57.338+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:57.389 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:57.386+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:57.411 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:57.406+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:57.574 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:57.566+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:57.579 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:57.575+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:57.921 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:57.916+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:57.947 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:57.943+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:58.346 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:58.342+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:58.369 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:58.363+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:58.395 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:58.390+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:58.573 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:58.569+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:58.628 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:58.623+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:58.730 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:21:58.723+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 43sec e535 v535) 2019-12-09T20:21:58.900 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:58.896+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:21:59.002 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:21:58.996+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:21:59.329 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:21:59.325+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:21:59.389 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:21:59.377+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:21:59.413 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:21:59.407+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:21:59.579 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:21:59.575+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:21:59.586 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:21:59.582+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:21:59.887 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:21:59.883+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:22:00.033 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:22:00.029+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:22:00.355 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:22:00.351+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:22:00.411 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:22:00.405+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:22:00.452 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:22:00.447+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:22:00.557 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:22:00.553+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:22:00.573 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:22:00.569+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:22:00.915 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:22:00.911+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:22:01.070 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:22:01.066+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:22:01.386 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:22:01.381+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:22:01.421 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:22:01.416+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:22:01.453 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:22:01.446+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:22:01.511 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:22:01.507+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:22:01.612 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:22:01.607+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:22:01.921 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:22:01.917+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:22:02.059 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:22:02.055+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:22:02.382 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:22:02.378+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:22:02.423 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:22:02.418+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:22:02.455 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:22:02.452+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:22:02.530 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:22:02.526+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:22:02.577 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:22:02.571+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:22:02.932 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:22:02.927+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:22:03.024 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:22:03.018+0000 1694f700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.060043+0000 front 2019-12-09T20:20:46.055033+0000 (oldest deadline 2019-12-09T20:21:29.468503+0000) 2019-12-09T20:22:03.394 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:22:03.391+0000 1694f700 -1 osd.0 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:44.426040+0000 front 2019-12-09T20:20:45.956224+0000 (oldest deadline 2019-12-09T20:21:25.744305+0000) 2019-12-09T20:22:03.456 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:22:03.448+0000 1694f700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:42.460911+0000 front 2019-12-09T20:20:42.366766+0000 (oldest deadline 2019-12-09T20:21:28.252060+0000) 2019-12-09T20:22:03.475 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:22:03.470+0000 1694f700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:46.054231+0000 front 2019-12-09T20:20:44.103604+0000 (oldest deadline 2019-12-09T20:21:26.016045+0000) 2019-12-09T20:22:03.539 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:22:03.535+0000 1694f700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:41.573963+0000 front 2019-12-09T20:20:41.372768+0000 (oldest deadline 2019-12-09T20:21:26.558927+0000) 2019-12-09T20:22:03.612 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:22:03.606+0000 1694f700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:40.462561+0000 front 2019-12-09T20:20:41.306640+0000 (oldest deadline 2019-12-09T20:21:25.620128+0000) 2019-12-09T20:22:03.803 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:22:03.796+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 43sec e535 v535) 2019-12-09T20:22:03.904 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:22:03.901+0000 1694f700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:20:45.764229+0000 front 2019-12-09T20:20:46.383371+0000 (oldest deadline 2019-12-09T20:21:30.568454+0000) 2019-12-09T20:22:09.145 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:16:30.204 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:22:09.165 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:16:30.218 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:22:09.207 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:16:30.265 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:22:09.209 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:16:30.268 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:22:09.244 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:16:30.279 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:22:09.245 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:16:30.304 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:22:09.268 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:16:30.302 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:22:09.281 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:16:30.335 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:22:09.365 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:16:30.400 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:22:40.831 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:22:40.820+0000 35f8f700 -1 osd.6 540 build_incremental_map_msg missing incremental map 540 2019-12-09T20:22:41.006 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:22:40.993+0000 3378a700 -1 osd.6 540 build_incremental_map_msg missing incremental map 540 2019-12-09T20:22:41.193 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:22:41.146+0000 35f8f700 -1 osd.6 540 build_incremental_map_msg missing incremental map 540 2019-12-09T20:22:41.414 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:22:41.405+0000 36790700 -1 osd.6 540 build_incremental_map_msg missing incremental map 540 2019-12-09T20:23:01.668 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:01.662+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:02.485 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:02.478+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:02.665 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:02.661+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:02.985 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:02.978+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:03.109 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:03.102+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:03.436 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:03.432+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:03.691 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:03.685+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:03.700 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:03.697+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:03.974 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:03.967+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:04.068 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:04.062+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:04.452 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:04.447+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:04.677 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:04.672+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:04.749 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:04.744+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:04.968 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:04.963+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:05.075 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:05.067+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:05.469 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:05.464+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:05.701 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:05.692+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:05.702 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:05.699+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:05.947 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:05.941+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:06.109 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:06.104+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:06.498 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:06.492+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:06.672 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:06.662+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:06.700 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:06.696+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:06.971 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:06.965+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:07.074 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:07.068+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:07.498 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:07.494+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:07.688 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:07.682+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:07.751 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:07.747+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:08.026 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:08.019+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:08.109 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:08.101+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:08.473 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:08.468+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:08.679 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:08.674+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:08.743 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:08.738+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:09.033 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:09.025+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:09.159 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:09.153+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:09.464 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:09.458+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:09.523 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:09.519+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:09.680 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:09.675+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:09.697 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:09.692+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:10.087 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:10.082+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:10.139 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:10.133+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:10.502 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:10.497+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:10.521 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:10.517+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:10.685 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:10.680+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:10.692 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:10.684+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:11.094 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:11.088+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:11.100 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:11.094+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:11.531 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:11.527+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:11.563 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:11.558+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:11.663 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:11.657+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:11.736 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:11.731+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:12.092 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:12.085+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:12.135 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:12.128+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:12.533 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:12.529+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:12.577 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:12.573+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:12.699 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:12.692+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:12.745 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:12.735+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:13.131 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:13.125+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:13.164 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:13.159+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:13.516 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:13.512+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:13.543 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:13.538+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:13.693 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:13.686+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:13.694 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:13.690+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:14.142 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:14.136+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:14.179 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:14.173+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:14.500 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:14.496+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:14.541 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:14.536+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:14.668 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:14.664+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:14.688 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:14.682+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:15.153 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:15.145+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:15.187 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:15.180+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:15.481 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:15.477+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:15.552 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:15.545+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:15.654 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:15.648+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:15.745 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:15.739+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:16.139 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:16.132+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:16.231 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:16.225+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:16.511 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:16.506+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:16.534 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:16.529+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:16.662 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:16.657+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:16.711 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:16.704+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:17.096 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:17.088+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:17.255 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:17.248+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:17.541 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:17.536+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:17.551 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:17.544+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:17.552 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:17.548+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:17.650 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:17.645+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:17.742 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:17.736+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:18.097 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:18.092+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:18.283 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:18.277+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:18.555 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:18.547+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:18.577 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:18.570+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:18.578 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:18.573+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:18.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:18.613+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:18.643 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:18.636+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:18.759 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:18.743+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:19.102 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:19.095+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:19.271 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:19.265+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:19.572 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:19.568+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:19.601 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:19.596+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:19.622 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:19.616+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:19.626 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:19.622+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:19.628 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:19.623+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:19.796 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:19.790+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:20.063 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:20.056+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:20.288 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:20.282+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:20.560 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:20.552+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:20.635 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:20.628+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:20.638 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:20.633+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:20.642 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:20.635+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:20.644 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:20.638+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:20.835 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:20.830+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:21.114 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:21.108+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:21.278 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:21.272+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:21.604 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:21.598+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:21.643 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:21.637+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:21.651 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:21.646+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:21.695 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:21.690+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:21.699 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:21.695+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:21.865 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:21.859+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:22.165 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:22.161+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:22.276 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:22.266+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:22.633 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:22.628+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:22.654 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:22.648+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:22.657 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:22.651+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:22.663 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:22.658+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:22.696 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:22.688+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:22.854 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:22.849+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:23.191 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:23.185+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:23.318 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:23.304+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:23.619 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:23.614+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:23.642 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:23.628+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:23.680 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:23.674+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:23.681 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:23.677+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:23.740 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:23.734+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:23.888 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:23.880+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:24.240 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:24.232+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:24.281 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:24.275+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:24.579 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:24.571+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:24.664 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:24.655+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:24.703 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:24.694+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:24.705 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:24.698+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:24.754 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:24.750+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:24.889 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:24.882+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:25.238 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:25.232+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:25.246 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:25.239+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:25.598 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:25.593+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:25.665 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:25.659+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:25.712 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:25.706+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:25.714 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:25.709+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:25.765 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:25.749+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:25.849 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:25.843+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:26.197 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:26.190+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:26.205 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:26.199+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:26.591 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:26.584+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:26.669 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:26.663+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:26.671 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:26.666+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:26.686 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:26.679+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:26.800 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:26.795+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:26.877 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:26.871+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:27.167 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:27.161+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:27.184 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:27.178+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:27.573 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:27.567+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:27.698 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:27.693+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:27.720 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:27.715+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:27.724 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:27.720+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:27.850 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:27.845+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:27.916 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:27.911+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:28.171 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:28.164+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:28.179 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:28.168+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:28.539 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:28.534+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:28.680 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:28.673+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:28.681 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:28.677+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:28.689 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:28.683+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:28.858 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:28.851+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:28.888 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:28.883+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:29.157 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:29.149+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:29.172 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:29.167+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:29.507 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:29.502+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:29.647 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:29.640+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:29.648 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:29.643+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:29.741 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:29.735+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:29.847 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:29.841+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:29.899 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:29.894+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:30.168 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:30.163+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:30.195 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:30.190+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:30.493 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:30.488+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:30.658 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:30.652+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:30.659 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:30.655+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:30.791 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:30.786+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:30.893 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:30.887+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:30.897 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:30.891+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:31.168 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:31.161+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:31.193 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:31.186+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:31.474 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:31.469+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:31.674 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:31.668+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:31.675 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:31.670+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:31.784 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:31.780+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:31.901 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:31.894+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:31.942 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:31.936+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:32.126 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:32.120+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:32.160 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:32.153+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:32.506 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:32.501+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:32.697 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:32.692+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:32.698 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:32.694+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:32.739 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:32.735+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:32.933 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:32.926+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:32.978 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:32.973+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:33.103 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:33.096+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:33.129 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:33.117+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:33.538 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:33.532+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:33.704 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:33.699+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:33.719 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:33.713+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:33.722 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:33.718+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:33.917 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:33.912+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:33.989 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:33.983+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:34.100 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:34.091+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:34.123 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:34.117+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:34.430 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:23:34.424+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e541 v541) 2019-12-09T20:23:34.591 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:34.582+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:34.692 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:34.686+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:34.696 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:34.691+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:34.720 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:34.715+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:34.905 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:34.900+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:34.971 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:34.965+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:35.116 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:35.111+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:35.118 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:35.113+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:35.621 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:35.615+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:35.691 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:35.686+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:35.692 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:35.685+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:35.692 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:35.687+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:35.872 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:35.865+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:35.968 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:35.963+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:36.077 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:36.070+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:36.107 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:36.101+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:36.673 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:36.666+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:36.709 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:36.703+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:36.721 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:36.714+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:36.722 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:36.717+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:36.931 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:36.920+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:36.978 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:36.973+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:37.118 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:37.112+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:37.157 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:37.151+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:37.676 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:37.668+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:37.717 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:37.713+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:37.742 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:37.736+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:37.743 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:37.739+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:37.970 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:37.963+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:37.994 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:37.990+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:38.127 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:38.120+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:38.139 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:38.133+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:38.673 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:38.669+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:38.705 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:38.700+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:38.751 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:38.744+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:38.752 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:38.747+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:38.943 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:38.937+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:38.989 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:38.985+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:39.162 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:39.149+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:39.189 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:39.182+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:39.459 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:23:39.455+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e541 v541) 2019-12-09T20:23:39.663 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:39.658+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:39.697 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:39.694+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:39.758 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:39.752+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:39.759 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:39.754+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:39.920 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:39.914+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:39.975 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:39.971+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:40.123 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:40.118+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:40.193 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:40.187+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:40.646 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:23:40.642+0000 1694f700 -1 osd.1 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.320777+0000 front 2019-12-09T20:22:20.319710+0000 (oldest deadline 2019-12-09T20:23:18.249513+0000) 2019-12-09T20:23:40.711 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:40.707+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:40.726 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:40.719+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:40.728 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:40.722+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:40.962 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:40.956+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:41.004 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:41.001+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:41.159 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:41.151+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:41.222 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:41.216+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:41.716 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:41.711+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:41.740 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:41.732+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:41.741 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:41.736+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:41.930 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:41.925+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:42.036 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:42.031+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:42.165 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:42.158+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:42.262 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:42.256+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:42.669 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:42.665+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:42.771 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:42.765+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:42.774 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:42.768+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:42.891 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:42.884+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:43.031 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:43.026+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:43.159 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:43.152+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:43.290 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:43.283+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:43.693 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:43.688+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:43.792 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:43.785+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:43.793 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:43.788+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:43.864 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:43.858+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:44.010 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:43.999+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:44.139 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:44.133+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:44.321 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:44.315+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:44.479 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:23:44.473+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e541 v541) 2019-12-09T20:23:44.698 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:44.692+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:44.763 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:44.757+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:44.763 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:44.759+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:44.824 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:44.819+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:44.981 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:44.978+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:45.118 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:45.114+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:45.280 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:45.274+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:45.740 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:45.736+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:45.780 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:45.775+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:45.786 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:45.782+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:45.790 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:45.785+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:45.979 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:45.973+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:46.092 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:46.086+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:46.317 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:46.301+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:46.698 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:46.693+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:46.760 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:46.753+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:46.820 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:46.813+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:46.821 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:46.816+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:46.957 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:46.953+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:47.073 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:47.066+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:47.292 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:47.282+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:47.725 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:47.711+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:47.726 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:47.720+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:47.778 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:47.770+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:47.779 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:47.774+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:47.917 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:47.910+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:48.072 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:48.066+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:48.275 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:48.266+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:48.709 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:48.704+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:48.712 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:48.706+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:48.823 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:48.815+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:48.824 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:48.819+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:48.960 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:48.955+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:49.109 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:49.103+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:49.260 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:49.253+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:49.496 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:23:49.490+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e541 v541) 2019-12-09T20:23:49.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:49.672+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:49.712 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:49.705+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:49.795 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:49.788+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:49.796 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:49.791+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:49.955 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:49.951+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:50.139 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:50.133+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:50.221 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:50.214+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:50.685 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:50.680+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:50.692 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:50.685+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:50.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:50.841+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:50.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:50.844+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:50.990 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:50.986+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:51.168 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:51.158+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:51.187 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:51.179+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:51.683 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:51.675+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:51.695 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:51.690+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:51.882 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:51.876+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:51.885 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:51.881+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:52.013 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:52.008+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:52.119 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:52.112+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:52.192 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:52.185+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:52.699 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:52.693+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:52.728 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:52.723+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:52.879 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:52.873+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:52.881 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:52.876+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:52.996 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:52.992+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:53.161 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:53.154+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:53.169 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:53.163+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:53.736 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:23:53.730+0000 1694f700 -1 osd.5 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.056788+0000 front 2019-12-09T20:22:20.057580+0000 (oldest deadline 2019-12-09T20:23:03.152246+0000) 2019-12-09T20:23:53.736 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:53.732+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:53.854 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:53.849+0000 1694f700 -1 osd.6 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:22:36.558829+0000 (oldest deadline 2019-12-09T20:23:16.558829+0000) 2019-12-09T20:23:53.858 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:53.854+0000 1694f700 -1 osd.6 541 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:54.040 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:23:54.035+0000 1694f700 -1 osd.3 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:15.699440+0000 front 2019-12-09T20:22:15.725592+0000 (oldest deadline 2019-12-09T20:23:01.572727+0000) 2019-12-09T20:23:54.142 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:23:54.138+0000 1694f700 -1 osd.7 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:20.526059+0000 front 2019-12-09T20:22:20.570375+0000 (oldest deadline 2019-12-09T20:23:02.206852+0000) 2019-12-09T20:23:54.211 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:23:54.205+0000 1694f700 -1 osd.4 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:19.545890+0000 front 2019-12-09T20:22:19.579143+0000 (oldest deadline 2019-12-09T20:23:02.204308+0000) 2019-12-09T20:23:54.587 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:23:54.575+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e541 v541) 2019-12-09T20:23:54.779 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:23:54.774+0000 1694f700 -1 osd.2 541 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:22:18.597560+0000 front 2019-12-09T20:22:18.392390+0000 (oldest deadline 2019-12-09T20:23:01.657399+0000) 2019-12-09T20:23:55.004 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:54.996+0000 1694f700 -1 osd.6 542 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e539) 2019-12-09T20:23:55.364 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:23:55.354+0000 38f95700 -1 osd.6 542 build_incremental_map_msg missing incremental map 540 2019-12-09T20:24:22.315 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:24:22.259+0000 36790700 -1 osd.0 547 build_incremental_map_msg missing incremental map 547 2019-12-09T20:24:22.353 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:24:22.262+0000 114ae700 -1 osd.0 547 build_incremental_map_msg missing incremental map 547 2019-12-09T20:24:22.359 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:24:22.276+0000 31786700 -1 osd.0 547 build_incremental_map_msg missing incremental map 547 2019-12-09T20:24:22.416 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:24:22.319+0000 31786700 -1 osd.0 547 build_incremental_map_msg missing incremental map 547 2019-12-09T20:24:22.427 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:24:22.388+0000 36790700 -1 osd.0 547 build_incremental_map_msg missing incremental map 547 2019-12-09T20:24:22.516 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:24:22.411+0000 3578e700 -1 osd.0 547 build_incremental_map_msg missing incremental map 547 2019-12-09T20:24:22.597 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:24:22.415+0000 31786700 -1 osd.0 547 build_incremental_map_msg missing incremental map 547 2019-12-09T20:24:22.633 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:24:22.463+0000 32f89700 -1 osd.0 547 build_incremental_map_msg missing incremental map 547 2019-12-09T20:24:24.432 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:24:24.289+0000 32f89700 -1 osd.0 547 build_incremental_map_msg missing incremental map 547 2019-12-09T20:25:03.588 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:19:24.647 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:25:03.601 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:19:24.659 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:25:03.617 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:19:24.651 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:25:03.619 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:19:24.677 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:25:03.622 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:19:24.657 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:25:03.624 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:19:24.682 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:25:03.788 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:19:24.847 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:25:03.803 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:19:24.836 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:25:03.893 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:19:24.952 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:25:20.090 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:20.083+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:20.285 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:20.276+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:20.574 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:20.569+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:21.074 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:21.069+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:21.234 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:21.231+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:21.549 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:21.543+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:22.116 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:22.112+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:22.118 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:22.113+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:22.274 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:22.269+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:22.274 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:22.269+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:22.497 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:22.492+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:22.522 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:22.517+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:23.078 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:23.074+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:23.135 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:23.130+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:23.280 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:23.276+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:23.298 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:23.293+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:23.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:23.450+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:23.539 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:23.534+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:24.087 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:24.082+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:24.101 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:24.096+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:24.278 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:24.272+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:24.282 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:24.276+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:24.419 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:24.414+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:24.440 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:24.435+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:24.540 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:24.531+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:25.050 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:25.045+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:25.115 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:25.110+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:25.263 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:25.258+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:25.332 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:25.327+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:25.382 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:25.377+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:25.459 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:25.445+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:25.547 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:25.543+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:26.077 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:26.073+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:26.155 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:26.150+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:26.261 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:26.256+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:26.291 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:26.285+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:26.364 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:26.360+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:26.436 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:26.431+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:26.564 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:26.559+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:27.127 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:27.123+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:27.187 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:27.182+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:27.278 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:27.268+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:27.288 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:27.283+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:27.343 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:27.339+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:27.430 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:27.425+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:27.608 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:27.603+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:28.110 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:28.105+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:28.181 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:28.175+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:28.248 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:28.243+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:28.270 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:28.265+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:28.378 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:28.373+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:28.403 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:28.398+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:28.657 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:28.652+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:29.086 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:29.081+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:29.134 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:29.129+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:29.212 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:29.207+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:29.301 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:29.295+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:29.401 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:29.396+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:29.440 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:29.435+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:29.687 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:29.683+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:30.090 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:30.086+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:30.103 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:30.090+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:30.223 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:30.218+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:30.329 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:30.321+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:30.357 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:30.353+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:30.433 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:30.428+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:30.642 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:30.638+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:31.066 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:31.061+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:31.096 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:31.091+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:31.192 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:31.187+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:31.380 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:31.374+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:31.395 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:31.390+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:31.435 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:31.430+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:31.643 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:31.639+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:32.040 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:32.034+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:32.148 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:32.143+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:32.214 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:32.209+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:32.366 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:32.361+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:32.424 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:32.416+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:32.474 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:32.468+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:32.623 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:32.618+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:33.044 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:33.037+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:33.154 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:33.149+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:33.176 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:33.171+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:33.402 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:33.398+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:33.428 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:33.421+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:33.453 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:33.448+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:33.647 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:33.643+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:34.084 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:34.079+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:34.158 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:34.153+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:34.182 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:34.177+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:34.365 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:34.359+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:34.445 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:34.439+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:34.457 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:34.452+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:34.617 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:34.611+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:35.130 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:35.126+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:35.137 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:35.127+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:35.211 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:35.206+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:35.331 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:35.326+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:35.476 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:35.471+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:35.493 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:35.489+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:35.599 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:35.594+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:36.093 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:36.079+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:36.149 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:36.144+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:36.242 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:36.237+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:36.332 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:36.328+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:36.478 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:36.473+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:36.483 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:36.478+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:36.643 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:36.638+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:37.048 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:37.041+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:37.106 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:37.102+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:37.266 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:37.261+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:37.381 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:37.376+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:37.447 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:37.443+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:37.505 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:37.500+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:37.640 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:37.635+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:38.059 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:38.054+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:38.063 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:38.058+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:38.237 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:38.232+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:38.416 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:38.411+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:38.430 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:38.425+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:38.500 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:38.491+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:38.602 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:38.598+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:39.080 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:39.075+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:39.103 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:39.098+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:39.282 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:39.277+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:39.413 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:39.408+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:39.470 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:39.466+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:39.487 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:39.482+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:39.615 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:39.610+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:40.123 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:40.118+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:40.124 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:40.119+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:40.312 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:40.304+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:40.386 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:40.381+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:40.453 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:40.448+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:40.525 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:40.521+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:40.634 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:40.630+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:41.149 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:41.144+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:41.151 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:41.147+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:41.323 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:41.318+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:41.346 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:41.342+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:41.429 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:41.424+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:41.539 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:41.535+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:41.591 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:41.587+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:42.138 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:42.133+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:42.172 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:42.167+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:42.340 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:42.335+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:42.396 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:42.389+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:42.423 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:42.418+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:42.548 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:42.542+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:42.583 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:42.575+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:43.147 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:43.134+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:43.185 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:43.171+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:43.359 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:43.355+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:43.402 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:43.397+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:43.452 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:43.447+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:43.534 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:43.529+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:43.618 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:43.614+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:44.145 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:44.140+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:44.222 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:44.218+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:44.328 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:44.323+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:44.436 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:44.430+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:44.464 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:44.454+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:44.580 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:44.575+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:44.647 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:44.642+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:45.161 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:45.156+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:45.217 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:45.211+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:45.291 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:45.286+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:45.397 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:45.392+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:45.473 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:45.469+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:45.580 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:45.575+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:45.636 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:45.631+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:46.132 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:46.128+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:46.207 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:46.201+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:46.284 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:46.279+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:46.384 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:46.380+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:46.515 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:46.510+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:46.535 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:46.530+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:46.648 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:46.643+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:47.170 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:47.166+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:47.233 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:47.228+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:47.245 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:47.241+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:47.367 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:47.362+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:47.530 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:47.524+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:47.566 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:47.561+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:47.650 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:47.645+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:48.154 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:48.148+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:48.196 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:48.191+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:48.293 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:48.290+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:48.421 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:48.412+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:48.510 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:48.505+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:48.599 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:48.594+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:48.632 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:48.627+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:49.174 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:49.170+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:49.185 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:49.180+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:49.304 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:49.299+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:49.430 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:49.426+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:49.517 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:49.513+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:49.619 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:49.614+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:49.667 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:49.663+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:50.132 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:50.129+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:50.218 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:50.213+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:50.329 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:50.326+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:50.474 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:50.470+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:50.512 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:50.508+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:50.572 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:50.568+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:50.680 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:50.675+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:51.122 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:51.119+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:51.229 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:51.223+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:51.313 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:51.309+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:51.465 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:51.461+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:51.493 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:51.489+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:51.573 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:51.568+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:51.730 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:51.725+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:52.148 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:52.145+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:52.235 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:52.230+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:52.271 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:52.267+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:52.470 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:52.466+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:52.519 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:52.516+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:52.553 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:52.548+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:52.768 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:52.764+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:53.129 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:53.126+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:53.255 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:53.250+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:53.311 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:53.306+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:53.430 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:53.427+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:53.516 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:53.513+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:53.599 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:53.593+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:53.742 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:53.738+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:54.089 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:54.085+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:54.217 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:54.205+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:54.290 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:54.286+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:54.433 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:54.429+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:54.565 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:54.561+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:54.609 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:54.605+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:54.709 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:54.705+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:55.047 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:25:55.043+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e547 v547) 2019-12-09T20:25:55.129 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:55.125+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:55.249 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:55.237+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:55.271 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:55.266+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:55.472 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:55.468+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:55.552 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:55.547+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:55.634 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:55.629+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:55.694 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:55.690+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:56.101 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:56.098+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:56.244 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:56.241+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:56.274 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:56.269+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:56.430 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:56.425+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:56.598 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:56.594+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:56.601 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:56.596+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:56.705 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:56.696+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:57.096 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:57.092+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:57.203 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:57.199+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:57.315 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:57.310+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:57.382 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:57.379+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:57.558 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:57.555+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:57.584 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:57.580+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:57.721 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:57.717+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:58.093 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:58.089+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:58.246 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:58.241+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:58.333 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:58.328+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:58.399 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:58.395+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:58.533 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:58.528+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:58.620 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:58.615+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:58.746 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:58.742+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:25:59.092 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:25:59.088+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:25:59.233 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:25:59.229+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:25:59.321 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:25:59.317+0000 1694f700 -1 osd.5 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.915609+0000 front 2019-12-09T20:24:38.340488+0000 (oldest deadline 2019-12-09T20:25:21.841975+0000) 2019-12-09T20:25:59.442 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:25:59.438+0000 1694f700 -1 osd.0 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.743339+0000 front 2019-12-09T20:24:37.548055+0000 (oldest deadline 2019-12-09T20:25:22.174378+0000) 2019-12-09T20:25:59.565 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:25:59.561+0000 1694f700 -1 osd.3 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:39.504256+0000 front 2019-12-09T20:24:39.499763+0000 (oldest deadline 2019-12-09T20:25:23.983784+0000) 2019-12-09T20:25:59.633 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:25:59.629+0000 1694f700 -1 osd.4 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:41.294414+0000 front 2019-12-09T20:24:41.291744+0000 (oldest deadline 2019-12-09T20:25:19.999476+0000) 2019-12-09T20:25:59.767 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:25:59.762+0000 1694f700 -1 osd.7 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.974866+0000 front 2019-12-09T20:24:41.295078+0000 (oldest deadline 2019-12-09T20:25:22.042876+0000) 2019-12-09T20:26:00.120 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:26:00.112+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e547 v547) 2019-12-09T20:26:00.126 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:26:00.122+0000 1694f700 -1 osd.2 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:40.113006+0000 front 2019-12-09T20:24:41.311465+0000 (oldest deadline 2019-12-09T20:25:20.026267+0000) 2019-12-09T20:26:00.187 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:26:00.183+0000 1694f700 -1 osd.1 547 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:24:37.754371+0000 front 2019-12-09T20:24:41.309772+0000 (oldest deadline 2019-12-09T20:25:19.674894+0000) 2019-12-09T20:26:37.137 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:26:37.043+0000 36790700 -1 osd.6 552 build_incremental_map_msg missing incremental map 552 2019-12-09T20:26:37.315 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:26:37.235+0000 3378a700 -1 osd.6 552 build_incremental_map_msg missing incremental map 552 2019-12-09T20:26:37.367 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:26:37.244+0000 3378a700 -1 osd.6 552 build_incremental_map_msg missing incremental map 552 2019-12-09T20:26:58.649 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:26:58.645+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:26:58.710 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:26:58.703+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:26:59.139 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:26:59.133+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:26:59.155 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:26:59.149+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:26:59.187 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:26:59.182+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:26:59.546 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:26:59.540+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:26:59.622 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:26:59.618+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:26:59.699 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:26:59.694+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:00.117 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:00.110+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:00.192 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:00.187+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:00.226 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:00.220+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:00.523 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:00.516+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:00.673 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:00.669+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:00.692 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:00.688+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:01.165 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:01.158+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:01.168 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:01.161+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:01.281 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:01.271+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:01.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:01.555+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:01.661 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:01.657+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:01.683 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:01.678+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:02.186 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:02.180+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:02.217 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:02.211+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:02.319 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:02.316+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:02.612 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:02.607+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:02.665 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:02.661+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:02.728 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:02.723+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:03.178 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:03.169+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:03.197 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:03.190+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:03.368 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:03.365+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:03.587 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:03.582+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:03.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:03.673+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:03.722 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:03.718+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:04.138 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:04.129+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:04.164 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:04.157+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:04.361 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:04.356+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:04.546 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:04.537+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:04.648 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:04.643+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:04.710 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:04.705+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:05.170 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:05.164+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:05.185 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:05.178+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:05.356 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:05.352+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:05.536 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:05.531+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:05.613 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:05.607+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:05.704 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:05.695+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:06.178 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:06.171+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:06.213 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:06.207+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:06.405 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:06.401+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:06.540 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:06.535+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:06.663 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:06.657+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:06.668 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:06.663+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:06.869 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:06.856+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:07.187 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:07.180+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:07.195 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:07.189+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:07.388 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:07.383+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:07.569 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:07.563+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:07.633 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:07.628+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:07.649 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:07.646+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:07.851 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:07.836+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:08.148 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:08.142+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:08.231 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:08.224+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:08.346 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:08.342+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:08.608 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:08.603+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:08.625 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:08.620+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:08.685 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:08.680+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:08.840 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:08.836+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:09.125 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:09.119+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:09.259 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:09.253+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:09.392 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:09.389+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:09.589 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:09.585+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:09.627 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:09.622+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:09.731 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:09.726+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:09.891 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:09.886+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:10.113 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:10.106+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:10.294 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:10.288+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:10.433 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:10.428+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:10.572 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:10.567+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:10.617 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:10.610+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:10.754 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:10.749+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:10.924 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:10.920+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:11.133 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:11.127+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:11.287 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:11.279+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:11.398 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:11.392+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:11.542 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:11.537+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:11.609 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:11.603+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:11.787 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:11.783+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:11.976 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:11.970+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:12.126 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:12.120+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:12.312 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:12.305+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:12.402 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:12.397+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:12.564 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:12.559+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:12.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:12.620+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:12.809 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:12.803+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:12.969 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:12.965+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:13.122 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:13.103+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:13.311 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:13.304+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:13.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:13.420+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:13.578 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:13.574+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:13.640 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:13.635+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:13.844 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:13.840+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:14.003 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:13.997+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:14.007 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:14.003+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:14.146 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:14.139+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:14.270 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:14.265+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:14.421 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:14.416+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:14.565 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:14.561+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:14.658 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:14.651+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:14.863 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:14.858+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:15.000 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:14.992+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:15.004 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:14.999+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:15.101 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:15.094+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:15.305 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:15.298+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:15.421 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:15.417+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:15.548 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:15.544+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:15.613 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:15.606+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:15.858 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:15.853+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:16.037 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:16.030+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:16.038 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:16.033+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:16.062 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:16.056+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:16.357 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:16.350+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:16.376 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:16.372+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:16.562 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:16.558+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:16.660 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:16.654+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:16.909 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:16.905+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:17.043 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:17.036+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:17.044 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:17.039+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:17.086 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:17.080+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:17.347 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:17.341+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:17.360 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:17.357+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:17.609 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:17.604+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:17.713 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:17.706+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:17.954 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:17.951+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:18.065 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:18.059+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:18.069 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:18.062+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:18.091 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:18.079+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:18.368 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:18.362+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:18.389 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:18.384+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:18.572 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:18.568+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:18.718 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:18.711+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:18.974 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:18.968+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:19.083 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:19.077+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:19.084 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:19.080+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:19.118 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:19.112+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:19.356 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:19.350+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:19.369 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:19.364+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:19.549 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:19.546+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:19.746 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:19.739+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:19.938 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:19.934+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:20.081 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:20.074+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:20.135 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:20.113+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:20.135 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:20.118+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:20.352 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:20.348+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:20.372 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:20.367+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:20.578 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:20.571+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:20.723 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:20.718+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:20.921 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:20.916+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:21.096 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:21.089+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:21.131 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:21.124+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:21.132 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:21.127+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:21.400 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:21.396+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:21.406 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:21.399+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:21.583 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:21.578+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:21.748 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:21.742+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:21.956 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:21.952+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:22.121 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:22.115+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:22.149 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:22.141+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:22.149 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:22.145+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:22.431 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:22.427+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:22.450 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:22.444+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:22.627 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:22.623+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:22.734 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:22.728+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:22.958 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:22.954+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:23.104 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:23.098+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:23.125 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:23.118+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:23.126 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:23.121+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:23.438 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:23.431+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:23.449 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:23.445+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:23.605 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:23.601+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:23.782 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:23.776+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:23.957 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:23.952+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:24.129 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:24.124+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:24.133 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:24.129+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:24.154 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:24.148+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:24.394 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:24.387+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:24.485 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:24.481+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:24.606 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:24.600+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:24.748 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:24.735+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:25.010 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:25.001+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:25.099 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:25.093+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:25.107 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:25.103+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:25.210 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:25.204+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:25.424 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:25.417+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:25.493 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:25.488+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:25.611 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:25.608+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:25.758 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:25.750+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:25.988 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:25.983+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:26.075 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:26.069+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:26.086 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:26.079+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:26.252 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:26.247+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:26.389 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:26.383+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:26.530 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:26.526+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:26.568 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:26.563+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:26.768 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:26.762+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:27.030 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:27.025+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:27.058 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:27.052+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:27.061 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:27.057+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:27.273 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:27.267+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:27.391 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:27.384+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:27.514 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:27.510+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:27.577 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:27.571+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:27.751 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:27.746+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:28.058 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:28.053+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:28.063 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:28.054+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:28.065 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:28.058+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:28.279 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:28.272+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:28.387 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:28.381+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:28.535 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:28.530+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:28.593 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:28.583+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:28.784 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:28.778+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:29.088 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:29.084+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:29.109 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:29.104+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:29.112 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:29.108+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:29.294 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:29.288+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:29.371 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:29.365+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:29.501 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:29.497+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:29.582 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:29.578+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:29.766 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:29.760+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:30.088 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:30.083+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:30.130 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:30.117+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:30.130 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:30.121+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:30.297 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:30.278+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:30.335 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:30.329+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:30.345 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:27:30.340+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e553 v553) 2019-12-09T20:27:30.528 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:30.524+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:30.560 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:30.556+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:30.749 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:30.743+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:31.088 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:31.083+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:31.147 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:31.141+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:31.151 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:31.146+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:31.327 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:31.320+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:31.367 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:31.361+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:31.510 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:31.506+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:31.563 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:31.560+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:31.752 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:31.747+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:32.086 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:32.081+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:32.177 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:32.168+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:32.178 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:32.172+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:32.348 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:32.341+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:32.400 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:32.394+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:32.543 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:32.538+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:32.600 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:32.595+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:32.798 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:32.792+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:33.145 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:33.136+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:33.212 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:33.202+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:33.212 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:33.207+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:33.325 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:33.318+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:33.363 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:33.357+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:33.552 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:33.544+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:33.604 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:33.599+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:33.853 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:33.847+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:34.114 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:34.108+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:34.252 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:34.245+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:34.253 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:34.249+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:34.312 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:34.305+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:34.409 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:34.404+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:34.559 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:34.554+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:34.629 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:34.625+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:34.901 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:34.890+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:35.145 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:35.141+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:35.294 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:35.288+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:35.298 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:35.294+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:35.345 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:35.339+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:35.362 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:27:35.355+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e553 v553) 2019-12-09T20:27:35.444 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:35.438+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:35.604 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:35.599+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:35.643 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:35.638+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:35.892 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:35.887+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:36.149 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:36.143+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:36.288 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:36.281+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:36.289 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:36.284+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:36.369 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:36.360+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:36.481 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:36.473+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:36.618 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:36.613+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:36.619 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:36.615+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:36.939 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:36.933+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:37.162 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:37.155+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:37.245 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:37.238+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:37.249 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:37.245+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:37.322 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:37.316+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:37.522 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:37.515+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:37.589 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:37.585+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:37.628 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:37.622+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:37.943 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:37.937+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:38.205 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:38.200+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:38.214 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:38.209+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:38.215 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:38.211+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:38.373 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:38.367+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:38.571 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:38.565+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:38.609 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:38.603+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:38.623 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:38.618+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:38.978 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:38.972+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:39.215 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:39.208+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:39.239 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:39.231+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:39.240 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:39.234+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:39.374 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:39.365+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:39.533 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:39.526+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:39.568 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:39.563+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:39.636 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:39.631+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:39.966 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:39.960+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:40.240 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:40.235+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:40.288 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:40.279+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:40.288 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:40.282+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:40.375 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:40.369+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:40.511 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:27:40.506+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e553 v553) 2019-12-09T20:27:40.530 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:22:01.588 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:40.536 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:40.531+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:40.561 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:40.555+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:40.568 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:22:01.626 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:40.572 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:22:01.631 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:40.575 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:22:01.634 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:40.614 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:22:01.649 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:40.628 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:22:01.662 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:40.678 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:40.672+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:40.707 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:22:01.766 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:40.721 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:22:01.779 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:40.799 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:22:01.834 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:40.954 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:40.949+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:41.243 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:41.236+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:41.313 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:41.308+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:41.315 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:41.310+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:41.401 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:41.394+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:41.502 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:41.490+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:41.551 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:41.545+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:41.699 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:41.694+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:41.945 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:41.939+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:42.237 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:42.232+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:42.358 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:42.347+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:42.358 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:42.349+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:42.435 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:42.429+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:42.519 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:42.514+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:42.539 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:42.533+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:42.732 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:42.727+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:42.913 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:42.907+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:43.261 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:43.254+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:43.368 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:43.361+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:43.370 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:43.365+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:43.482 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:43.476+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:43.493 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:43.489+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:43.547 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:43.541+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:43.720 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:43.715+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:43.907 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:43.902+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:44.215 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:44.209+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:44.352 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:44.346+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:44.357 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:44.352+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:44.500 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:44.494+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:44.519 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:44.509+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:44.576 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:44.570+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:44.742 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:27:44.737+0000 1694f700 -1 osd.3 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:15.044430+0000 front 2019-12-09T20:26:15.064011+0000 (oldest deadline 2019-12-09T20:26:58.492514+0000) 2019-12-09T20:27:44.894 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:27:44.889+0000 1694f700 -1 osd.5 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.051617+0000 front 2019-12-09T20:26:16.053053+0000 (oldest deadline 2019-12-09T20:26:59.320611+0000) 2019-12-09T20:27:45.220 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:27:45.215+0000 1694f700 -1 osd.1 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:16.842965+0000 front 2019-12-09T20:26:17.480200+0000 (oldest deadline 2019-12-09T20:26:58.282548+0000) 2019-12-09T20:27:45.367 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:45.360+0000 1694f700 -1 osd.6 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:26:33.066933+0000 (oldest deadline 2019-12-09T20:27:13.066933+0000) 2019-12-09T20:27:45.368 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:45.364+0000 1694f700 -1 osd.6 553 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e551) 2019-12-09T20:27:45.500 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:27:45.494+0000 1694f700 -1 osd.2 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:12.901547+0000 front 2019-12-09T20:26:12.879400+0000 (oldest deadline 2019-12-09T20:26:58.158314+0000) 2019-12-09T20:27:45.520 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:27:45.514+0000 1694f700 -1 osd.7 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:17.068810+0000 front 2019-12-09T20:26:17.069885+0000 (oldest deadline 2019-12-09T20:26:58.130872+0000) 2019-12-09T20:27:45.549 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:27:45.543+0000 1694f700 -1 osd.4 553 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:26:14.650039+0000 front 2019-12-09T20:26:14.691586+0000 (oldest deadline 2019-12-09T20:26:58.628253+0000) 2019-12-09T20:27:45.564 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:27:45.555+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e553 v553) 2019-12-09T20:27:46.555 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:27:46.544+0000 38f95700 -1 osd.6 554 build_incremental_map_msg missing incremental map 552 2019-12-09T20:29:07.787 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:23:28.844 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:29:07.799 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:23:28.857 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:29:07.803 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:23:28.862 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:29:07.808 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:23:28.842 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:29:07.809 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:23:28.868 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:29:07.820 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:23:28.854 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:29:07.901 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:23:28.959 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:29:07.939 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:23:28.998 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:29:07.959 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:23:28.993 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:29:16.752 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:16.747+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:17.148 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:17.144+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:17.721 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:17.704+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:18.190 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:18.186+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:18.264 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:18.259+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:18.755 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:18.748+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:19.231 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:19.227+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:19.284 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:19.279+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:19.761 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:19.749+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:20.234 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:20.225+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:20.270 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:20.265+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:20.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:20.477+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:20.769 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:20.763+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:21.208 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:21.203+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:21.236 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:21.233+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:21.256 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:21.250+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:21.497 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:21.493+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:21.693 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:21.685+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:21.807 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:21.803+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:21.986 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:21.981+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:22.220 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:22.215+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:22.254 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:22.251+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:22.284 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:22.280+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:22.502 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:22.498+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:22.740 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:22.736+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:22.831 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:22.826+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:23.033 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:23.029+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:23.233 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:23.227+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:23.239 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:23.235+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:23.320 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:23.316+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:23.464 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:23.460+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:23.720 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:23.700+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:23.884 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:23.871+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:24.015 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:24.011+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:24.239 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:24.234+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:24.272 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:24.267+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:24.274 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:24.271+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:24.487 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:24.481+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:24.761 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:24.754+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:24.909 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:24.905+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:24.995 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:24.988+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:25.232 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:25.227+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:25.278 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:25.274+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:25.296 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:25.278+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:25.443 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:25.438+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:25.723 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:25.719+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:25.960 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:25.954+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:25.969 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:25.962+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:26.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:26.201+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:26.241 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:26.238+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:26.273 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:26.266+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:26.491 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:26.486+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:26.780 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:26.774+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:26.951 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:26.946+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:26.988 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:26.984+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:27.204 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:27.199+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:27.219 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:27.213+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:27.237 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:27.233+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:27.481 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:27.477+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:27.758 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:27.754+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:27.923 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:27.918+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:27.999 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:27.995+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:28.204 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:28.201+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:28.220 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:28.215+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:28.242 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:28.237+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:28.489 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:28.485+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:28.733 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:28.729+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:28.907 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:28.902+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:29.007 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:29.003+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:29.225 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:29.221+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:29.228 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:29.224+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:29.243 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:29.232+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:29.497 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:29.493+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:29.694 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:29.689+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:29.894 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:29.889+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:30.021 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:30.015+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:30.197 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:30.189+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:30.197 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:30.188+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:30.213 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:30.208+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:30.478 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:30.474+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:30.686 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:30.682+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:30.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:30.920+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:31.056 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:31.052+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:31.184 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:31.178+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:31.187 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:31.184+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:31.197 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:31.189+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:31.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:31.478+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:31.679 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:31.675+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:31.951 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:31.947+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:32.026 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:32.016+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:32.148 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:32.145+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:32.166 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:32.161+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:32.209 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:32.205+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:32.468 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:32.464+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:32.634 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:32.631+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:32.940 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:32.934+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:33.003 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:32.992+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:33.138 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:33.135+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:33.140 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:33.135+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:33.254 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:33.251+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:33.514 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:33.511+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:33.637 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:33.633+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:33.909 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:33.905+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:33.975 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:33.971+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:34.140 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:34.136+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:34.154 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:34.146+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:34.239 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:34.235+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:34.471 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:34.468+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:34.634 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:34.629+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:34.881 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:34.876+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:35.025 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:35.020+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:35.154 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:35.149+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:35.192 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:35.188+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:35.272 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:35.268+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:35.516 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:35.509+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:35.606 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:35.599+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:35.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:35.921+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:36.029 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:36.024+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:36.163 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:36.159+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:36.192 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:36.187+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:36.261 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:36.257+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:36.561 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:36.557+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:36.578 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:36.573+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:36.939 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:36.931+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:36.989 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:36.979+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:37.151 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:37.146+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:37.163 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:37.159+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:37.223 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:37.218+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:37.585 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:37.581+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:37.588 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:37.584+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:37.893 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:37.889+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:37.973 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:37.969+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:38.159 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:38.154+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:38.174 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:38.169+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:38.250 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:38.247+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:38.597 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:38.593+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:38.617 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:38.612+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:38.899 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:38.893+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:38.993 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:38.988+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:39.155 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:39.151+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:39.158 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:39.154+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:39.260 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:39.257+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:39.597 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:39.594+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:39.624 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:39.617+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:39.861 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:39.856+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:39.956 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:39.951+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:40.143 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:40.110+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:40.184 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:40.175+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:40.309 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:40.304+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:40.604 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:40.599+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:40.629 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:40.625+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:40.894 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:40.889+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:40.958 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:40.953+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:41.142 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:41.138+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:41.176 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:41.172+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:41.345 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:41.340+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:41.601 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:41.594+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:41.646 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:41.640+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:41.914 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:41.909+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:41.927 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:41.923+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:42.157 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:42.152+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:42.185 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:42.177+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:42.335 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:42.331+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:42.636 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:42.631+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:42.679 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:42.675+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:42.906 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:42.902+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:42.919 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:42.915+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:43.180 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:43.175+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:43.187 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:43.181+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:43.343 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:43.338+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:43.616 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:43.611+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:43.642 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:43.638+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:43.910 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:43.903+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:43.917 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:43.911+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:44.149 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:44.145+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:44.186 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:44.181+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:44.331 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:44.325+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:44.664 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:44.658+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:44.685 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:44.675+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:44.898 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:44.894+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:44.935 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:44.931+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:45.170 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:45.164+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:45.188 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:45.183+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:45.297 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:45.290+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:45.654 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:45.650+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:45.695 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:45.691+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:45.950 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:45.945+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:45.984 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:45.980+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:46.203 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:46.197+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:46.232 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:46.226+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:46.326 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:46.321+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:46.631 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:46.626+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:46.655 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:46.651+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:46.951 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:46.945+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:46.953 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:46.949+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:47.202 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:47.195+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:47.225 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:47.220+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:47.304 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:47.299+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:47.626 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:47.620+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:47.696 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:47.692+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:47.922 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:47.916+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:47.939 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:47.934+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:48.247 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:48.243+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:48.266 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:48.261+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:48.336 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:48.331+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:48.593 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:48.587+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:48.724 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:48.720+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:48.955 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:48.951+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:48.981 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:48.977+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:49.258 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:49.253+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:49.291 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:49.286+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:49.358 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:49.352+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:49.619 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:49.614+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:49.691 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:49.688+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:49.919 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:49.913+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:49.953 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:49.949+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:50.273 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:50.268+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:50.298 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:50.293+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:50.328 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:50.323+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:50.619 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:50.613+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:50.675 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:50.670+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:50.905 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:50.900+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:50.920 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:50.915+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:50.997 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:29:50.980+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e558 v558) 2019-12-09T20:29:51.304 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:51.299+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:51.350 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:51.344+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:51.352 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:51.347+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:51.583 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:51.579+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:51.654 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:51.649+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:51.928 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:51.923+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:51.948 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:51.944+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:52.324 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:52.321+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:52.327 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:52.323+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:52.361 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:52.357+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:52.550 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:52.546+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:52.669 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:52.664+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:52.919 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:52.914+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:52.944 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:52.939+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:53.318 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:53.313+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:53.347 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:53.342+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:53.387 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:53.382+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:53.525 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:53.521+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:53.663 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:53.655+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:53.960 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:53.955+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:53.968 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:53.964+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:54.337 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:54.323+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:54.373 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:54.368+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:54.374 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:54.368+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:54.485 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:54.477+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:54.647 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:54.643+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:54.965 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:54.960+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:55.011 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:55.006+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:55.343 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:29:55.338+0000 1694f700 -1 osd.2 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.326870+0000 front 2019-12-09T20:28:36.327746+0000 (oldest deadline 2019-12-09T20:29:20.850367+0000) 2019-12-09T20:29:55.361 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:29:55.356+0000 1694f700 -1 osd.5 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.662691+0000 front 2019-12-09T20:28:33.532948+0000 (oldest deadline 2019-12-09T20:29:17.967774+0000) 2019-12-09T20:29:55.362 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:29:55.357+0000 1694f700 -1 osd.1 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:33.143597+0000 front 2019-12-09T20:28:36.793673+0000 (oldest deadline 2019-12-09T20:29:16.615385+0000) 2019-12-09T20:29:55.467 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:29:55.460+0000 1694f700 -1 osd.0 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.572535+0000 front 2019-12-09T20:28:35.600156+0000 (oldest deadline 2019-12-09T20:29:21.043463+0000) 2019-12-09T20:29:55.653 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:29:55.643+0000 1694f700 -1 osd.3 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.563351+0000 front 2019-12-09T20:28:35.561691+0000 (oldest deadline 2019-12-09T20:29:20.133108+0000) 2019-12-09T20:29:55.942 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:29:55.937+0000 1694f700 -1 osd.4 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:36.038327+0000 front 2019-12-09T20:28:35.772867+0000 (oldest deadline 2019-12-09T20:29:21.556433+0000) 2019-12-09T20:29:56.028 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:29:56.023+0000 1694f700 -1 osd.7 558 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:28:35.097755+0000 front 2019-12-09T20:28:36.774786+0000 (oldest deadline 2019-12-09T20:29:16.491968+0000) 2019-12-09T20:29:56.050 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:29:56.044+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e558 v558) 2019-12-09T20:30:32.790 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:30:32.779+0000 3478c700 -1 osd.6 563 build_incremental_map_msg missing incremental map 563 2019-12-09T20:30:33.047 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:30:32.937+0000 38f95700 -1 osd.6 563 build_incremental_map_msg missing incremental map 563 2019-12-09T20:30:33.438 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:30:33.401+0000 34f8d700 -1 osd.6 563 build_incremental_map_msg missing incremental map 563 2019-12-09T20:30:55.376 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:30:55.369+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:30:55.580 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:30:55.575+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:30:55.908 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:30:55.902+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:30:56.402 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:30:56.396+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:30:56.541 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:30:56.534+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:30:56.839 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:30:56.833+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:30:56.877 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:30:56.871+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:30:56.935 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:30:56.929+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:30:57.369 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:30:57.362+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:30:57.586 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:30:57.581+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:30:57.856 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:30:57.849+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:30:57.868 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:30:57.864+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:30:57.963 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:30:57.958+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:30:58.388 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:30:58.376+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:30:58.620 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:30:58.614+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:30:58.876 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:30:58.872+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:30:58.881 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:30:58.875+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:30:58.998 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:30:58.993+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:30:59.398 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:30:59.392+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:30:59.630 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:30:59.625+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:30:59.659 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:30:59.653+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:30:59.904 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:30:59.899+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:30:59.916 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:30:59.910+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:00.059 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:00.050+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:00.408 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:00.402+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:00.641 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:00.636+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:00.696 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:00.686+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:00.878 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:00.872+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:00.891 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:00.887+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:01.088 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:01.082+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:01.457 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:01.452+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:01.595 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:01.590+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:01.689 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:01.683+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:01.896 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:01.890+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:01.935 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:01.930+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:02.124 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:02.117+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:02.465 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:02.459+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:02.635 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:02.631+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:02.684 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:02.677+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:02.901 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:02.895+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:02.942 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:02.936+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:03.169 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:03.164+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:03.461 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:03.455+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:03.612 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:03.606+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:03.680 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:03.674+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:03.872 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:03.867+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:03.920 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:03.914+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:04.203 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:04.197+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:04.302 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:04.297+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:04.514 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:04.507+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:04.648 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:04.639+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:04.731 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:04.726+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:04.853 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:04.848+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:04.960 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:04.952+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:05.219 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:05.214+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:05.292 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:05.289+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:05.472 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:05.466+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:05.698 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:05.692+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:05.730 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:05.724+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:05.835 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:05.829+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:06.015 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:06.010+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:06.203 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:06.197+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:06.273 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:06.269+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:06.469 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:06.463+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:06.721 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:06.714+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:06.733 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:06.729+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:06.846 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:06.840+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:07.025 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:07.020+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:07.199 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:07.194+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:07.325 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:07.321+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:07.515 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:07.510+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:07.714 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:07.709+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:07.731 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:07.721+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:07.820 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:07.815+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:08.056 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:08.050+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:08.166 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:08.160+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:08.366 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:08.362+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:08.516 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:08.511+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:08.688 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:08.682+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:08.720 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:08.714+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:08.820 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:08.814+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:09.108 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:09.102+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:09.167 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:09.161+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:09.393 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:09.387+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:09.397 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:09.393+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:09.531 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:09.526+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:09.658 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:09.653+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:09.710 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:09.704+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:09.794 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:09.789+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:10.077 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:10.072+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:10.199 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:10.193+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:10.373 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:10.356+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:10.374 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:10.363+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:10.585 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:10.580+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:10.634 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:10.630+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:10.710 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:10.705+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:10.789 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:10.785+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:11.054 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:11.048+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:11.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:11.200+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:11.340 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:11.330+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:11.343 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:11.338+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:11.552 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:11.547+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:11.595 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:11.589+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:11.755 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:11.748+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:11.775 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:11.770+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:12.079 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:12.072+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:12.180 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:12.175+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:12.402 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:12.382+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:12.447 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:12.387+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:12.604 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:12.600+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:12.617 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:12.613+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:12.711 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:12.704+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:12.779 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:12.774+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:13.037 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:13.032+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:13.178 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:13.171+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:13.376 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:13.369+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:13.378 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:13.373+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:13.620 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:13.615+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:13.643 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:13.638+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:13.705 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:13.700+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:13.790 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:13.786+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:14.030 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:14.023+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:14.188 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:14.182+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:14.356 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:14.351+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:14.360 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:14.356+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:14.587 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:14.582+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:14.650 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:14.646+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:14.730 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:14.725+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:14.839 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:14.835+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:15.079 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:15.073+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:15.166 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:15.160+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:15.354 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:15.347+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:15.354 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:15.350+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:15.569 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:15.564+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:15.663 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:15.660+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:15.725 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:15.720+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:15.822 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:15.818+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:16.049 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:16.043+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:16.168 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:16.162+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:16.401 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:16.395+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:16.402 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:16.398+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:16.590 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:16.587+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:16.618 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:16.614+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:16.780 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:16.774+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:16.870 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:16.866+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:17.092 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:17.086+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:17.144 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:17.138+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:17.450 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:17.436+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:17.450 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:17.442+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:17.589 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:17.585+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:17.591 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:17.586+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:17.821 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:17.814+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:17.835 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:17.831+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:18.097 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:18.085+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:18.171 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:18.165+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:18.497 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:18.490+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:18.499 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:18.494+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:18.562 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:18.557+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:18.633 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:18.624+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:18.855 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:18.849+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:18.885 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:18.880+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:19.123 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:19.116+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:19.127 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:19.120+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:19.503 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:19.496+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:19.504 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:19.500+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:19.577 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:19.569+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:19.646 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:19.642+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:19.830 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:19.824+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:19.923 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:19.918+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:20.085 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:20.079+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:20.116 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:20.110+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:20.545 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:20.537+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:20.556 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:20.550+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:20.560 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:20.556+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:20.614 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:20.609+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:20.822 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:20.804+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:20.918 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:20.914+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:21.113 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:21.102+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:21.126 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:21.120+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:21.533 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:21.528+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:21.592 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:21.586+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:21.595 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:21.592+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:21.646 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:21.642+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:21.850 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:21.845+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:21.909 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:21.905+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:22.086 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:22.080+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:22.125 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:22.118+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:22.574 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:22.564+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:22.624 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:22.618+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:22.624 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:22.621+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:22.625 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:22.621+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:22.846 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:22.841+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:22.865 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:22.861+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:23.062 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:23.056+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:23.152 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:23.146+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:23.616 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:23.612+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:23.633 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:23.627+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:23.636 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:23.630+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:23.659 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:23.652+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:23.829 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:23.824+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:23.870 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:23.865+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:24.064 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:24.059+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:24.123 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:24.118+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:24.595 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:24.589+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:24.596 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:24.592+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:24.650 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:24.645+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:24.666 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:24.661+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:24.829 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:24.823+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:24.911 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:24.906+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:25.112 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:25.106+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:25.169 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:25.162+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:25.612 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:25.607+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:25.614 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:25.607+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:25.614 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:25.610+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:25.667 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:25.662+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:25.822 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:25.805+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:25.922 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:25.918+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:26.069 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:26.064+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:26.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:26.129+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:26.634 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:26.629+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:26.638 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:26.634+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:26.655 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:26.649+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:26.668 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:26.661+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:26.801 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:26.795+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:26.892 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:26.887+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:27.070 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:27.064+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:27.115 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:27.109+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:27.625 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:27.622+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:27.655 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:27.648+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:27.656 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:27.651+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:27.675 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:27.671+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:27.785 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:27.778+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:27.935 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:27.931+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:28.042 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:28.036+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:28.144 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:28.138+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:28.643 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:28.638+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:28.644 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:28.637+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:28.645 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:28.641+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:28.681 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:28.674+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:28.787 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:28.781+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:28.955 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:28.951+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:29.025 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:29.019+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:29.158 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:29.151+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:29.623 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:29.618+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:29.692 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:29.687+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:29.696 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:29.692+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:29.703 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:29.699+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:29.795 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:29.789+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:29.964 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:29.961+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:30.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:30.055+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:30.123 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:30.109+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:30.645 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:30.638+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:30.706 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:30.700+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:30.707 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:30.703+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:30.744 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:30.740+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:30.804 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:30.798+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:30.942 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:30.938+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:31.055 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:31.049+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:31.155 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:31.149+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:31.315 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:31:31.310+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 48sec e564 v564) 2019-12-09T20:31:31.658 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:31.654+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:31.698 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:31.692+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:31.701 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:31.697+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:31.786 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:31.782+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:31.856 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:31.850+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:31.951 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:31.947+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:32.062 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:32.056+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:32.154 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:32.149+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:32.636 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:32.632+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:32.702 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:32.695+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:32.703 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:32.699+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:32.793 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:32.788+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:32.907 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:32.901+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:32.965 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:32.960+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:33.043 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:33.037+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:33.209 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:33.203+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:33.688 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:33.684+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:33.705 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:33.699+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:33.707 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:33.702+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:33.778 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:33.775+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:33.896 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:33.890+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:33.963 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:33.959+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:34.042 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:34.036+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:34.195 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:34.187+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:34.679 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:34.675+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:34.714 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:34.707+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:34.715 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:34.710+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:34.753 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:34.748+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:34.936 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:34.930+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:35.008 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:35.003+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:35.068 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:35.061+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:35.150 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:35.144+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:35.704 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:35.698+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:35.705 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:35.701+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:35.708 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:35.704+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:35.736 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:35.730+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:35.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:35.965+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:36.039 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:36.034+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:36.119 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:36.113+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:36.158 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:36.152+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:36.331 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:31:36.326+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 48sec e564 v564) 2019-12-09T20:31:36.672 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:36.664+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:36.674 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:36.668+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:36.716 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:36.712+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:36.736 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:36.732+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:36.967 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:36.961+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:37.001 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:36.996+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:37.073 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:37.067+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:37.144 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:37.138+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:37.711 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:37.705+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:37.724 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:37.719+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:37.728 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:37.724+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:37.756 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:37.749+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:37.933 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:37.928+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:37.970 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:37.965+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:38.051 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:38.045+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:38.196 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:38.190+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:38.684 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:38.676+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:38.709 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:38.704+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:38.717 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:38.712+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:38.770 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:38.764+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:38.899 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:38.893+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:38.994 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:38.989+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:39.088 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:39.082+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:39.224 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:39.218+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:39.705 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:39.700+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:39.741 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:39.733+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:39.744 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:39.736+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:39.800 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:39.796+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:39.882 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:39.876+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:40.047 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:40.042+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:40.108 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:40.101+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:40.227 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:40.218+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:40.747 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:40.740+0000 1694f700 -1 osd.6 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:30:29.004015+0000 (oldest deadline 2019-12-09T20:31:09.004015+0000) 2019-12-09T20:31:40.748 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:40.743+0000 1694f700 -1 osd.6 564 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:31:40.758 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:31:40.752+0000 1694f700 -1 osd.2 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:09.762565+0000 front 2019-12-09T20:30:09.435355+0000 (oldest deadline 2019-12-09T20:30:55.292710+0000) 2019-12-09T20:31:40.795 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:31:40.792+0000 1694f700 -1 osd.3 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:10.109007+0000 front 2019-12-09T20:30:10.115219+0000 (oldest deadline 2019-12-09T20:30:54.738435+0000) 2019-12-09T20:31:40.888 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:31:40.883+0000 1694f700 -1 osd.7 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.791550+0000 front 2019-12-09T20:30:13.770587+0000 (oldest deadline 2019-12-09T20:30:59.642804+0000) 2019-12-09T20:31:41.071 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:31:41.065+0000 1694f700 -1 osd.5 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:11.148516+0000 front 2019-12-09T20:30:11.435118+0000 (oldest deadline 2019-12-09T20:30:55.138063+0000) 2019-12-09T20:31:41.097 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:31:41.093+0000 1694f700 -1 osd.1 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:13.742939+0000 front 2019-12-09T20:30:13.754312+0000 (oldest deadline 2019-12-09T20:30:55.990582+0000) 2019-12-09T20:31:41.267 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:31:41.262+0000 1694f700 -1 osd.4 564 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:30:12.567226+0000 front 2019-12-09T20:30:13.402729+0000 (oldest deadline 2019-12-09T20:30:56.652397+0000) 2019-12-09T20:31:41.418 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:31:41.406+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 48sec e564 v564) 2019-12-09T20:31:41.831 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:31:41.762+0000 1694f700 -1 osd.6 565 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e562) 2019-12-09T20:32:45.009 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:32:45.005+0000 1694f700 -1 osd.0 571 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:121881 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 385731248 gen 148] snapc 0=[] ondisk+write+known_if_redirected e569) 2019-12-09T20:32:45.970 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:32:45.966+0000 1694f700 -1 osd.0 571 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:121881 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 385731248 gen 148] snapc 0=[] ondisk+write+known_if_redirected e569) 2019-12-09T20:32:46.935 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:32:46.931+0000 1694f700 -1 osd.0 571 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:121881 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 385731248 gen 148] snapc 0=[] ondisk+write+known_if_redirected e569) 2019-12-09T20:32:47.901 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:32:47.899+0000 1694f700 -1 osd.0 571 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:121881 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 385731248 gen 148] snapc 0=[] ondisk+write+known_if_redirected e569) 2019-12-09T20:32:48.893 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:32:48.890+0000 1694f700 -1 osd.0 571 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:121881 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 385731248 gen 148] snapc 0=[] ondisk+write+known_if_redirected e569) 2019-12-09T20:33:00.919 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:27:21.977 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:33:00.926 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:27:21.985 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:33:00.934 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:27:21.992 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:33:00.936 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:27:21.971 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:33:00.938 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:27:21.997 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:33:00.943 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:27:21.974 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:33:01.171 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:27:22.230 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:33:01.195 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:27:22.254 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:33:01.197 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:27:22.232 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:33:16.153 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:16.148+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:17.168 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:17.163+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:17.609 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:17.605+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:17.926 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:17.922+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:18.173 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:18.163+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:18.466 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:18.460+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:18.479 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:18.473+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:18.657 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:18.651+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:18.889 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:18.885+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:19.184 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:19.179+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:19.482 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:19.477+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:19.517 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:19.513+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:19.686 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:19.679+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:19.887 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:19.883+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:20.156 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:20.153+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:20.481 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:20.477+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:20.520 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:20.515+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:20.715 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:20.711+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:20.801 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:20.797+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:20.898 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:20.894+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:20.937 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:20.932+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:21.164 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:21.160+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:21.443 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:21.440+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:21.556 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:21.552+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:21.722 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:21.719+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:21.795 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:21.792+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:21.861 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:21.858+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:21.985 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:21.979+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:22.131 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:22.128+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:22.459 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:22.456+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:22.600 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:22.595+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:22.735 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:22.731+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:22.817 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:22.812+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:22.905 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:22.901+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:22.969 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:22.964+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:23.096 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:23.092+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:23.482 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:23.479+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:23.647 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:23.642+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:23.702 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:23.698+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:23.842 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:23.838+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:23.930 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:23.927+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:23.981 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:23.975+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:24.080 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:24.076+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:24.483 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:24.480+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:24.618 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:24.613+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:24.703 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:24.698+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:24.882 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:24.878+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:24.981 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:24.977+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:24.989 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:24.984+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:25.112 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:25.109+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:25.472 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:25.468+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:25.654 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:25.649+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:25.699 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:25.695+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:25.896 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:25.893+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:25.960 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:25.957+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:25.966 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:25.962+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:26.097 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:26.093+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:26.458 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:26.453+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:26.645 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:26.640+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:26.686 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:26.682+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:26.902 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:26.898+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:26.925 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:26.921+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:26.932 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:26.929+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:27.067 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:27.063+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:27.453 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:27.449+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:27.655 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:27.651+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:27.681 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:27.677+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:27.904 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:27.902+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:27.943 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:27.935+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:27.947 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:27.944+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:28.111 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:28.107+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:28.494 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:28.490+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:28.667 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:28.662+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:28.706 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:28.702+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:28.896 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:28.892+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:28.958 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:28.954+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:28.971 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:28.967+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:29.144 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:29.141+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:29.482 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:29.478+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:29.717 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:29.713+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:29.756 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:29.751+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:29.852 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:29.848+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:29.996 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:29.991+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:30.004 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:30.000+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:30.131 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:30.127+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:30.503 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:30.499+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:30.709 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:30.704+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:30.782 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:30.766+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:30.903 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:30.900+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:30.956 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:30.950+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:31.055 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:31.049+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:31.119 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:31.115+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:31.507 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:31.503+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:31.727 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:31.723+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:31.751 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:31.747+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:31.884 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:31.881+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:31.945 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:31.940+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:32.055 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:32.052+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:32.135 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:32.132+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:32.525 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:32.521+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:32.712 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:32.708+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:32.736 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:32.732+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:32.933 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:32.930+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:32.944 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:32.941+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:33.099 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:33.095+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:33.165 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:33.161+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:33.483 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:33.479+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:33.719 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:33.714+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:33.768 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:33.763+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:33.889 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:33.886+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:33.938 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:33.933+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:34.120 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:34.116+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:34.169 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:34.165+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:34.453 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:34.450+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:34.688 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:34.683+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:34.789 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:34.785+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:34.899 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:34.895+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:34.916 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:34.912+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:35.098 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:35.095+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:35.161 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:35.157+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:35.458 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:35.455+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:35.651 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:35.647+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:35.747 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:35.741+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:35.890 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:35.886+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:35.922 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:35.919+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:36.114 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:36.110+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:36.201 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:36.197+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:36.429 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:36.425+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:36.618 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:36.614+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:36.746 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:36.740+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:36.923 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:36.919+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:36.931 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:36.927+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:37.125 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:37.120+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:37.239 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:37.235+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:37.412 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:37.409+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:37.613 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:37.608+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:37.762 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:37.757+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:37.923 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:37.919+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:37.944 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:37.937+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:38.130 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:38.125+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:38.269 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:38.254+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:38.408 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:38.402+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:38.605 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:38.600+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:38.791 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:38.786+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:38.914 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:38.909+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:38.936 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:38.932+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:39.125 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:39.122+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:39.265 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:39.262+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:39.459 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:39.455+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:39.641 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:39.636+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:39.778 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:39.773+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:39.912 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:39.908+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:39.930 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:39.925+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:40.089 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:40.085+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:40.299 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:40.295+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:40.492 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:40.489+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:40.653 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:40.647+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:40.738 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:40.733+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:40.929 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:40.926+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:40.964 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:40.961+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:41.107 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:41.103+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:41.304 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:41.300+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:41.492 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:41.487+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:41.653 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:41.649+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:41.775 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:41.770+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:41.963 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:41.958+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:42.014 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:42.011+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:42.137 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:42.133+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:42.325 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:42.319+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:42.538 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:42.535+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:42.683 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:42.679+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:42.796 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:42.791+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:42.978 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:42.973+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:43.051 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:43.048+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:43.124 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:43.116+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:43.369 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:43.365+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:43.561 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:43.556+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:43.647 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:43.643+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:43.828 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:43.824+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:43.935 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:43.931+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:44.034 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:44.029+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:44.141 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:44.137+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:44.409 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:44.405+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:44.589 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:44.585+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:44.635 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:44.630+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:44.839 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:44.821+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:44.987 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:44.983+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:45.018 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:45.013+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:45.120 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:45.115+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:45.386 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:45.381+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:45.592 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:45.587+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:45.661 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:45.656+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:45.879 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:45.875+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:46.029 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:46.024+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:46.060 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:46.058+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:46.162 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:46.158+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:46.359 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:46.355+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:46.580 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:46.577+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:46.658 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:46.653+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:46.917 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:46.912+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:47.037 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:47.034+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:47.080 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:47.076+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:47.123 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:47.118+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:47.361 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:47.356+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:47.561 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:47.558+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:47.682 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:47.677+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:47.948 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:47.943+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:48.037 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:48.034+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:48.039 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:48.034+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:48.145 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:48.142+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:48.351 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:48.347+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:48.522 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:48.518+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:48.668 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:48.664+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:48.948 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:48.943+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:49.004 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:49.000+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:49.067 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:49.063+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:49.143 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:49.139+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:49.328 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:49.324+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:49.500 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:49.495+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:49.683 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:49.678+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:49.991 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:49.985+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:49.994 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:49.990+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:50.038 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:50.034+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:50.144 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:50.140+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:50.298 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:50.295+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:50.511 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:50.507+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:50.656 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:50.651+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:51.001 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:50.996+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:51.012 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:51.007+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:51.013 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:51.009+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:51.193 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:51.190+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:51.278 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:51.274+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:51.492 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:51.488+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:51.625 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:51.621+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:51.937 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:33:51.932+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e571 v571) 2019-12-09T20:33:52.011 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:52.006+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:52.021 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:52.019+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:52.046 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:52.041+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:52.243 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:52.233+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:52.248 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:52.244+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:52.545 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:52.541+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:52.673 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:52.665+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:53.041 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:53.038+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:53.058 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:53.053+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:53.098 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:53.093+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:53.247 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:53.244+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:53.285 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:53.282+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:53.556 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:53.553+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:53.703 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:53.698+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:54.078 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:54.074+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:54.088 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:54.083+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:54.109 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:54.095+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:54.233 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:54.229+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:54.297 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:54.293+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:54.591 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:54.587+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:54.719 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:54.715+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:55.091 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:55.086+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:55.124 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:55.121+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:55.128 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:55.124+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:55.199 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:55.196+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:55.317 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:55.310+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:55.576 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:55.573+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:55.733 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:55.729+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:56.098 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:33:56.093+0000 1694f700 -1 osd.4 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.185502+0000 front 2019-12-09T20:32:34.448849+0000 (oldest deadline 2019-12-09T20:33:18.307882+0000) 2019-12-09T20:33:56.108 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:33:56.103+0000 1694f700 -1 osd.3 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037841+0000 front 2019-12-09T20:32:35.743949+0000 (oldest deadline 2019-12-09T20:33:19.746942+0000) 2019-12-09T20:33:56.163 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:33:56.158+0000 1694f700 -1 osd.5 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:35.743701+0000 front 2019-12-09T20:32:35.485063+0000 (oldest deadline 2019-12-09T20:33:17.422184+0000) 2019-12-09T20:33:56.193 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:56.189+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:33:56.344 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:33:56.340+0000 1694f700 -1 osd.0 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:33.294179+0000 front 2019-12-09T20:32:35.758854+0000 (oldest deadline 2019-12-09T20:33:15.317255+0000) 2019-12-09T20:33:56.592 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:33:56.588+0000 1694f700 -1 osd.2 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:32.597855+0000 front 2019-12-09T20:32:32.590804+0000 (oldest deadline 2019-12-09T20:33:17.768844+0000) 2019-12-09T20:33:56.745 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:33:56.740+0000 1694f700 -1 osd.7 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.031615+0000 front 2019-12-09T20:32:35.742703+0000 (oldest deadline 2019-12-09T20:33:16.929603+0000) 2019-12-09T20:33:56.996 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:33:56.989+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 44sec e571 v571) 2019-12-09T20:33:57.153 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:33:57.149+0000 1694f700 -1 osd.1 571 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:32:36.037362+0000 front 2019-12-09T20:32:36.031768+0000 (oldest deadline 2019-12-09T20:33:20.872560+0000) 2019-12-09T20:34:30.410 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:34:30.366+0000 35f8f700 -1 osd.6 576 build_incremental_map_msg missing incremental map 576 2019-12-09T20:34:30.453 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:34:30.443+0000 124b0700 -1 osd.6 576 build_incremental_map_msg missing incremental map 576 2019-12-09T20:34:30.605 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:34:30.590+0000 31786700 -1 osd.6 576 build_incremental_map_msg missing incremental map 576 2019-12-09T20:34:31.015 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:34:30.990+0000 32788700 -1 osd.6 576 build_incremental_map_msg missing incremental map 576 2019-12-09T20:34:31.281 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:34:31.276+0000 38f95700 -1 osd.6 576 build_incremental_map_msg missing incremental map 576 2019-12-09T20:34:32.849 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:34:32.820+0000 38f95700 -1 osd.6 577 build_incremental_map_msg missing incremental map 576 2019-12-09T20:34:55.793 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:34:55.787+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:34:56.062 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:34:56.058+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:34:56.821 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:34:56.813+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:34:57.066 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:34:57.062+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:34:57.531 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:34:57.527+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:34:57.799 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:34:57.792+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:34:58.051 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:34:58.046+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:34:58.490 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:34:58.484+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:34:58.558 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:34:58.554+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:34:58.794 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:34:58.787+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:34:59.060 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:34:59.056+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:34:59.532 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:34:59.526+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:34:59.535 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:34:59.531+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:34:59.723 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:34:59.717+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:34:59.782 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:34:59.776+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:00.066 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:00.060+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:00.509 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:00.505+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:00.572 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:00.566+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:00.700 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:00.694+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:00.809 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:00.803+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:01.052 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:01.048+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:01.506 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:01.502+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:01.592 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:01.586+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:01.747 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:01.741+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:01.797 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:01.791+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:02.055 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:02.051+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:02.188 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:02.184+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:02.556 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:02.552+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:02.611 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:02.606+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:02.777 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:02.772+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:02.778 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:02.771+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:03.031 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:03.025+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:03.179 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:03.175+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:03.570 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:03.566+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:03.653 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:03.648+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:03.791 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:03.786+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:03.816 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:03.811+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:03.994 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:03.990+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:04.224 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:04.220+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:04.611 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:04.608+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:04.684 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:04.676+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:04.802 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:04.797+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:04.808 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:04.803+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:04.981 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:04.975+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:05.244 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:05.240+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:05.645 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:05.639+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:05.664 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:05.659+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:05.760 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:05.754+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:05.814 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:05.808+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:05.967 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:05.963+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:06.250 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:06.243+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:06.251 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:06.247+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:06.655 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:06.648+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:06.659 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:06.654+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:06.769 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:06.762+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:06.848 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:06.842+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:06.982 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:06.976+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:07.235 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:07.230+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:07.238 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:07.235+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:07.624 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:07.618+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:07.643 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:07.638+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:07.766 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:07.760+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:07.836 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:07.828+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:07.953 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:07.948+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:08.229 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:08.223+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:08.232 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:08.228+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:08.584 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:08.578+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:08.682 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:08.676+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:08.763 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:08.757+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:08.870 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:08.864+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:08.999 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:08.994+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:09.251 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:09.244+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:09.253 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:09.248+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:09.546 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:09.539+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:09.666 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:09.661+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:09.741 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:09.735+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:09.914 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:09.908+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:10.037 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:10.031+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:10.240 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:10.228+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:10.241 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:10.236+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:10.519 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:10.514+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:10.668 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:10.662+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:10.741 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:10.735+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:10.940 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:10.934+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:11.004 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:10.998+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:11.277 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:11.271+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:11.279 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:11.274+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:11.509 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:11.503+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:11.627 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:11.621+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:11.740 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:11.734+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:11.993 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:11.989+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:12.016 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:12.011+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:12.300 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:12.295+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:12.304 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:12.300+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:12.554 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:12.549+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:12.602 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:12.590+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:12.749 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:12.743+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:13.007 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:13.000+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:13.015 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:13.009+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:13.343 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:13.337+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:13.344 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:13.340+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:13.556 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:13.551+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:13.585 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:13.580+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:13.725 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:13.718+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:13.968 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:13.964+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:13.988 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:13.982+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:14.327 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:14.319+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:14.328 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:14.323+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:14.540 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:14.534+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:14.592 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:14.588+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:14.721 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:14.715+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:14.971 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:14.966+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:14.972 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:14.967+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:15.348 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:15.342+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:15.349 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:15.345+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:15.549 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:15.544+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:15.579 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:15.573+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:15.756 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:15.748+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:15.940 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:15.935+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:15.979 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:15.974+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:16.309 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:16.303+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:16.311 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:16.306+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:16.510 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:16.505+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:16.553 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:16.547+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:16.729 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:16.723+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:16.981 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:16.976+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:17.007 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:17.001+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:17.307 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:17.302+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:17.309 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:17.305+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:17.560 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:17.556+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:17.565 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:17.559+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:17.730 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:17.724+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:18.015 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:18.010+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:18.022 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:18.016+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:18.324 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:18.317+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:18.329 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:18.321+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:18.531 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:18.526+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:18.570 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:18.566+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:18.714 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:18.709+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:19.018 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:19.013+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:19.060 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:19.053+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:19.283 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:19.278+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:19.286 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:19.282+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:19.512 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:19.507+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:19.567 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:19.563+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:19.683 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:19.679+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:19.986 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:19.982+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:20.052 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:20.045+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:20.305 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:20.298+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:20.310 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:20.306+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:20.481 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:20.474+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:20.556 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:20.549+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:20.657 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:20.650+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:21.027 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:21.019+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:21.039 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:21.034+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:21.341 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:21.335+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:21.345 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:21.341+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:21.445 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:21.438+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:21.528 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:21.524+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:21.692 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:21.685+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:22.010 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:22.005+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:22.018 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:22.013+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:22.380 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:22.373+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:22.381 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:22.376+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:22.429 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:22.425+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:22.490 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:22.484+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:22.677 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:22.671+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:22.977 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:22.969+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:22.977 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:22.968+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:23.387 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:23.380+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:23.388 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:23.384+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:23.396 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:23.390+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:23.464 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:23.458+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:23.635 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:23.630+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:23.934 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:23.930+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:23.983 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:23.977+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:24.422 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:24.415+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:24.423 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:24.419+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:24.438 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:24.432+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:24.447 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:24.434+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:24.636 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:24.631+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:24.939 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:24.931+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:24.946 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:24.942+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:25.425 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:25.420+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:25.428 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:25.423+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:25.431 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:25.426+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:25.443 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:25.438+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:25.653 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:25.647+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:25.942 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:25.938+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:25.985 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:25.980+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:26.432 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:26.427+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:26.455 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:26.449+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:26.465 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:26.458+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:26.466 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:26.461+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:26.686 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:26.681+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:26.989 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:26.982+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:27.006 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:27.000+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:27.429 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:27.424+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:27.439 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:27.432+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:27.439 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:27.429+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:27.477 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:27.471+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:27.646 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:27.640+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:27.982 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:27.975+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:28.009 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:28.001+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:28.393 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:28.387+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:28.395 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:28.390+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:28.395 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:28.391+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:28.450 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:28.444+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:28.611 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:28.602+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:28.978 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:28.974+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:29.026 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:29.020+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:29.351 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:29.348+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:29.424 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:29.419+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:29.425 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:29.420+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:29.425 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:29.421+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:29.629 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:29.624+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:30.000 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:29.994+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:30.011 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:30.006+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:30.401 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:30.398+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:30.412 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:30.407+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:30.428 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:30.421+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:30.428 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:30.424+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:30.681 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:30.675+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:30.970 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:30.965+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:31.038 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:31.034+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:31.393 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:31.388+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:31.397 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:31.392+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:31.401 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:31.397+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:31.456 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:31.450+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:31.721 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:31.710+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:31.961 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:31.954+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:31.994 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:31.991+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:32.253 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:35:32.250+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e577 v577) 2019-12-09T20:35:32.403 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:32.397+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:32.405 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:32.401+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:32.406 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:32.402+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:32.444 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:32.438+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:32.745 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:32.739+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:32.930 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:32.925+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:32.956 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:32.952+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:33.396 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:33.392+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:33.399 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:33.393+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:33.400 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:33.396+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:33.423 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:33.418+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:33.791 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:33.765+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:33.900 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:33.895+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:33.943 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:33.939+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:34.408 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:34.402+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:34.425 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:34.420+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:34.436 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:34.426+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:34.440 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:34.436+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:34.725 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:34.719+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:34.903 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:34.897+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:34.949 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:34.945+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:35.375 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:35.369+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:35.473 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:35.469+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:35.476 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:35.472+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:35.483 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:35.479+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:35.735 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:35.731+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:35.870 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:35.861+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:35.991 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:35.987+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:36.405 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:36.394+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:36.455 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:36.448+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:36.465 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:36.452+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:36.509 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:36.505+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:36.779 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:36.774+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:36.870 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:36.865+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:36.977 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:36.972+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:37.245 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:35:37.240+0000 1694f700 -1 osd.2 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:11.464376+0000 front 2019-12-09T20:34:11.466370+0000 (oldest deadline 2019-12-09T20:35:37.059500+0000) 2019-12-09T20:35:37.274 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:35:37.269+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e577 v577) 2019-12-09T20:35:37.406 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:37.401+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:37.444 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:37.439+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:37.448 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:37.444+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:37.496 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:37.489+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:37.770 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:37.765+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:37.888 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:37.883+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:37.994 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:37.990+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:38.292 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:35:38.289+0000 1694f700 -1 osd.2 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:11.464376+0000 front 2019-12-09T20:34:11.466370+0000 (oldest deadline 2019-12-09T20:35:37.059500+0000) 2019-12-09T20:35:38.403 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:38.396+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:38.403 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:38.399+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:38.442 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:38.437+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:38.528 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:38.525+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:38.751 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:35:38.745+0000 1694f700 -1 osd.7 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.277086+0000 front 2019-12-09T20:34:11.930224+0000 (oldest deadline 2019-12-09T20:34:55.349181+0000) 2019-12-09T20:35:38.925 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:35:38.920+0000 1694f700 -1 osd.4 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:13.726957+0000 front 2019-12-09T20:34:13.844461+0000 (oldest deadline 2019-12-09T20:34:58.977695+0000) 2019-12-09T20:35:39.042 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:35:39.037+0000 1694f700 -1 osd.3 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:10.292872+0000 front 2019-12-09T20:34:10.298667+0000 (oldest deadline 2019-12-09T20:34:56.015901+0000) 2019-12-09T20:35:39.266 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:35:39.260+0000 1694f700 -1 osd.2 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:11.464376+0000 front 2019-12-09T20:34:11.466370+0000 (oldest deadline 2019-12-09T20:35:37.059500+0000) 2019-12-09T20:35:39.445 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:39.440+0000 1694f700 -1 osd.6 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:34:26.213720+0000 (oldest deadline 2019-12-09T20:35:06.213720+0000) 2019-12-09T20:35:39.449 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:35:39.446+0000 1694f700 -1 osd.6 577 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:121508 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e575) 2019-12-09T20:35:39.458 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:35:39.453+0000 1694f700 -1 osd.5 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:12.284281+0000 front 2019-12-09T20:34:12.284837+0000 (oldest deadline 2019-12-09T20:34:57.560335+0000) 2019-12-09T20:35:39.549 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:35:39.544+0000 1694f700 -1 osd.1 577 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:34:14.484389+0000 front 2019-12-09T20:34:14.407951+0000 (oldest deadline 2019-12-09T20:34:57.100581+0000) 2019-12-09T20:35:42.606 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:30:03.661 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.651 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:30:03.710 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.690 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:30:03.725 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.697 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:30:03.732 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.707 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:30:03.766 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.708 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:30:03.767 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.869 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:30:03.923 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.902 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:30:03.960 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.985 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:30:04.013 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:36:02.732 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:30:23.790 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:36:02.773 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:30:23.831 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:36:02.798 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:30:23.856 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:36:02.809 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:30:23.867 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:36:02.812 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:30:23.871 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:36:02.822 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:30:23.857 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:36:02.828 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:30:23.863 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:36:02.844 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:30:23.903 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:36:02.881 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:30:23.916 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:36:14.284 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:36:14.253+0000 3578e700 -1 osd.0 583 build_incremental_map_msg missing incremental map 583 2019-12-09T20:36:14.302 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:36:14.264+0000 3578e700 -1 osd.0 583 build_incremental_map_msg missing incremental map 583 2019-12-09T20:36:15.305 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:36:15.267+0000 37f93700 -1 osd.0 583 build_incremental_map_msg missing incremental map 583 2019-12-09T20:37:01.933 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:31:22.992 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:37:01.940 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:31:22.999 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:37:01.950 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:31:23.009 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:37:01.951 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:31:22.984 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:37:01.955 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:31:23.014 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:37:01.956 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:31:22.991 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:37:02.004 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:31:23.063 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:37:02.023 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:31:23.081 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:37:02.067 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:31:23.102 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:37:14.017 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:14.014+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:14.159 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:14.156+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:14.423 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:14.419+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:14.669 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:14.664+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:15.068 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:15.062+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:15.142 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:15.138+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:15.434 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:15.430+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:15.629 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:15.625+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:15.666 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:15.661+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:16.050 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:16.040+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:16.098 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:16.094+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:16.391 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:16.387+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:16.635 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:16.631+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:16.694 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:16.687+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:17.002 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:16.998+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:17.138 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:17.132+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:17.377 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:17.372+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:17.642 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:17.636+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:17.750 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:17.745+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:17.962 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:17.957+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:17.967 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:17.963+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:18.188 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:18.182+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:18.419 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:18.416+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:18.621 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:18.617+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:18.728 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:18.724+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:18.955 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:18.950+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:19.021 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:19.015+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:19.162 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:19.157+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:19.436 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:19.431+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:19.590 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:19.587+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:19.712 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:19.707+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:19.921 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:19.916+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:20.044 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:20.040+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:20.159 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:20.155+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:20.401 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:20.395+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:20.609 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:20.604+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:20.714 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:20.707+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:20.968 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:20.964+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:21.055 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:21.050+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:21.212 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:21.208+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:21.413 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:21.408+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:21.627 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:21.622+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:21.671 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:21.666+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:21.991 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:21.987+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:22.099 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:22.095+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:22.190 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:22.185+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:22.377 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:22.363+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:22.659 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:22.649+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:22.665 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:22.656+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:22.951 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:22.944+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:23.141 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:23.136+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:23.172 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:23.168+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:23.360 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:23.356+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:23.668 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:23.661+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:23.685 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:23.673+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:23.912 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:23.906+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:24.110 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:24.105+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:24.174 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:24.170+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:24.375 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:24.371+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:24.639 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:24.634+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:24.659 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:24.654+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:24.929 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:24.925+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:25.131 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:25.125+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:25.148 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:25.144+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:25.362 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:25.358+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:25.677 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:25.668+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:25.686 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:25.682+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:25.956 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:25.952+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:26.101 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:26.096+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:26.118 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:26.114+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:26.407 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:26.402+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:26.664 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:26.658+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:26.708 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:26.703+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:26.918 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:26.913+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:27.066 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:27.062+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:27.141 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:27.136+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:27.378 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:27.373+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:27.713 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:27.709+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:27.728 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:27.723+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:27.960 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:27.956+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:28.038 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:28.033+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:28.097 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:28.093+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:28.356 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:28.351+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:28.733 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:28.729+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:28.774 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:28.768+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:28.945 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:28.938+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:29.008 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:29.003+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:29.054 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:29.049+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:29.347 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:29.343+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:29.734 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:29.731+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:29.810 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:29.806+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:29.970 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:29.965+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:29.978 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:29.974+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:30.060 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:30.055+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:30.346 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:30.340+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:30.739 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:30.735+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:30.779 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:30.774+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:30.985 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:30.980+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:30.987 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:30.983+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:31.081 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:31.077+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:31.343 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:31.336+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:31.780 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:31.775+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:31.796 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:31.791+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:32.021 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:32.016+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:32.039 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:32.034+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:32.098 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:32.094+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:32.374 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:32.369+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:32.778 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:32.774+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:32.822 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:32.818+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:33.019 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:33.014+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:33.072 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:33.067+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:33.099 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:33.093+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:33.406 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:33.401+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:33.763 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:33.758+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:33.784 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:33.779+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:33.995 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:33.990+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:34.078 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:34.073+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:34.115 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:34.109+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:34.378 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:34.374+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:34.763 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:34.758+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:34.763 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:34.758+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:35.041 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:35.035+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:35.086 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:35.081+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:35.092 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:35.087+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:35.354 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:35.349+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:35.759 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:35.754+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:35.791 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:35.787+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:36.020 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:36.016+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:36.074 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:36.069+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:36.077 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:36.073+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:36.359 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:36.355+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:36.723 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:36.719+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:36.799 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:36.795+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:37.011 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:37.007+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:37.054 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:37.050+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:37.110 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:37.106+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:37.349 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:37.344+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:37.701 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:37.693+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:37.833 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:37.828+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:38.034 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:38.030+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:38.040 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:38.036+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:38.136 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:38.132+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:38.381 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:38.377+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:38.755 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:38.748+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:38.796 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:38.791+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:39.021 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:39.018+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:39.050 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:39.046+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:39.104 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:39.101+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:39.337 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:39.332+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:39.757 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:39.752+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:39.833 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:39.828+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:40.054 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:40.050+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:40.070 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:40.063+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:40.135 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:40.132+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:40.387 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:40.383+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:40.805 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:40.798+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:40.866 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:40.862+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:41.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:41.057+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:41.103 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:41.098+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:41.103 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:41.099+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:41.417 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:41.412+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:41.811 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:41.808+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:41.822 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:41.819+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:42.101 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:42.097+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:42.104 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:42.100+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:42.110 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:42.106+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:42.142 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:37:42.138+0000 1694f700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.537214+0000 front 2019-12-09T20:36:32.240054+0000 (oldest deadline 2019-12-09T20:37:41.645883+0000) 2019-12-09T20:37:42.376 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:42.372+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:42.791 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:42.787+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:42.827 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:42.824+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:43.062 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:43.057+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:43.065 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:43.062+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:43.124 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:43.121+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:43.167 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:37:43.164+0000 1694f700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.537214+0000 front 2019-12-09T20:36:32.240054+0000 (oldest deadline 2019-12-09T20:37:41.645883+0000) 2019-12-09T20:37:43.397 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:43.387+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:43.781 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:43.779+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:43.801 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:43.795+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:44.024 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:44.020+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:44.114 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:44.111+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:44.175 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:44.171+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:44.192 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:37:44.189+0000 1694f700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.537214+0000 front 2019-12-09T20:36:32.240054+0000 (oldest deadline 2019-12-09T20:37:41.645883+0000) 2019-12-09T20:37:44.396 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:44.387+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:44.784 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:44.779+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:44.800 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:44.796+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:45.052 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:45.047+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:45.156 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:45.152+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:45.179 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:45.175+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:45.223 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:37:45.219+0000 1694f700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.537214+0000 front 2019-12-09T20:36:32.240054+0000 (oldest deadline 2019-12-09T20:37:41.645883+0000) 2019-12-09T20:37:45.438 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:45.433+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:45.785 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:45.781+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:45.824 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:45.820+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:46.091 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:46.086+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:46.140 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:46.137+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:46.213 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:46.209+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:46.256 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:37:46.252+0000 1694f700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.537214+0000 front 2019-12-09T20:36:32.240054+0000 (oldest deadline 2019-12-09T20:37:41.645883+0000) 2019-12-09T20:37:46.489 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:46.486+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:46.783 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:46.779+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:46.806 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:46.802+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:47.077 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:47.072+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:47.105 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:47.101+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:47.208 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:47.204+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:47.222 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:37:47.219+0000 1694f700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.537214+0000 front 2019-12-09T20:36:32.240054+0000 (oldest deadline 2019-12-09T20:37:41.645883+0000) 2019-12-09T20:37:47.510 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:37:47.505+0000 1694f700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.597724+0000 front 2019-12-09T20:36:32.595086+0000 (oldest deadline 2019-12-09T20:37:13.630910+0000) 2019-12-09T20:37:47.755 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:37:47.750+0000 1694f700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.657254+0000 front 2019-12-09T20:36:29.001015+0000 (oldest deadline 2019-12-09T20:37:14.535638+0000) 2019-12-09T20:37:47.766 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:37:47.764+0000 1694f700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:30.399200+0000 front 2019-12-09T20:36:30.343565+0000 (oldest deadline 2019-12-09T20:37:15.502491+0000) 2019-12-09T20:37:48.036 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:37:48.031+0000 1694f700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:29.971147+0000 front 2019-12-09T20:36:29.950736+0000 (oldest deadline 2019-12-09T20:37:13.325265+0000) 2019-12-09T20:37:48.157 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:37:48.153+0000 1694f700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.315322+0000 front 2019-12-09T20:36:32.617494+0000 (oldest deadline 2019-12-09T20:37:17.456010+0000) 2019-12-09T20:37:48.182 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:37:48.178+0000 1694f700 -1 osd.0 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:28.776624+0000 front 2019-12-09T20:36:28.697986+0000 (oldest deadline 2019-12-09T20:37:13.841957+0000) 2019-12-09T20:37:48.246 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:37:48.241+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 41sec e583 v583) 2019-12-09T20:37:48.276 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:37:48.272+0000 1694f700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:36:32.537214+0000 front 2019-12-09T20:36:32.240054+0000 (oldest deadline 2019-12-09T20:37:41.645883+0000) 2019-12-09T20:38:26.540 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:38:26.535+0000 35f8f700 -1 osd.6 588 build_incremental_map_msg missing incremental map 588 2019-12-09T20:38:29.230 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:38:29.101+0000 3578e700 -1 osd.0 589 build_incremental_map_msg missing incremental map 589 2019-12-09T20:38:30.392 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:38:30.374+0000 37f93700 -1 osd.0 589 build_incremental_map_msg missing incremental map 589 2019-12-09T20:38:47.583 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:47.579+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:47.682 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:47.675+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:47.779 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:47.774+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:48.278 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:38:48.273+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:38:48.601 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:48.595+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:48.686 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:48.680+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:48.743 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:48.736+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:49.311 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:38:49.307+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:38:49.625 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:49.621+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:49.729 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:49.723+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:49.731 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:49.727+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:50.299 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:38:50.296+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:38:50.566 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:38:50.561+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:38:50.589 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:50.586+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:50.670 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:38:50.664+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:38:50.700 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:50.694+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:50.715 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:50.711+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:51.267 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:38:51.264+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:38:51.557 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:38:51.550+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:38:51.606 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:51.601+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:51.698 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:38:51.693+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:38:51.708 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:51.703+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:51.714 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:51.711+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:52.237 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:38:52.234+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:38:52.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:38:52.511+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:38:52.580 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:52.576+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:52.694 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:52.690+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:52.718 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:38:52.712+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:38:52.721 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:52.715+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:53.216 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:38:53.211+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:38:53.502 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:38:53.495+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:38:53.580 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:53.575+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:53.691 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:38:53.685+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:38:53.708 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:53.701+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:53.709 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:53.706+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:54.211 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:38:54.204+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:38:54.474 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:38:54.468+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:38:54.577 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:54.573+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:54.673 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:54.667+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:54.723 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:38:54.717+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:38:54.731 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:54.721+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:55.168 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:38:55.165+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:38:55.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:38:55.450+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:38:55.604 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:55.600+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:55.713 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:55.708+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:55.721 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:38:55.716+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:38:55.743 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:55.739+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:56.205 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:38:56.199+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:38:56.501 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:38:56.495+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:38:56.601 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:56.596+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:56.738 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:38:56.732+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:38:56.750 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:56.745+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:56.755 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:56.749+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:56.816 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:38:56.812+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:38:57.161 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:38:57.158+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:38:57.479 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:38:57.473+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:38:57.587 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:57.584+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:57.698 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:38:57.692+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:38:57.708 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:57.704+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:57.788 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:57.782+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:57.812 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:38:57.808+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:38:58.190 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:38:58.187+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:38:58.483 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:38:58.478+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:38:58.597 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:58.584+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:58.672 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:38:58.666+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:38:58.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:58.704+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:58.812 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:58.807+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:58.849 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:38:58.845+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:38:59.243 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:38:59.239+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:38:59.536 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:38:59.530+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:38:59.555 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:38:59.550+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:38:59.670 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:38:59.662+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:38:59.691 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:38:59.687+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:38:59.775 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:38:59.769+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:38:59.855 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:38:59.850+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:00.219 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:00.215+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:00.540 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:00.537+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:00.584 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:00.578+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:00.655 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:00.651+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:00.717 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:00.713+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:00.736 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:00.731+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:00.819 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:00.816+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:01.264 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:01.260+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:01.539 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:01.535+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:01.636 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:01.631+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:01.661 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:01.658+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:01.682 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:01.668+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:01.777 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:01.770+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:01.777 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:01.772+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:02.278 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:02.272+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:02.533 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:02.529+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:02.640 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:02.637+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:02.641 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:02.636+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:02.653 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:02.647+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:02.737 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:02.731+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:02.755 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:02.749+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:02.759 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:02.755+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:03.240 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:03.234+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:03.525 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:03.520+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:03.618 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:03.611+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:03.656 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:03.652+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:03.677 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:03.670+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:03.737 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:03.731+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:03.741 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:03.737+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:03.781 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:03.774+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:04.274 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:04.269+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:04.534 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:04.530+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:04.611 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:04.605+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:04.629 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:04.625+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:04.654 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:04.648+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:04.744 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:04.739+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:04.748 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:04.744+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:04.815 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:04.809+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:05.323 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:05.319+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:05.491 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:05.486+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:05.648 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:05.642+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:05.680 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:05.673+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:05.698 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:05.693+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:05.759 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:05.751+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:05.761 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:05.755+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:05.800 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:05.792+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:06.364 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:06.359+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:06.455 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:06.451+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:06.606 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:06.600+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:06.664 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:06.658+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:06.692 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:06.687+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:06.770 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:06.765+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:06.774 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:06.770+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:06.814 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:06.808+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:07.387 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:07.381+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:07.427 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:07.422+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:07.617 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:07.611+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:07.661 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:07.657+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:07.684 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:07.679+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:07.737 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:07.731+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:07.739 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:07.734+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:07.783 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:07.776+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:08.388 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:08.384+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:08.400 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:08.396+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:08.665 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:08.660+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:08.717 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:08.709+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:08.740 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:08.735+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:08.766 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:08.760+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:08.766 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:08.762+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:08.770 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:08.764+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:09.381 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:09.377+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:09.401 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:09.398+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:09.659 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:09.648+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:09.682 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:09.677+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:09.742 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:09.737+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:09.757 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:09.743+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:09.757 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:09.746+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:09.768 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:09.756+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:10.369 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:10.365+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:10.409 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:10.405+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:10.668 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:10.664+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:10.689 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:10.683+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:10.727 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:10.721+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:10.728 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:10.722+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:10.728 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:10.723+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:10.796 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:10.791+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:11.355 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:11.352+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:11.392 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:11.387+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:11.692 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:11.686+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:11.693 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:11.690+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:11.718 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:11.713+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:11.722 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:11.718+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:11.748 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:11.742+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:11.809 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:11.802+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:12.404 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:12.399+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:12.406 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:12.401+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:12.686 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:12.681+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:12.712 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:12.706+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:12.716 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:12.705+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:12.717 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:12.708+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:12.733 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:12.728+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:12.783 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:12.778+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:13.391 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:13.387+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:13.392 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:13.387+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:13.644 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:13.640+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:13.713 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:13.706+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:13.713 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:13.709+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:13.772 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:13.754+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:13.782 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:13.779+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:13.799 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:13.794+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:14.348 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:14.342+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:14.356 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:14.350+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:14.623 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:14.619+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:14.736 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:14.731+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:14.737 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:14.733+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:14.748 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:14.743+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:14.760 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:14.756+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:14.836 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:14.832+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:15.345 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:15.340+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:15.401 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:15.394+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:15.626 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:15.622+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:15.711 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:15.701+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:15.734 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:15.729+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:15.735 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:15.731+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:15.797 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:15.791+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:15.831 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:15.827+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:16.363 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:16.359+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:16.442 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:16.438+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:16.657 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:16.653+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:16.753 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:16.746+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:16.771 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:16.765+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:16.773 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:16.767+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:16.779 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:16.775+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:16.880 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:16.875+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:17.370 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:17.366+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:17.468 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:17.464+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:17.650 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:17.646+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:17.724 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:17.718+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:17.755 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:17.749+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:17.758 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:17.755+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:17.805 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:17.799+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:17.904 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:17.899+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:18.358 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:18.353+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:18.428 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:18.424+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:18.487 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:39:18.483+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e589 v589) 2019-12-09T20:39:18.637 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:18.632+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:18.752 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:18.745+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:18.781 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:18.775+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:18.782 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:18.778+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:18.822 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:18.816+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:18.911 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:18.905+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:19.354 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:19.351+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:19.443 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:19.439+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:19.647 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:19.643+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:19.739 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:19.733+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:19.812 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:19.806+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:19.815 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:19.812+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:19.847 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:19.841+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:19.909 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:19.904+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:20.397 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:20.393+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:20.469 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:20.466+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:20.636 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:20.632+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:20.714 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:20.708+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:20.818 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:20.811+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:20.819 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:20.814+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:20.842 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:20.836+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:20.953 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:20.948+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:21.429 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:21.425+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:21.510 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:21.506+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:21.606 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:21.602+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:21.716 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:21.710+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:21.816 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:21.810+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:21.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:21.847+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:21.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:21.850+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:21.940 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:21.935+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:22.461 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:22.457+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:22.490 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:22.487+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:22.591 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:22.587+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:22.745 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:22.739+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:22.862 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:22.856+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:22.892 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:22.886+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:22.893 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:22.889+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:22.990 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:22.985+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:23.439 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:23.433+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:23.503 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:23.496+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:23.513 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:39:23.506+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e589 v589) 2019-12-09T20:39:23.603 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:23.597+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:23.758 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:23.752+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:23.841 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:23.836+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:23.856 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:23.851+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:23.860 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:23.856+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:24.042 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:24.037+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:24.440 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:24.433+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:24.556 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:24.551+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:24.602 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:24.597+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:24.792 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:24.785+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:24.846 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:24.841+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:24.850 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:24.846+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:24.891 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:24.885+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:25.094 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:25.088+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:25.491 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:25.485+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:25.538 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:25.532+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:25.626 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:25.619+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:25.782 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:25.777+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:25.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:25.846+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:25.853 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:25.849+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:25.876 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:25.870+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:26.074 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:26.068+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:26.498 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:26.492+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:26.541 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:26.536+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:26.582 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:26.576+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:26.809 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:26.803+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:26.812 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:26.806+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:26.816 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:26.810+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:26.903 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:26.898+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:27.056 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:27.050+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:27.457 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:27.453+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:27.558 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:27.554+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:27.613 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:27.609+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:27.799 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:27.792+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:27.800 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:27.796+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:27.814 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:27.808+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:27.918 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:27.913+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:28.043 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:28.037+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:28.499 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:28.494+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:28.522 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:39:28.517+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e589 v589) 2019-12-09T20:39:28.584 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:28.579+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:28.646 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:28.641+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:28.782 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:28.775+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:28.783 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:28.779+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:28.832 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:28.826+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:28.953 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:28.947+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:29.045 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:29.040+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:29.554 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:29.548+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:29.622 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:29.611+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:29.638 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:29.631+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:29.794 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:29.788+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:29.795 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:29.791+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:29.837 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:29.832+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:29.908 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:29.902+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:30.021 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:30.015+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:30.593 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:30.587+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:30.632 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:30.627+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:30.655 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:30.650+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:30.805 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:30.801+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:30.808 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:30.804+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:30.814 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:30.810+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:30.907 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:30.902+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:31.063 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:31.059+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:31.600 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:31.595+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:31.650 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:31.640+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:31.650 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:31.645+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:31.776 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:31.769+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:31.782 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:31.776+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:31.783 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:31.780+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:31.953 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:31.946+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:32.088 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:32.081+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:32.581 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:32.571+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:32.609 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:32.604+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:32.641 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:32.636+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:32.751 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:32.745+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:32.751 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:32.748+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:32.803 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:32.798+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:32.910 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:32.904+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:33.123 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:33.116+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:33.543 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:39:33.538+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e589 v589) 2019-12-09T20:39:33.592 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:33.586+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:33.660 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:33.656+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:33.672 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:33.668+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:33.714 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:33.707+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:33.715 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:33.710+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:33.768 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:33.759+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:33.880 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:33.869+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:34.130 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:34.124+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:34.602 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:34.597+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:34.675 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:34.667+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:34.684 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:34.679+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:34.689 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:34.684+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:34.707 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:34.701+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:34.742 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:34.736+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:34.927 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:34.922+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:35.163 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:35.157+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:35.625 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:35.620+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:35.655 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:35.649+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:35.680 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:35.674+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:35.681 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:35.677+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:35.698 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:35.694+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:35.718 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:35.712+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:35.965 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:35.961+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:36.163 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:36.157+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:36.609 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:36.603+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:36.652 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:36.645+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:36.653 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:36.648+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:36.674 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:36.669+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:36.733 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:36.728+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:36.739 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:36.733+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:36.983 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:36.977+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:37.177 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:37.171+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:37.640 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:39:37.634+0000 1694f700 -1 osd.3 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:01.252927+0000 front 2019-12-09T20:38:01.306577+0000 (oldest deadline 2019-12-09T20:38:47.097930+0000) 2019-12-09T20:39:37.700 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:37.693+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:37.701 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:37.697+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:37.711 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:37.706+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:37.740 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:39:37.734+0000 1694f700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.062737+0000 front 2019-12-09T20:38:04.992998+0000 (oldest deadline 2019-12-09T20:38:50.288915+0000) 2019-12-09T20:39:37.767 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:37.761+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:37.956 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:39:37.951+0000 1694f700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.746147+0000 front 2019-12-09T20:38:04.923325+0000 (oldest deadline 2019-12-09T20:38:46.958012+0000) 2019-12-09T20:39:38.218 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:39:38.212+0000 1694f700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:05.740223+0000 front 2019-12-09T20:38:05.939356+0000 (oldest deadline 2019-12-09T20:38:50.252957+0000) 2019-12-09T20:39:38.592 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:39:38.588+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e589 v589) 2019-12-09T20:39:38.677 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:38.671+0000 1694f700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:38:22.105232+0000 (oldest deadline 2019-12-09T20:39:02.105232+0000) 2019-12-09T20:39:38.677 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:38.674+0000 1694f700 -1 osd.6 589 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-12-09T20:39:38.762 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:39:38.757+0000 1694f700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:04.930095+0000 front 2019-12-09T20:38:04.927882+0000 (oldest deadline 2019-12-09T20:38:47.643084+0000) 2019-12-09T20:39:38.818 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:39:38.814+0000 1694f700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:38:02.401058+0000 front 2019-12-09T20:38:02.594928+0000 (oldest deadline 2019-12-09T20:38:47.572437+0000) 2019-12-09T20:39:39.502 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:39:39.476+0000 34f8d700 -1 osd.6 590 build_incremental_map_msg missing incremental map 588 2019-12-09T20:40:05.858 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:40:05.852+0000 31786700 -1 osd.0 594 build_incremental_map_msg missing incremental map 594 2019-12-09T20:40:06.589 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:40:06.578+0000 32788700 -1 osd.0 594 build_incremental_map_msg missing incremental map 594 2019-12-09T20:40:06.990 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:40:06.983+0000 37f93700 -1 osd.0 594 build_incremental_map_msg missing incremental map 594 2019-12-09T20:41:04.058 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:35:25.116 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:04.063 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:35:25.122 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:04.073 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:35:25.131 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:04.076 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:35:25.111 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:04.080 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:35:25.139 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:04.083 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:35:25.118 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:04.301 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:35:25.360 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:04.322 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:35:25.380 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:04.333 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:35:25.368 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:04.974 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:04.969+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:05.098 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:05.095+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:05.961 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:05.954+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:05.991 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:05.987+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:06.067 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:06.060+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:06.067 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:06.061+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:06.981 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:06.976+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:07.016 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:07.009+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:07.072 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:07.065+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:07.113 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:07.110+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:08.025 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:08.021+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:08.025 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:08.020+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:08.031 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:08.026+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:08.046 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:08.042+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:08.126 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:08.123+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:08.202 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:08.197+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:09.003 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:08.999+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:09.020 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:09.015+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:09.036 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:09.031+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:09.053 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:09.050+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:09.084 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:09.080+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:09.246 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:09.242+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:09.990 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:09.986+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:10.015 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:10.007+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:10.017 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:10.013+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:10.054 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:10.050+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:10.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:10.063+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:10.213 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:10.211+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:10.975 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:10.969+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:11.014 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:11.011+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:11.033 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:11.029+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:11.073 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:11.069+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:11.101 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:11.098+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:11.214 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:11.211+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:12.017 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:12.013+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:12.025 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:12.020+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:12.043 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:12.036+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:12.078 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:12.075+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:12.133 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:12.126+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:12.253 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:12.250+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:13.010 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:13.006+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:13.026 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:13.022+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:13.038 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:13.034+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:13.053 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:13.049+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:13.093 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:13.089+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:13.277 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:13.275+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:14.025 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:14.020+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:14.043 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:14.039+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:14.064 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:14.059+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:14.064 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:14.060+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:14.078 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:14.076+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:14.270 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:14.267+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:14.993 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:14.989+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:15.017 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:15.012+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:15.027 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:15.023+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:15.081 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:15.071+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:15.133 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:15.129+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:15.269 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:15.265+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:16.004 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:15.998+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:16.021 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:16.017+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:16.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:16.063+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:16.090 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:16.085+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:16.125 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:16.121+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:16.279 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:16.275+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:16.957 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:16.953+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:17.044 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:17.037+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:17.049 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:17.045+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:17.063 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:17.059+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:17.146 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:17.142+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:17.314 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:17.311+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:17.945 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:17.938+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:18.015 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:18.009+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:18.041 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:18.034+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:18.097 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:18.092+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:18.189 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:18.185+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:18.277 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:18.273+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:18.981 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:18.976+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:19.048 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:19.043+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:19.072 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:19.068+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:19.141 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:19.137+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:19.158 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:19.155+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:19.309 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:19.305+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:19.979 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:19.976+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:20.045 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:20.040+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:20.091 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:20.087+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:20.123 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:20.120+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:20.128 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:20.124+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:20.292 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:20.288+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:21.007 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:21.003+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:21.050 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:21.045+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:21.076 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:21.071+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:21.145 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:21.140+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:21.178 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:21.174+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:21.255 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:21.251+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:21.623 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:21.619+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:21.989 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:21.986+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:22.014 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:22.010+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:22.044 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:22.040+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:22.126 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:22.123+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:22.216 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:22.213+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:22.230 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:22.225+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:22.615 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:22.611+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:22.955 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:22.951+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:23.038 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:23.031+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:23.084 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:23.080+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:23.175 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:23.172+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:23.219 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:23.214+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:23.264 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:23.260+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:23.619 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:23.614+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:23.921 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:23.916+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:24.003 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:23.999+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:24.045 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:24.041+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:24.231 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:24.222+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:24.232 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:24.229+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:24.277 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:24.268+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:24.584 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:24.581+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:24.956 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:24.953+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:25.049 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:25.044+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:25.056 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:25.051+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:25.201 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:25.197+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:25.264 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:25.259+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:25.288 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:25.280+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:25.574 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:25.570+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:25.961 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:25.958+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:26.015 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:26.012+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:26.046 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:26.043+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:26.205 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:26.202+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:26.234 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:26.230+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:26.332 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:26.327+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:26.624 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:26.621+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:26.924 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:26.920+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:27.002 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:26.999+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:27.082 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:27.078+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:27.227 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:27.223+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:27.232 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:27.229+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:27.344 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:27.339+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:27.596 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:27.592+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:27.975 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:27.972+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:28.001 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:27.992+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:28.129 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:28.124+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:28.263 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:28.260+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:28.279 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:28.273+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:28.321 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:28.316+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:28.623 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:28.620+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:29.028 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:29.024+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:29.033 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:29.029+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:29.091 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:29.087+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:29.233 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:29.228+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:29.236 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:29.233+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:29.292 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:29.288+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:29.637 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:29.634+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:30.026 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:30.020+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:30.062 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:30.057+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:30.143 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:30.139+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:30.229 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:30.224+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:30.243 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:30.234+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:30.332 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:30.328+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:30.597 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:30.592+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:31.044 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:31.039+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:31.075 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:31.071+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:31.130 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:31.126+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:31.208 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:31.203+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:31.233 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:31.230+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:31.334 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:31.329+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:31.566 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:31.562+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:32.043 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:32.038+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:32.087 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:32.085+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:32.119 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:32.115+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:32.208 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:32.204+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:32.223 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:32.219+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:32.296 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:32.291+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:32.562 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:32.557+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:33.057 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:33.053+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:33.112 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:33.107+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:33.169 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:33.165+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:33.215 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:33.209+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:33.215 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:33.209+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:33.291 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:33.287+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:33.567 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:33.562+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:34.083 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:34.079+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:34.133 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:34.130+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:34.134 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:34.130+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:34.188 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:34.184+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:34.202 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:34.198+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:34.251 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:34.247+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:34.566 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:34.561+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:35.114 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:35.110+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:35.150 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:35.146+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:35.160 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:35.155+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:35.164 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:35.159+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:35.248 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:35.245+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:35.252 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:35.246+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:35.587 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:35.583+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:36.139 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:36.134+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:36.149 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:36.144+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:36.168 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:36.163+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:36.168 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:36.164+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:36.213 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:36.208+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:36.295 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:36.290+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:36.637 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:36.632+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:37.125 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:37.121+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:37.165 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:37.160+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:37.170 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:37.166+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:37.177 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:37.174+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:37.222 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:37.216+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:37.326 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:37.321+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:37.647 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:37.642+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:38.100 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:38.095+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:38.139 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:38.135+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:38.166 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:38.161+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:38.185 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:38.175+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:38.207 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:38.203+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:38.313 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:38.309+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:38.660 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:38.656+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:39.092 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:41:39.086+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e594 v594) 2019-12-09T20:41:39.129 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:39.124+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:39.153 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:39.148+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:39.156 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:39.151+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:39.188 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:39.184+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:39.256 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:39.252+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:39.312 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:39.307+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:39.719 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:39.713+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:40.116 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:40.111+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:40.139 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:40.134+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:40.208 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:40.204+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:40.211 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:40.207+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:40.266 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:40.261+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:40.336 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:40.332+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:40.714 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:40.709+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:41.122 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:41.118+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:41.127 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:41.122+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:41.216 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:41.213+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:41.245 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:41.241+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:41.281 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:41.277+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:41.362 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:41.358+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:41.688 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:41.684+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:42.079 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:42.074+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:42.152 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:42.147+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:42.258 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:42.255+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:42.281 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:42.276+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:42.290 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:42.282+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:42.352 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:42.348+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:42.657 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:42.653+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:43.109 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:43.104+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:43.121 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:43.116+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:43.227 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:43.222+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:43.288 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:41:43.284+0000 1694f700 -1 osd.4 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.553373+0000 front 2019-12-09T20:40:23.666160+0000 (oldest deadline 2019-12-09T20:41:04.629716+0000) 2019-12-09T20:41:43.314 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:43.310+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:41:43.380 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:41:43.376+0000 1694f700 -1 osd.5 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.710327+0000 front 2019-12-09T20:40:23.714724+0000 (oldest deadline 2019-12-09T20:41:05.259390+0000) 2019-12-09T20:41:43.657 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:41:43.652+0000 1694f700 -1 osd.1 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751295+0000 front 2019-12-09T20:40:22.896232+0000 (oldest deadline 2019-12-09T20:41:21.516952+0000) 2019-12-09T20:41:44.078 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:41:44.074+0000 1694f700 -1 osd.3 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.913658+0000 front 2019-12-09T20:40:22.915895+0000 (oldest deadline 2019-12-09T20:41:04.276931+0000) 2019-12-09T20:41:44.089 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:41:44.084+0000 1694f700 -1 osd.0 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:23.830344+0000 front 2019-12-09T20:40:23.826885+0000 (oldest deadline 2019-12-09T20:41:07.895513+0000) 2019-12-09T20:41:44.143 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:41:44.135+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e594 v594) 2019-12-09T20:41:44.181 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:41:44.178+0000 1694f700 -1 osd.7 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.893141+0000 front 2019-12-09T20:40:22.397400+0000 (oldest deadline 2019-12-09T20:41:05.096165+0000) 2019-12-09T20:41:44.302 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:41:44.298+0000 1694f700 -1 osd.2 594 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:40:22.751336+0000 front 2019-12-09T20:40:22.894181+0000 (oldest deadline 2019-12-09T20:41:07.024273+0000) 2019-12-09T20:42:42.545 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:42.539+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:42.987 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:42.981+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:43.413 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:43.406+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:43.594 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:43.588+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:43.852 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:43.847+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:43.984 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:43.978+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:44.393 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:44.388+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:44.606 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:44.602+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:44.868 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:44.862+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:45.003 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:44.998+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:45.403 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:45.399+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:45.581 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:45.575+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:45.819 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:45.815+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:45.860 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:45.854+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:46.042 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:46.036+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:46.308 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:46.302+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:46.422 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:46.414+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:46.458 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:46.454+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:46.586 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:46.582+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:46.822 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:46.816+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:46.898 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:46.893+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:47.039 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:47.033+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:47.286 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:47.280+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:47.409 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:47.404+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:47.471 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:47.467+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:47.562 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:47.557+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:47.823 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:47.819+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:47.907 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:47.901+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:47.994 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:47.989+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:48.274 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:48.268+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:48.421 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:48.417+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:48.469 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:48.466+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:48.551 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:48.548+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:48.832 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:48.827+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:48.940 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:48.935+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:48.975 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:48.970+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:49.310 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:49.305+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:49.397 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:49.388+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:49.442 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:49.439+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:49.564 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:49.560+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:49.820 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:49.815+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:49.946 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:49.941+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:50.008 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:50.003+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:50.341 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:50.335+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:50.432 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:50.427+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:50.496 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:50.493+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:50.606 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:50.602+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:50.865 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:50.859+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:50.966 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:50.961+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:51.013 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:51.007+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:51.385 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:51.367+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:51.435 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:51.429+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:51.463 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:51.459+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:51.639 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:51.634+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:51.823 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:51.817+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:51.990 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:51.980+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:52.000 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:51.994+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:52.366 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:52.360+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:52.468 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:52.464+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:52.476 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:52.471+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:52.634 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:52.629+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:52.864 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:52.858+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:52.964 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:52.959+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:53.047 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:53.040+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:53.397 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:53.392+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:53.432 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:53.426+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:42:53.434 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:53.429+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:53.459 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:53.453+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:53.616 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:53.611+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:53.881 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:53.876+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:53.954 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:53.947+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:54.005 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:53.999+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:54.377 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:54.369+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:54.449 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:54.443+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:54.472 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:54.463+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:42:54.472 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:54.466+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:54.585 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:54.580+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:54.862 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:54.855+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:54.936 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:54.930+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:54.985 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:54.979+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:55.353 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:55.347+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:55.429 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:55.423+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:55.475 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:55.469+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:42:55.479 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:55.475+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:55.565 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:55.559+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:55.850 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:55.844+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:55.946 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:55.940+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:55.983 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:55.976+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:56.403 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:56.397+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:56.426 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:56.421+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:56.528 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:56.520+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:42:56.530 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:56.525+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:56.557 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:56.551+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:56.830 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:56.822+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:56.973 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:56.968+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:56.981 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:56.976+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:57.389 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:57.383+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:57.400 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:57.395+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:57.552 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:57.545+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:42:57.553 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:57.549+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:57.607 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:57.603+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:57.862 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:57.856+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:57.983 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:57.978+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:58.019 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:58.014+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:58.423 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:58.412+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:58.449 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:58.443+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:58.599 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:58.593+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:58.604 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:58.598+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:42:58.608 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:58.604+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:58.821 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:58.816+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:58.983 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:58.978+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:42:59.023 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:42:59.017+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:42:59.388 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:42:59.382+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:42:59.465 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:42:59.461+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:42:59.595 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:42:59.591+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:42:59.645 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:59.638+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:42:59.646 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:42:59.641+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:42:59.830 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:42:59.826+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:42:59.949 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:42:59.943+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:00.042 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:00.036+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:00.408 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:00.402+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:00.449 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:00.443+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:00.646 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:00.642+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:00.690 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:00.683+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:00.691 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:00.687+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:00.880 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:00.876+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:00.981 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:00.975+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:01.076 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:01.070+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:01.369 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:01.363+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:01.426 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:01.422+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:01.653 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:01.648+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:01.657 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:01.653+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:01.699 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:01.694+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:01.847 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:01.844+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:02.032 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:02.023+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:02.077 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:02.071+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:02.396 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:02.386+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:02.419 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:02.414+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:02.616 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:02.611+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:02.620 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:02.616+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:02.744 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:02.734+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:02.816 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:02.812+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:03.035 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:03.029+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:03.071 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:03.065+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:03.381 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:03.375+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:03.434 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:03.429+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:03.621 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:03.616+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:03.625 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:03.621+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:03.744 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:03.739+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:03.796 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:03.792+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:04.034 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:04.029+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:04.062 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:04.057+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:04.353 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:04.348+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:04.405 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:04.402+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:04.620 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:04.614+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:04.622 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:04.617+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:04.708 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:04.703+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:04.821 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:04.818+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:05.047 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:05.042+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:05.057 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:05.047+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:05.341 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:05.335+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:05.368 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:05.361+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:05.665 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:05.660+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:05.667 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:05.662+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:05.702 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:05.697+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:05.826 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:05.822+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:06.065 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:06.061+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:06.098 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:06.090+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:06.320 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:06.314+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:06.347 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:06.344+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:06.643 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:06.636+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:06.648 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:06.639+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:06.670 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:06.666+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:06.855 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:06.851+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:07.031 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:07.025+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:07.117 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:07.112+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:07.354 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:07.350+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:07.357 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:07.351+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:07.630 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:07.625+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:07.655 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:07.649+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:07.656 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:07.652+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:07.890 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:07.886+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:08.088 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:08.071+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:08.154 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:08.148+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:08.405 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:08.401+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:08.406 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:08.401+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:08.642 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:08.638+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:08.671 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:08.664+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:08.672 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:08.668+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:08.860 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:08.855+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:09.079 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:09.074+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:09.125 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:09.119+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:09.365 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:09.361+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:09.393 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:09.388+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:09.677 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:09.670+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:09.679 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:09.674+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:09.691 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:09.687+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:09.846 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:09.841+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:10.041 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:10.035+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:10.085 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:10.078+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:10.360 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:10.354+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:10.400 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:10.397+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:10.661 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:10.656+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:10.662 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:10.658+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:10.676 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:10.671+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:10.804 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:10.801+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:11.059 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:11.053+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:11.098 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:11.092+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:11.367 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:11.361+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:11.367 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:11.362+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:11.658 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:11.652+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:11.658 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:11.655+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:11.703 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:11.699+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:11.825 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:11.821+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:12.076 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:12.071+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:12.109 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:12.103+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:12.333 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:12.328+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:12.376 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:12.371+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:12.664 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:12.657+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:12.665 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:12.661+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:12.671 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:12.668+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:12.817 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:12.813+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:13.080 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:13.075+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:13.105 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:13.099+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:13.317 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:13.313+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:13.361 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:13.356+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:13.623 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:13.617+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:13.624 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:13.620+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:13.659 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:13.654+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:13.838 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:13.835+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:14.071 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:14.065+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:14.111 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:14.105+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:14.279 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:14.274+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:14.357 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:14.352+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:14.384 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:43:14.381+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e600 v600) 2019-12-09T20:43:14.592 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:14.586+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:14.595 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:14.592+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:14.684 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:14.680+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:14.806 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:14.802+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:15.091 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:15.086+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:15.159 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:15.153+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:15.301 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:15.296+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:15.402 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:15.398+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:15.589 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:15.583+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:15.591 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:15.586+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:15.678 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:15.673+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:15.780 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:15.776+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:16.105 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:16.100+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:16.185 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:16.178+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:16.299 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:16.293+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:16.421 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:16.416+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:16.555 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:16.548+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:16.556 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:16.551+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:16.659 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:16.654+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:16.756 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:16.752+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:17.108 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:17.103+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:17.154 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:17.147+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:17.289 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:17.284+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:17.417 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:17.413+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:17.583 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:17.579+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:17.587 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:17.583+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:17.637 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:17.634+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:17.783 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:17.779+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:18.084 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:18.072+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:18.182 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:18.177+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:18.315 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:18.307+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:18.461 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:18.456+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:18.616 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:18.605+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:18.619 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:18.614+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:18.641 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:18.637+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:18.791 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:18.788+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:19.079 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:19.073+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:19.184 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:19.178+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:19.359 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:19.352+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:19.392 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:43:19.390+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e600 v600) 2019-12-09T20:43:19.420 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:19.416+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:19.599 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:19.593+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:19.600 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:19.596+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:19.638 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:19.633+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:19.773 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:19.768+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:20.066 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:20.057+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:20.165 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:20.160+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:20.371 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:20.367+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:20.413 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:20.410+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:20.643 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:20.638+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:20.646 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:20.640+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:20.687 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:20.683+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:20.767 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:20.762+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:21.086 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:21.081+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:21.135 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:21.126+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:21.343 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:21.337+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:21.405 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:21.401+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:21.652 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:21.647+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:21.679 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:21.673+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:21.680 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:21.676+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:21.791 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:21.788+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:22.104 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:22.100+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:22.132 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:22.128+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:22.344 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:22.340+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:22.403 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:22.399+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:22.683 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:22.680+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:22.693 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:22.689+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:22.694 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:22.690+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:22.782 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:22.770+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:23.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:23.128+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:23.145 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:23.139+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:23.355 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:23.349+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:23.418 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:23.414+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:23.648 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:43:23.643+0000 1694f700 -1 osd.3 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:58.222326+0000 front 2019-12-09T20:41:58.121859+0000 (oldest deadline 2019-12-09T20:42:42.153891+0000) 2019-12-09T20:43:23.721 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:23.711+0000 1694f700 -1 osd.6 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:42:13.087272+0000 (oldest deadline 2019-12-09T20:42:53.087272+0000) 2019-12-09T20:43:23.721 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:23.714+0000 1694f700 -1 osd.6 600 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:43:23.813 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:43:23.809+0000 1694f700 -1 osd.2 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.503852+0000 front 2019-12-09T20:42:01.520486+0000 (oldest deadline 2019-12-09T20:42:45.581450+0000) 2019-12-09T20:43:24.140 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:43:24.134+0000 1694f700 -1 osd.4 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.450299+0000 front 2019-12-09T20:42:01.494397+0000 (oldest deadline 2019-12-09T20:42:43.247609+0000) 2019-12-09T20:43:24.175 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:43:24.170+0000 1694f700 -1 osd.5 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:41:59.165193+0000 front 2019-12-09T20:41:58.625069+0000 (oldest deadline 2019-12-09T20:42:42.704117+0000) 2019-12-09T20:43:24.362 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:43:24.356+0000 1694f700 -1 osd.7 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:01.513656+0000 front 2019-12-09T20:42:01.517625+0000 (oldest deadline 2019-12-09T20:42:46.266646+0000) 2019-12-09T20:43:24.435 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:43:24.432+0000 1694f700 -1 osd.1 600 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:42:00.409412+0000 front 2019-12-09T20:42:00.413351+0000 (oldest deadline 2019-12-09T20:42:42.687781+0000) 2019-12-09T20:43:24.465 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:43:24.463+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e600 v600) 2019-12-09T20:43:25.017 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:43:24.869+0000 1694f700 -1 osd.6 601 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:122679 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e598) 2019-12-09T20:44:02.055 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:02.006+0000 36790700 -1 osd.0 605 build_incremental_map_msg missing incremental map 605 2019-12-09T20:44:02.094 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:02.054+0000 36f91700 -1 osd.0 605 build_incremental_map_msg missing incremental map 605 2019-12-09T20:44:02.326 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:02.146+0000 36f91700 -1 osd.0 605 build_incremental_map_msg missing incremental map 605 2019-12-09T20:44:02.353 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:02.154+0000 31f87700 -1 osd.0 605 build_incremental_map_msg missing incremental map 605 2019-12-09T20:44:02.357 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:02.158+0000 31f87700 -1 osd.0 605 build_incremental_map_msg missing incremental map 605 2019-12-09T20:44:02.359 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:02.163+0000 31f87700 -1 osd.0 605 build_incremental_map_msg missing incremental map 605 2019-12-09T20:44:02.395 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:02.194+0000 31f87700 -1 osd.0 605 build_incremental_map_msg missing incremental map 605 2019-12-09T20:44:02.772 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:02.754+0000 33f8b700 -1 osd.0 605 build_incremental_map_msg missing incremental map 605 2019-12-09T20:44:03.467 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:03.372+0000 114ae700 -1 osd.0 606 build_incremental_map_msg missing incremental map 606 2019-12-09T20:44:03.617 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:03.458+0000 3578e700 -1 osd.0 606 build_incremental_map_msg missing incremental map 606 2019-12-09T20:44:03.650 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:03.501+0000 31f87700 -1 osd.0 606 build_incremental_map_msg missing incremental map 606 2019-12-09T20:44:03.716 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:03.578+0000 31f87700 -1 osd.0 606 build_incremental_map_msg missing incremental map 606 2019-12-09T20:44:03.745 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:03.595+0000 31f87700 -1 osd.0 606 build_incremental_map_msg missing incremental map 606 2019-12-09T20:44:05.357 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:05.348+0000 37f93700 -1 osd.0 606 build_incremental_map_msg missing incremental map 606 2019-12-09T20:44:24.869 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:38:45.927 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:24.871 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:38:45.929 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:24.938 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:38:45.973 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:24.944 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:38:45.979 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:25.023 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:38:46.082 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:25.026 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:38:46.084 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:25.099 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:38:46.158 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:25.173 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:38:46.208 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:25.325 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:38:46.384 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:32.303 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:32.300+0000 1694f700 -1 osd.0 606 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:123012 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 385731248 gen 160] snapc 0=[] ondisk+write+known_if_redirected e604) 2019-12-09T20:44:54.278 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:39:15.337 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:54.294 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:39:15.353 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:54.295 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:39:15.353 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:54.299 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:39:15.358 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:54.313 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:39:15.348 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:54.323 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:39:15.358 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:54.345 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:39:15.404 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:54.349 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:39:15.408 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:54.425 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:39:15.460 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:58.373 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:58.368+0000 1694f700 -1 osd.0 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:15.391578+0000 front 2019-12-09T20:44:15.393034+0000 (oldest deadline 2019-12-09T20:44:58.356787+0000) 2019-12-09T20:44:58.727 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:44:58.723+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:44:59.370 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:44:59.365+0000 1694f700 -1 osd.0 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:15.391578+0000 front 2019-12-09T20:44:15.393034+0000 (oldest deadline 2019-12-09T20:44:58.356787+0000) 2019-12-09T20:44:59.744 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:44:59.739+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:00.402 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:45:00.397+0000 1694f700 -1 osd.0 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:15.391578+0000 front 2019-12-09T20:44:15.393034+0000 (oldest deadline 2019-12-09T20:44:58.356787+0000) 2019-12-09T20:45:00.632 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:00.626+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:00.722 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:00.716+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:00.955 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:00.951+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:01.423 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:45:01.418+0000 1694f700 -1 osd.0 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:15.391578+0000 front 2019-12-09T20:44:15.393034+0000 (oldest deadline 2019-12-09T20:44:58.356787+0000) 2019-12-09T20:45:01.667 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:01.663+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:01.689 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:01.684+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:01.989 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:01.983+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:02.425 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:45:02.421+0000 1694f700 -1 osd.0 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:15.391578+0000 front 2019-12-09T20:44:15.393034+0000 (oldest deadline 2019-12-09T20:44:58.356787+0000) 2019-12-09T20:45:02.667 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:02.662+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:02.716 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:02.712+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:02.729 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:02.719+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:02.968 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:02.964+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:03.460 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:45:03.455+0000 1694f700 -1 osd.0 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:15.391578+0000 front 2019-12-09T20:44:15.393034+0000 (oldest deadline 2019-12-09T20:44:58.356787+0000) 2019-12-09T20:45:03.676 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:03.672+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:03.708 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:03.704+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:03.708 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:03.703+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:03.972 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:03.968+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:04.008 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:04.001+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:04.430 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:45:04.423+0000 1694f700 -1 osd.0 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:15.391578+0000 front 2019-12-09T20:44:15.393034+0000 (oldest deadline 2019-12-09T20:44:58.356787+0000) 2019-12-09T20:45:04.634 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:04.631+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:04.684 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:04.681+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:04.690 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:04.687+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:04.977 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:04.973+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:05.020 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:05.015+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:05.624 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:05.620+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:05.742 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:05.734+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:05.743 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:05.730+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:05.980 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:05.976+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:05.985 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:05.981+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:06.606 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:06.601+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:06.767 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:06.763+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:06.771 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:06.766+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:06.788 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:06.783+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:06.958 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:06.954+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:06.964 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:06.960+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:07.574 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:07.568+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:07.730 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:07.725+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:07.767 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:07.761+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:07.810 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:07.805+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:07.923 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:07.918+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:07.929 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:07.924+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:08.558 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:08.552+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:08.716 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:08.713+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:08.747 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:08.743+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:08.838 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:08.834+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:08.900 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:08.895+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:08.932 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:08.927+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:09.588 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:09.584+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:09.688 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:09.680+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:09.752 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:09.749+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:09.808 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:09.805+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:09.904 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:09.900+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:09.907 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:09.903+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:10.633 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:10.626+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:10.725 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:10.721+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:10.750 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:10.747+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:10.767 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:10.763+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:10.886 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:10.881+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:10.944 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:10.939+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:11.641 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:11.638+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:11.726 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:11.721+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:11.749 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:11.746+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:11.807 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:11.802+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:11.849 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:11.844+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:11.967 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:11.963+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:12.614 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:12.611+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:12.777 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:12.772+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:12.788 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:12.784+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:12.825 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:12.821+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:12.859 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:12.855+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:12.966 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:12.962+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:13.604 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:13.599+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:13.761 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:13.757+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:13.783 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:13.781+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:13.885 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:13.877+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:13.887 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:13.884+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:13.953 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:13.948+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:14.610 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:14.607+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:14.758 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:14.754+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:14.838 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:14.834+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:14.855 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:14.851+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:14.879 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:14.875+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:14.980 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:14.976+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:15.629 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:15.625+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:15.752 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:15.748+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:15.824 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:15.821+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:15.876 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:15.873+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:15.877 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:15.872+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:16.018 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:16.014+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:16.664 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:16.661+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:16.741 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:16.736+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:16.799 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:16.795+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:16.882 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:16.878+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:16.892 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:16.888+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:16.991 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:16.987+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:17.690 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:17.686+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:17.726 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:17.722+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:17.812 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:17.808+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:17.898 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:17.895+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:17.920 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:17.915+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:18.047 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:18.043+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:18.691 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:18.687+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:18.705 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:18.700+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:18.830 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:18.826+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:18.863 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:18.857+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:18.944 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:18.941+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:19.097 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:19.090+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:19.678 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:19.675+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:19.679 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:19.674+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:19.828 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:19.824+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:19.864 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:19.860+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:19.978 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:19.974+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:20.099 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:20.095+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:20.673 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:20.667+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:20.724 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:20.719+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:20.824 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:20.817+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:20.894 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:20.891+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:21.031 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:21.027+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:21.128 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:21.124+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:21.639 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:21.637+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:21.772 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:21.767+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:21.809 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:21.806+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:21.901 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:21.898+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:22.003 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:22.000+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:22.121 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:22.109+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:22.675 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:22.671+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:22.781 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:22.777+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:22.812 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:22.807+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:22.925 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:22.921+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:22.965 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:22.961+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:23.120 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:23.115+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:23.660 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:23.655+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:23.800 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:23.794+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:23.820 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:23.816+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:23.945 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:23.941+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:23.952 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:23.948+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:24.146 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:24.142+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:24.629 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:24.624+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:24.849 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:24.841+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:24.866 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:24.861+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:24.958 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:24.955+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:25.003 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:24.999+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:25.168 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:25.164+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:25.593 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:25.590+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:25.847 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:25.843+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:25.876 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:25.867+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:25.953 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:25.949+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:25.985 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:25.982+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:26.139 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:26.134+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:26.566 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:26.563+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:26.813 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:26.809+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:26.864 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:26.859+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:26.932 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:26.929+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:26.980 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:26.976+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:27.193 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:27.188+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:27.550 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:27.546+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:27.810 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:27.807+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:27.847 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:27.843+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:27.905 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:27.901+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:28.022 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:28.018+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:28.218 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:28.212+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:28.563 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:28.559+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:28.835 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:28.832+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:28.850 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:28.846+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:28.911 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:28.899+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:29.047 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:29.044+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:29.190 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:29.186+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:29.533 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:29.529+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:29.817 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:29.813+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:29.841 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:29.834+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:29.889 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:29.885+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:30.099 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:30.096+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:30.144 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:45:30.142+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e606 v606) 2019-12-09T20:45:30.204 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:30.201+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:30.547 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:30.544+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:30.824 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:30.821+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:30.828 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:30.822+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:30.939 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:30.936+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:31.080 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:31.076+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:31.256 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:31.252+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:31.545 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:31.541+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:31.794 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:31.790+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:31.873 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:31.865+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:31.902 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:31.899+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:32.072 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:32.068+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:32.224 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:32.219+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:32.507 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:32.503+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:32.816 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:32.812+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:32.890 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:32.886+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:32.911 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:32.907+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:33.121 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:33.118+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:33.227 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:33.220+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:33.555 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:33.552+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:33.872 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:33.867+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:33.882 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:33.877+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:33.929 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:33.924+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:34.104 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:34.100+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:34.272 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:34.268+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:34.570 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:34.565+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:34.870 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:34.866+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:34.906 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:34.901+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:34.980 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:34.977+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:35.110 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:35.106+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:35.164 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:45:35.160+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e606 v606) 2019-12-09T20:45:35.287 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:35.283+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:35.530 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:35.526+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:35.886 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:35.882+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:35.952 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:35.947+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:35.991 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:35.987+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:36.074 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:36.071+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:36.321 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:36.317+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:36.509 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:36.506+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:36.901 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:36.896+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:36.929 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:36.924+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:37.002 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:36.999+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:37.058 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:37.054+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:37.340 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:37.336+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:37.468 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:37.463+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:37.900 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:37.895+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:37.920 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:37.916+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:38.042 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:38.037+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:38.080 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:38.075+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:38.362 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:38.358+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:38.459 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:38.452+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:38.909 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:38.901+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:38.958 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:38.954+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:39.032 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:39.028+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:39.111 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:39.107+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:39.400 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:39.396+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:45:39.482 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:45:39.478+0000 1694f700 -1 osd.2 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.161056+0000 front 2019-12-09T20:44:14.356865+0000 (oldest deadline 2019-12-09T20:44:58.514578+0000) 2019-12-09T20:45:39.931 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:45:39.923+0000 1694f700 -1 osd.4 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:22.235131+0000 front 2019-12-09T20:44:20.637517+0000 (oldest deadline 2019-12-09T20:45:00.369222+0000) 2019-12-09T20:45:39.993 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:45:39.990+0000 1694f700 -1 osd.7 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:14.945718+0000 front 2019-12-09T20:44:21.618266+0000 (oldest deadline 2019-12-09T20:45:00.666276+0000) 2019-12-09T20:45:40.073 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:45:40.069+0000 1694f700 -1 osd.1 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:20.892111+0000 front 2019-12-09T20:44:20.650524+0000 (oldest deadline 2019-12-09T20:45:05.927288+0000) 2019-12-09T20:45:40.141 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:45:40.138+0000 1694f700 -1 osd.3 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.665771+0000 front 2019-12-09T20:44:19.667814+0000 (oldest deadline 2019-12-09T20:45:02.467855+0000) 2019-12-09T20:45:40.217 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:45:40.214+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.6 [v2:172.21.15.194:6816/10133,v1:172.21.15.194:6817/10133] for 42sec e606 v606) 2019-12-09T20:45:40.373 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:45:40.369+0000 1694f700 -1 osd.5 606 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:44:19.754306+0000 front 2019-12-09T20:44:19.752761+0000 (oldest deadline 2019-12-09T20:45:03.827909+0000) 2019-12-09T20:46:37.995 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:37.990+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:38.719 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:38.713+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:39.002 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:38.997+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:39.389 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:39.385+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:39.419 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:39.414+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:39.703 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:39.697+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:40.048 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:40.044+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:40.380 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:40.374+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:40.419 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:40.415+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:40.666 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:40.660+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:40.797 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:40.793+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:41.064 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:41.059+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:41.390 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:41.386+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:41.397 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:41.389+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:41.699 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:41.694+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:41.759 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:41.755+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:42.087 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:42.081+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:42.359 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:42.355+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:42.439 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:42.435+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:42.659 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:42.653+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:42.682 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:42.676+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:42.795 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:42.792+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:43.107 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:43.101+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:43.316 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:43.313+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:43.452 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:43.442+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:43.650 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:43.644+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:43.657 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:43.651+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:43.817 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:43.813+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:44.153 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:44.146+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:44.304 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:44.301+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:44.457 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:44.452+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:44.681 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:44.673+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:44.684 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:44.677+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:44.838 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:44.832+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:45.143 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:45.139+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:45.272 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:45.268+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:45.465 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:45.461+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:45.646 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:45.640+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:45.674 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:45.669+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:45.847 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:45.844+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:46.156 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:46.150+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:46.299 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:46.296+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:46.435 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:46.431+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:46.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:46.662+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:46.670 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:46.665+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:46.822 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:46.817+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:47.197 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:47.190+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:47.298 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:47.294+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:47.483 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:47.480+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:47.528 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:47.524+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:47.638 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:47.634+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:47.651 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:47.646+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:47.827 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:47.824+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:48.234 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:48.225+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:48.334 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:48.331+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:48.444 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:48.439+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:48.572 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:48.569+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:48.616 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:48.612+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:48.665 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:48.661+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:48.819 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:48.815+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:49.291 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:49.286+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:49.315 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:49.311+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:49.489 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:49.486+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:49.604 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:49.592+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:49.628 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:49.622+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:49.652 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:49.648+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:49.818 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:49.812+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:50.268 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:50.264+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:50.334 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:50.329+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:50.493 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:50.490+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:50.561 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:50.557+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:50.625 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:50.620+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:50.640 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:50.633+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:50.790 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:50.787+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:51.291 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:51.286+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:51.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:51.346+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:51.510 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:51.505+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:51.562 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:51.558+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:51.643 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:51.637+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:51.664 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:51.659+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:51.800 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:51.796+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:52.346 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:52.340+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:52.395 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:52.391+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:52.473 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:52.468+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:52.560 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:52.553+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:46:52.561 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:52.556+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:52.624 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:52.619+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:52.691 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:52.685+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:52.822 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:52.816+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:53.391 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:53.386+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:53.426 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:53.422+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:53.517 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:53.513+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:53.589 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:53.583+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:46:53.590 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:53.586+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:53.612 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:53.606+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:53.743 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:53.737+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:53.792 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:53.789+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:54.367 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:54.361+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:54.440 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:54.436+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:54.482 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:54.477+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:54.608 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:54.602+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:54.627 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:54.621+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:46:54.628 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:54.624+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:54.710 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:54.704+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:54.817 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:54.812+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:55.330 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:55.323+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:55.459 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:55.454+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:55.529 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:55.525+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:55.626 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:55.620+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:46:55.628 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:55.621+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:55.630 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:55.625+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:55.756 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:55.750+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:55.828 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:55.823+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:56.311 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:56.306+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:56.424 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:56.418+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:56.497 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:56.493+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:56.617 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:56.612+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:46:56.618 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:56.614+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:56.648 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:56.643+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:56.773 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:56.767+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:56.822 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:56.818+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:57.339 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:57.321+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:57.440 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:57.435+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:57.456 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:57.450+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:57.634 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:57.629+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:46:57.635 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:57.631+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:57.692 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:57.687+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:57.753 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:57.749+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:57.830 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:57.825+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:58.334 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:58.328+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:58.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:58.419+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:58.463 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:58.459+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:58.594 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:58.589+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:46:58.598 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:58.595+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:58.721 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:58.715+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:58.722 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:58.715+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:58.837 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:58.832+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:46:59.362 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:46:59.357+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:46:59.398 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:46:59.389+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:46:59.448 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:46:59.444+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:46:59.609 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:59.603+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:46:59.610 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:46:59.606+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:46:59.703 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:46:59.698+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:46:59.730 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:46:59.724+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:46:59.885 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:46:59.879+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:00.400 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:00.395+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:00.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:00.413+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:00.465 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:00.460+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:00.566 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:00.561+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:00.567 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:00.564+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:00.697 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:00.692+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:00.752 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:00.746+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:00.913 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:00.907+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:01.429 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:01.423+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:01.436 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:01.431+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:01.438 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:01.432+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:01.522 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:01.516+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:01.523 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:01.519+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:01.668 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:01.663+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:01.786 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:01.780+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:01.931 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:01.926+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:02.402 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:02.394+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:02.468 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:02.463+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:02.484 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:02.478+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:02.567 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:02.560+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:02.568 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:02.563+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:02.719 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:02.714+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:02.810 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:02.804+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:02.923 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:02.918+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:03.446 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:03.441+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:03.451 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:03.446+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:03.533 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:03.526+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:03.597 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:03.590+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:03.598 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:03.594+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:03.735 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:03.729+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:03.806 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:03.801+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:03.886 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:03.881+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:04.422 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:04.417+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:04.453 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:04.446+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:04.500 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:04.495+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:04.636 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:04.632+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:04.637 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:04.633+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:04.737 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:04.732+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:04.788 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:04.782+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:04.914 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:04.908+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:05.406 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:05.401+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:05.454 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:05.449+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:05.499 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:05.494+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:05.681 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:05.676+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:05.683 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:05.678+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:05.787 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:05.781+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:05.793 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:05.788+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:05.933 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:05.926+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:06.404 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:06.399+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:06.444 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:06.439+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:06.519 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:06.513+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:06.692 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:06.688+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:06.695 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:06.691+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:06.752 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:06.747+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:06.812 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:06.807+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:06.934 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:06.929+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:07.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:07.420+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:07.435 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:07.430+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:07.569 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:07.563+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:07.654 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:07.648+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:07.656 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:07.651+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:07.756 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:07.750+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:07.782 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:07.777+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:07.928 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:07.923+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:08.391 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:08.386+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:08.461 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:08.454+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:08.610 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:08.604+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:08.659 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:08.654+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:08.662 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:08.658+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:08.744 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:08.738+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:08.797 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:08.792+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:08.973 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:08.968+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:09.399 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:09.394+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:09.431 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:09.426+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:09.607 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:09.602+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:09.655 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:09.649+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:09.656 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:09.652+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:09.727 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:09.715+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:09.775 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:09.768+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:09.978 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:09.973+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:10.410 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:10.403+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:10.469 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:10.464+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:10.481 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:47:10.476+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e612 v612) 2019-12-09T20:47:10.641 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:10.636+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:10.706 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:10.701+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:10.708 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:10.703+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:10.761 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:10.756+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:10.813 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:10.807+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:10.969 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:10.964+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:11.409 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:11.402+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:11.504 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:11.499+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:11.639 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:11.631+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:11.663 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:11.656+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:11.664 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:11.660+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:11.734 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:11.722+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:11.858 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:11.852+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:11.996 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:11.992+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:12.360 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:12.357+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:12.542 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:12.537+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:12.619 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:12.613+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:12.620 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:12.616+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:12.679 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:12.674+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:12.749 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:12.742+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:12.903 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:12.896+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:13.017 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:13.012+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:13.315 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:13.310+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:13.497 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:13.492+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:13.600 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:13.596+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:13.603 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:13.600+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:13.709 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:13.704+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:13.801 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:13.795+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:13.886 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:13.880+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:14.001 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:13.996+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:14.350 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:14.345+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:14.487 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:14.482+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:14.651 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:14.644+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:14.652 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:14.648+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:14.705 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:14.699+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:14.841 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:14.835+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:14.873 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:14.867+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:15.013 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:15.010+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:15.361 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:15.356+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:15.454 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:15.448+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:15.500 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:47:15.495+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e612 v612) 2019-12-09T20:47:15.685 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:15.679+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:15.685 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:15.682+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:15.723 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:15.719+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:15.839 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:15.835+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:15.918 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:15.913+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:16.062 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:16.058+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:16.367 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:16.363+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:16.427 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:16.423+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:16.645 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:16.639+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:16.646 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:16.642+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:16.741 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:16.736+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:16.830 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:16.826+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:16.970 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:16.960+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:17.037 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:17.032+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:17.329 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:17.325+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:17.407 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:17.402+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:17.685 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:17.676+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:17.687 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:17.679+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:17.730 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:17.724+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:17.840 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:17.835+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:17.983 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:17.978+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:18.031 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:18.026+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:18.381 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:18.377+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:18.432 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:18.428+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:18.663 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:18.658+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:18.667 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:18.664+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:18.702 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:18.687+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:18.854 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:18.848+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:18.967 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:18.961+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:19.041 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:19.038+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:19.381 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:19.378+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:19.429 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:19.426+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:19.674 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:19.668+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:19.718 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:19.711+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:19.718 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:19.715+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:19.839 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:19.834+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:19.973 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:19.967+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:20.093 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:20.089+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:20.356 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:20.350+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:20.471 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:20.468+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:20.513 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:47:20.507+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e612 v612) 2019-12-09T20:47:20.662 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:20.656+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:20.675 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:20.670+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:20.676 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:20.672+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:20.838 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:20.832+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:20.944 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:20.939+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:21.060 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:21.056+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:21.326 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:21.323+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:21.464 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:21.457+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:21.674 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:21.669+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:21.702 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:21.695+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:21.705 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:21.702+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:21.864 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:21.858+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:21.937 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:21.931+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:22.054 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:22.050+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:22.310 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:22.307+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:22.480 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:22.476+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:22.659 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:22.654+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:22.663 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:22.659+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:22.687 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:22.675+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:22.828 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:22.822+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:22.923 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:22.918+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:23.049 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:23.044+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:23.322 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:23.317+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:23.508 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:23.503+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:23.630 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:23.624+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:23.631 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:23.627+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:23.677 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:23.672+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:23.871 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:23.866+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:23.892 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:23.886+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:24.075 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:24.071+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:24.290 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:24.284+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:24.521 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:24.516+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:24.613 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:24.607+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:24.614 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:24.610+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:24.698 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:24.692+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:24.861 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:47:24.855+0000 1694f700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.462470+0000 front 2019-12-09T20:45:57.510352+0000 (oldest deadline 2019-12-09T20:46:42.124160+0000) 2019-12-09T20:47:24.893 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:47:24.886+0000 1694f700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:54.523844+0000 front 2019-12-09T20:45:54.718896+0000 (oldest deadline 2019-12-09T20:46:38.516360+0000) 2019-12-09T20:47:25.113 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:47:25.109+0000 1694f700 -1 osd.3 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:58.165669+0000 front 2019-12-09T20:45:58.127305+0000 (oldest deadline 2019-12-09T20:46:40.352284+0000) 2019-12-09T20:47:25.242 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:47:25.238+0000 1694f700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:57.403893+0000 front 2019-12-09T20:45:57.361246+0000 (oldest deadline 2019-12-09T20:46:39.021659+0000) 2019-12-09T20:47:25.488 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:47:25.484+0000 1694f700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:56.408428+0000 front 2019-12-09T20:45:56.430980+0000 (oldest deadline 2019-12-09T20:46:38.664858+0000) 2019-12-09T20:47:25.568 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:47:25.565+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e612 v612) 2019-12-09T20:47:25.578 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:25.571+0000 1694f700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 ever on either front or back, first ping sent 2019-12-09T20:46:12.227886+0000 (oldest deadline 2019-12-09T20:46:52.227886+0000) 2019-12-09T20:47:25.579 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:47:25.575+0000 1694f700 -1 osd.6 612 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4376.0:123222 7.7 7.cbe5d797 (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-12-09T20:47:25.693 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:25.688+0000 1694f700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:45:53.221148+0000 front 2019-12-09T20:45:53.227902+0000 (oldest deadline 2019-12-09T20:46:37.885707+0000) 2019-12-09T20:47:57.401 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:57.294+0000 3658b700 -1 osd.5 616 build_incremental_map_msg missing incremental map 616 2019-12-09T20:47:57.501 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:57.356+0000 32d84700 -1 osd.5 616 build_incremental_map_msg missing incremental map 616 2019-12-09T20:47:57.555 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:57.357+0000 32d84700 -1 osd.5 616 build_incremental_map_msg missing incremental map 616 2019-12-09T20:47:57.623 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:57.445+0000 3758d700 -1 osd.5 616 build_incremental_map_msg missing incremental map 616 2019-12-09T20:47:57.811 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:47:57.584+0000 3658b700 -1 osd.5 616 build_incremental_map_msg missing incremental map 616 2019-12-09T20:48:52.434 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:43:13.492 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:48:52.444 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:43:13.503 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:48:52.450 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:43:13.485 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:48:52.453 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:43:13.512 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:48:52.460 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:43:13.494 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:48:52.466 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:43:13.520 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:48:52.709 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:43:13.767 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:48:52.785 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:43:13.844 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:48:52.821 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:43:13.854 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:48:56.693 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:48:56.690+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:48:57.742 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:48:57.738+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:48:57.873 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:48:57.868+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:48:57.873 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:48:57.869+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:48:58.787 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:48:58.784+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:48:58.837 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:48:58.833+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:48:58.896 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:48:58.892+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:48:59.137 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:48:59.133+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:48:59.774 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:48:59.768+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:48:59.816 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:48:59.812+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:48:59.836 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:48:59.833+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:48:59.878 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:48:59.874+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:00.152 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:00.150+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:00.781 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:00.776+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:00.807 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:00.803+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:00.856 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:00.852+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:00.868 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:00.863+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:01.167 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:01.162+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:01.618 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:01.614+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:01.744 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:01.739+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:01.837 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:01.833+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:01.843 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:01.839+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:01.858 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:01.853+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:02.129 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:02.125+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:02.397 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:02.394+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:02.604 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:02.600+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:02.703 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:02.699+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:02.818 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:02.814+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:02.831 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:02.828+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:02.833 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:02.829+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:03.151 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:03.147+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:03.401 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:03.396+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:03.593 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:03.590+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:03.749 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:03.746+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:03.820 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:03.814+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:03.869 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:03.866+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:03.878 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:03.873+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:04.143 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:04.139+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:04.422 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:04.418+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:04.564 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:04.558+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:04.722 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:04.718+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:04.834 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:04.830+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:04.845 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:04.841+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:04.852 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:04.846+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:05.115 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:05.111+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:05.397 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:05.391+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:05.597 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:05.588+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:05.748 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:05.743+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:05.827 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:05.823+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:05.868 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:05.863+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:05.873 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:05.869+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:06.154 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:06.151+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:06.421 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:06.417+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:06.635 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:06.630+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:06.791 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:06.787+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:06.812 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:06.808+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:06.824 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:06.820+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:06.866 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:06.857+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:07.146 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:07.141+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:07.438 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:07.433+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:07.629 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:07.625+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:07.756 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:07.751+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:07.779 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:07.774+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:07.859 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:07.855+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:07.909 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:07.904+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:08.142 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:08.138+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:08.470 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:08.465+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:08.650 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:08.645+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:08.771 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:08.766+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:08.808 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:08.804+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:08.904 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:08.899+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:08.906 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:08.902+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:09.139 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:09.132+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:09.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:09.476+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:09.563 INFO:tasks.ceph.osd.6.smithi194.stderr:*** Caught signal (Segmentation fault) ** 2019-12-09T20:49:09.563 INFO:tasks.ceph.osd.6.smithi194.stderr: in thread 11caf700 thread_name:msgr-worker-1 2019-12-09T20:49:09.679 INFO:tasks.ceph.osd.6.smithi194.stderr: ceph version 15.0.0-7900-g1351c81 (1351c819e1a9518cde4c8b12d645782009028360) octopus (dev) 2019-12-09T20:49:09.680 INFO:tasks.ceph.osd.6.smithi194.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-09T20:49:09.680 INFO:tasks.ceph.osd.6.smithi194.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-09T20:49:09.680 INFO:tasks.ceph.osd.6.smithi194.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-09T20:49:09.680 INFO:tasks.ceph.osd.6.smithi194.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-09T20:49:09.680 INFO:tasks.ceph.osd.6.smithi194.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-09T20:49:09.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-09T20:49:09.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-09T20:49:09.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-09T20:49:09.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-09T20:49:09.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-09T20:49:09.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-09T20:49:09.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-09T20:49:09.682 INFO:tasks.ceph.osd.6.smithi194.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-09T20:49:09.690 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:09.684+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:09.736 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:09.732+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:09.822 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:09.816+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:09.935 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:09.931+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:09.942 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:09.939+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:10.193 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:10.184+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:10.497 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:10.493+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:10.665 INFO:tasks.ceph.osd.6.smithi194.stderr:2019-12-09T20:49:09.980+0000 11caf700 -1 *** Caught signal (Segmentation fault) ** 2019-12-09T20:49:10.665 INFO:tasks.ceph.osd.6.smithi194.stderr: in thread 11caf700 thread_name:msgr-worker-1 2019-12-09T20:49:10.665 INFO:tasks.ceph.osd.6.smithi194.stderr: 2019-12-09T20:49:10.665 INFO:tasks.ceph.osd.6.smithi194.stderr: ceph version 15.0.0-7900-g1351c81 (1351c819e1a9518cde4c8b12d645782009028360) octopus (dev) 2019-12-09T20:49:10.665 INFO:tasks.ceph.osd.6.smithi194.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-09T20:49:10.666 INFO:tasks.ceph.osd.6.smithi194.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-09T20:49:10.666 INFO:tasks.ceph.osd.6.smithi194.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-09T20:49:10.666 INFO:tasks.ceph.osd.6.smithi194.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-09T20:49:10.666 INFO:tasks.ceph.osd.6.smithi194.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-09T20:49:10.666 INFO:tasks.ceph.osd.6.smithi194.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-09T20:49:10.666 INFO:tasks.ceph.osd.6.smithi194.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-09T20:49:10.666 INFO:tasks.ceph.osd.6.smithi194.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-09T20:49:10.667 INFO:tasks.ceph.osd.6.smithi194.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-09T20:49:10.667 INFO:tasks.ceph.osd.6.smithi194.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-09T20:49:10.667 INFO:tasks.ceph.osd.6.smithi194.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-09T20:49:10.667 INFO:tasks.ceph.osd.6.smithi194.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-09T20:49:10.667 INFO:tasks.ceph.osd.6.smithi194.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-09T20:49:10.667 INFO:tasks.ceph.osd.6.smithi194.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-09T20:49:10.667 INFO:tasks.ceph.osd.6.smithi194.stderr: 2019-12-09T20:49:10.668 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:10.658+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:10.733 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:10.728+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:10.785 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:10.781+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:10.911 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:10.907+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:10.983 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:10.980+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:11.241 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:11.236+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:11.307 INFO:tasks.ceph.osd.6.smithi194.stderr: -1162> 2019-12-09T20:49:09.980+0000 11caf700 -1 *** Caught signal (Segmentation fault) ** 2019-12-09T20:49:11.308 INFO:tasks.ceph.osd.6.smithi194.stderr: in thread 11caf700 thread_name:msgr-worker-1 2019-12-09T20:49:11.308 INFO:tasks.ceph.osd.6.smithi194.stderr: 2019-12-09T20:49:11.308 INFO:tasks.ceph.osd.6.smithi194.stderr: ceph version 15.0.0-7900-g1351c81 (1351c819e1a9518cde4c8b12d645782009028360) octopus (dev) 2019-12-09T20:49:11.308 INFO:tasks.ceph.osd.6.smithi194.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-09T20:49:11.308 INFO:tasks.ceph.osd.6.smithi194.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-09T20:49:11.308 INFO:tasks.ceph.osd.6.smithi194.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-09T20:49:11.309 INFO:tasks.ceph.osd.6.smithi194.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-09T20:49:11.309 INFO:tasks.ceph.osd.6.smithi194.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-09T20:49:11.309 INFO:tasks.ceph.osd.6.smithi194.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-09T20:49:11.309 INFO:tasks.ceph.osd.6.smithi194.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-09T20:49:11.309 INFO:tasks.ceph.osd.6.smithi194.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-09T20:49:11.309 INFO:tasks.ceph.osd.6.smithi194.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-09T20:49:11.309 INFO:tasks.ceph.osd.6.smithi194.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-09T20:49:11.309 INFO:tasks.ceph.osd.6.smithi194.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-09T20:49:11.310 INFO:tasks.ceph.osd.6.smithi194.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-09T20:49:11.310 INFO:tasks.ceph.osd.6.smithi194.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-09T20:49:11.310 INFO:tasks.ceph.osd.6.smithi194.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-09T20:49:11.310 INFO:tasks.ceph.osd.6.smithi194.stderr: 2019-12-09T20:49:11.529 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:11.525+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:11.679 INFO:tasks.ceph.osd.6.smithi194.stderr: -1189> 2019-12-09T20:49:09.980+0000 11caf700 -1 *** Caught signal (Segmentation fault) ** 2019-12-09T20:49:11.679 INFO:tasks.ceph.osd.6.smithi194.stderr: in thread 11caf700 thread_name:msgr-worker-1 2019-12-09T20:49:11.679 INFO:tasks.ceph.osd.6.smithi194.stderr: 2019-12-09T20:49:11.679 INFO:tasks.ceph.osd.6.smithi194.stderr: ceph version 15.0.0-7900-g1351c81 (1351c819e1a9518cde4c8b12d645782009028360) octopus (dev) 2019-12-09T20:49:11.680 INFO:tasks.ceph.osd.6.smithi194.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-09T20:49:11.680 INFO:tasks.ceph.osd.6.smithi194.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-09T20:49:11.680 INFO:tasks.ceph.osd.6.smithi194.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-09T20:49:11.680 INFO:tasks.ceph.osd.6.smithi194.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-09T20:49:11.680 INFO:tasks.ceph.osd.6.smithi194.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-09T20:49:11.680 INFO:tasks.ceph.osd.6.smithi194.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-09T20:49:11.680 INFO:tasks.ceph.osd.6.smithi194.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-09T20:49:11.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-09T20:49:11.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-09T20:49:11.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-09T20:49:11.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-09T20:49:11.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-09T20:49:11.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-09T20:49:11.681 INFO:tasks.ceph.osd.6.smithi194.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-09T20:49:11.681 INFO:tasks.ceph.osd.6.smithi194.stderr: 2019-12-09T20:49:11.712 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:11.707+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:11.752 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:11.748+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:11.793 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:11.788+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:11.907 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:11.903+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:12.016 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:12.011+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:12.221 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:12.216+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:12.530 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:12.523+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:12.691 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:12.687+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:12.772 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:12.767+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:12.780 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:12.776+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:12.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:12.920+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:12.987 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:12.983+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:13.199 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:13.194+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:13.503 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:13.498+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:13.737 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:13.732+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:13.773 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:49:13.769+0000 1694f700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:15.894388+0000 front 2019-12-09T20:48:15.896831+0000 (oldest deadline 2019-12-09T20:48:56.073361+0000) 2019-12-09T20:49:13.804 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:49:13.799+0000 1694f700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.586799+0000 front 2019-12-09T20:48:15.865111+0000 (oldest deadline 2019-12-09T20:48:59.448955+0000) 2019-12-09T20:49:13.912 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:49:13.908+0000 1694f700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:17.195124+0000 front 2019-12-09T20:48:14.614379+0000 (oldest deadline 2019-12-09T20:48:57.161849+0000) 2019-12-09T20:49:14.011 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:49:14.007+0000 1694f700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207154+0000 front 2019-12-09T20:48:13.185123+0000 (oldest deadline 2019-12-09T20:48:57.126435+0000) 2019-12-09T20:49:14.209 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:49:14.205+0000 1694f700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:13.207440+0000 front 2019-12-09T20:48:13.320499+0000 (oldest deadline 2019-12-09T20:48:58.499382+0000) 2019-12-09T20:49:14.505 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:49:14.500+0000 1694f700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:16.955790+0000 front 2019-12-09T20:48:16.996446+0000 (oldest deadline 2019-12-09T20:49:02.212045+0000) 2019-12-09T20:49:14.752 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:49:14.748+0000 1694f700 -1 osd.0 618 heartbeat_check: no reply from 172.21.15.194:6820 osd.6 since back 2019-12-09T20:48:09.338605+0000 front 2019-12-09T20:48:09.641484+0000 (oldest deadline 2019-12-09T20:49:00.732495+0000) 2019-12-09T20:49:14.881 INFO:tasks.ceph.osd.6.smithi194.stderr:daemon-helper: command crashed with signal 11 2019-12-09T20:49:15.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2019-12-09T20:49:21.246 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:43:42.304 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:21.258 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:43:42.317 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:21.294 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:43:42.353 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:21.305 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:43:42.364 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:21.313 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:43:42.347 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:21.318 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:43:42.377 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:21.320 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:43:42.355 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:21.362 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:43:42.421 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:21.383 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:43:42.418 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:22.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~6s 2019-12-09T20:49:28.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~13s 2019-12-09T20:49:34.685 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~19s 2019-12-09T20:49:41.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~25s 2019-12-09T20:49:47.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~32s 2019-12-09T20:49:53.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~38s 2019-12-09T20:49:59.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~44s 2019-12-09T20:50:06.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~50s 2019-12-09T20:50:12.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~57s 2019-12-09T20:50:13.472 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:13.466+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:13.588 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:13.582+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:14.379 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:14.374+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:14.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:14.420+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:14.584 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:14.578+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:15.394 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:15.389+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:15.430 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:15.427+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:15.543 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:15.539+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:15.546 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:15.539+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:16.406 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:16.402+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:16.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:16.412+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:16.523 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:16.518+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:16.568 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:16.562+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:17.456 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:17.452+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:17.459 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:17.454+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:17.554 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:17.550+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:17.585 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:17.580+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:18.474 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:18.470+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:18.480 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:18.476+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:18.521 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:18.515+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:18.548 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:18.543+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:18.553 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:18.548+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:18.879 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~63s 2019-12-09T20:50:19.468 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:19.464+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:19.487 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:19.480+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:19.519 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:19.515+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:19.520 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:19.517+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:19.563 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:19.557+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:20.459 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:20.454+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:20.500 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:20.495+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:20.508 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:20.503+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:20.534 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:20.529+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:20.614 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:20.610+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:21.433 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:21.429+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:21.498 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:21.493+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:21.535 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:21.531+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:21.553 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:21.549+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:21.611 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:21.606+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:22.393 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:22.389+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:22.514 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:22.509+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:22.546 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:22.541+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:22.558 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:22.552+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:22.636 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:22.631+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:23.361 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:23.357+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:23.501 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:23.496+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:23.524 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:23.511+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:23.548 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:23.543+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:23.603 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:23.598+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:24.383 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:24.378+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:24.454 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:24.449+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:24.529 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:24.524+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:24.545 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:24.540+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:24.610 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:24.604+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:25.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~69s 2019-12-09T20:50:25.385 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:25.381+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:25.465 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:25.460+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:25.487 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:25.482+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:25.546 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:25.540+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:25.572 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:25.567+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:26.365 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:26.361+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:26.474 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:26.470+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:26.504 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:26.500+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:26.543 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:26.540+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:26.597 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:26.591+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:27.365 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:27.360+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:27.463 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:27.458+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:27.505 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:27.501+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:27.513 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:27.508+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:27.614 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:27.609+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:28.365 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:28.360+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:28.469 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:28.462+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:28.508 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:28.503+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:28.512 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:28.506+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:28.573 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:28.567+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:29.416 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:29.409+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:29.470 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:29.464+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:29.477 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:29.473+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:29.486 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:29.479+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:29.553 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:29.548+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:30.413 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:30.409+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:30.494 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:30.488+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:30.505 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:30.501+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:30.521 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:30.515+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:30.547 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:30.541+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:31.390 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:31.384+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:31.482 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:31.478+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:31.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~76s 2019-12-09T20:50:31.557 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:31.551+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:31.561 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:31.556+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:31.584 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:31.578+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:32.437 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:32.431+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:32.532 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:32.527+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:32.565 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:32.560+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:32.579 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:32.575+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:32.613 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:32.608+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:33.421 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:33.419+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:33.565 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:33.561+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:33.588 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:33.583+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:33.604 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:33.599+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:33.625 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:33.620+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:34.436 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:34.433+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:34.550 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:34.547+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:34.562 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:34.558+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:34.588 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:34.583+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:34.636 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:34.632+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:35.479 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:35.474+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:35.518 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:35.514+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:35.616 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:35.611+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:35.623 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:35.617+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:35.665 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:35.660+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:36.483 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:36.479+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:36.532 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:36.529+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:36.610 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:36.605+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:36.633 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:36.628+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:36.695 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:36.693+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:37.454 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:37.451+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:37.508 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:37.505+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:37.585 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:37.579+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:37.658 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:37.653+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:37.662 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:37.657+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:37.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~82s 2019-12-09T20:50:38.449 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:38.445+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:38.511 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:38.507+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:38.561 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:38.556+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:38.681 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:38.675+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:38.682 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:38.679+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:39.426 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:39.420+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:39.531 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:39.525+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:39.535 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:39.531+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:39.657 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:39.652+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:39.686 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:39.682+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:40.432 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:40.429+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:40.514 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:40.509+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:40.527 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:40.523+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:40.650 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:40.644+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:40.657 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:50:40.652+0000 1694f700 -1 osd.3 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.522422+0000 front 2019-12-09T20:49:29.511499+0000 (oldest deadline 2019-12-09T20:50:13.343774+0000) 2019-12-09T20:50:41.441 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:50:41.438+0000 1694f700 -1 osd.2 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.306530+0000 front 2019-12-09T20:49:29.510796+0000 (oldest deadline 2019-12-09T20:50:13.850504+0000) 2019-12-09T20:50:41.507 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:50:41.502+0000 1694f700 -1 osd.1 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:29.834957+0000 front 2019-12-09T20:49:29.838583+0000 (oldest deadline 2019-12-09T20:50:13.002360+0000) 2019-12-09T20:50:41.566 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:50:41.551+0000 1694f700 -1 osd.4 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:30.174713+0000 front 2019-12-09T20:49:30.164076+0000 (oldest deadline 2019-12-09T20:50:15.427565+0000) 2019-12-09T20:50:41.677 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:50:41.672+0000 1694f700 -1 osd.5 620 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:49:31.794611+0000 front 2019-12-09T20:49:31.624249+0000 (oldest deadline 2019-12-09T20:50:17.502709+0000) 2019-12-09T20:50:44.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~88s 2019-12-09T20:50:50.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~95s 2019-12-09T20:50:56.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~101s 2019-12-09T20:51:03.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~107s 2019-12-09T20:51:09.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~114s 2019-12-09T20:51:15.715 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~120s 2019-12-09T20:51:22.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~126s 2019-12-09T20:51:28.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~133s 2019-12-09T20:51:34.657 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~139s 2019-12-09T20:51:35.683 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:51:35.668+0000 3378a700 -1 osd.0 626 build_incremental_map_msg missing incremental map 626 2019-12-09T20:51:35.785 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:51:35.691+0000 35f8f700 -1 osd.0 626 build_incremental_map_msg missing incremental map 626 2019-12-09T20:51:35.807 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:51:35.698+0000 31f87700 -1 osd.0 626 build_incremental_map_msg missing incremental map 626 2019-12-09T20:51:36.008 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:51:35.994+0000 3478c700 -1 osd.0 626 build_incremental_map_msg missing incremental map 626 2019-12-09T20:51:36.252 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:51:36.208+0000 33f8b700 -1 osd.0 626 build_incremental_map_msg missing incremental map 626 2019-12-09T20:51:36.258 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:51:36.240+0000 37f93700 -1 osd.0 626 build_incremental_map_msg missing incremental map 626 2019-12-09T20:51:37.500 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T20:51:37.472+0000 20e25700 -1 RGWWatcher::handle_error cookie 385731248 err (107) Transport endpoint is not connected 2019-12-09T20:51:39.675 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:51:39.612+0000 36f91700 -1 osd.0 626 build_incremental_map_msg missing incremental map 626 2019-12-09T20:51:40.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~145s 2019-12-09T20:51:47.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~152s 2019-12-09T20:51:53.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~158s 2019-12-09T20:51:59.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~164s 2019-12-09T20:52:06.220 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~170s 2019-12-09T20:52:12.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~177s 2019-12-09T20:52:18.838 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~183s 2019-12-09T20:52:25.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~189s 2019-12-09T20:52:31.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~196s 2019-12-09T20:52:31.525 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:31.519+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:32.536 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:32.530+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:33.219 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:33.214+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:33.467 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:33.460+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:33.558 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:33.553+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:34.059 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:34.054+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:34.204 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:34.199+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:34.499 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:34.494+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:34.518 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:34.514+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:35.053 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:35.049+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:35.117 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:35.110+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:35.241 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:35.236+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:35.485 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:35.479+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:35.540 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:35.535+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:36.024 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:36.019+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:36.088 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:36.082+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:36.215 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:36.208+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:36.228 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:36.224+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:36.470 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:36.461+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:36.537 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:36.530+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:37.046 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:37.040+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:37.055 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:37.049+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:37.230 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:37.225+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:37.271 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:37.265+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:37.501 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:37.497+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:37.506 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:37.501+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:37.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~202s 2019-12-09T20:52:38.051 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:38.044+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:38.100 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:38.094+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:38.264 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:38.260+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:38.280 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:38.275+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:38.477 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:38.473+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:38.525 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:38.521+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:39.077 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:39.069+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:39.126 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:39.122+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:39.243 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:39.239+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:39.280 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:39.275+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:39.501 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:39.496+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:39.571 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:39.566+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:40.080 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:40.075+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:40.149 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:40.143+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:40.241 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:40.235+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:40.290 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:40.285+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:40.521 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:40.517+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:40.589 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:40.578+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:41.098 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:41.092+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:41.147 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:41.144+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:41.268 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:41.261+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:41.296 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:41.291+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:41.503 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:41.499+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:41.565 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:41.560+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:42.050 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:42.046+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:42.180 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:42.176+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:42.252 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:42.246+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:42.300 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:42.296+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:42.458 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:42.454+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:42.532 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:42.528+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:43.019 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:43.015+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:43.182 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:43.177+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:43.256 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:43.251+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:43.295 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:43.291+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:43.430 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:43.426+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:43.583 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:43.577+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:44.053 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:44.048+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:44.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~208s 2019-12-09T20:52:44.190 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:44.186+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:44.257 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:44.252+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:44.266 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:44.261+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:44.387 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:44.384+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:44.634 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:44.630+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:45.054 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:45.050+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:45.193 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:45.189+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:45.234 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:45.229+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:45.292 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:45.283+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:45.427 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:45.421+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:45.604 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:45.591+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:46.079 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:46.069+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:46.149 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:46.146+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:46.239 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:46.236+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:46.295 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:46.289+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:46.398 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:46.394+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:46.582 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:46.577+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:47.079 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:47.075+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:47.124 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:47:08.183 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:52:47.194 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:47:08.253 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:52:47.200 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:47.196+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:47.214 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:47:08.273 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:52:47.243 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:47:08.302 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:52:47.249 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:47.244+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:47.257 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:47.251+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:47.299 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:47:08.334 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:52:47.304 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:47:08.340 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:52:47.375 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:47:08.434 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:52:47.432 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:47.429+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:47.432 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:47:08.491 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:52:47.503 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:47:08.538 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:52:47.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:47.563+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:48.063 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:48.057+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:48.240 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:48.237+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:48.248 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:48.242+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:48.260 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:48.256+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:48.414 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:48.410+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:48.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:48.572+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:49.056 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:49.052+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:49.212 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:49.209+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:49.217 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:49.214+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:49.298 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:49.289+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:49.411 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:49.409+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:49.626 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:49.620+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:50.064 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:50.059+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:50.182 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:50.178+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:50.227 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:50.222+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:50.308 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:50.304+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:50.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~215s 2019-12-09T20:52:50.459 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:50.456+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:50.593 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:50.587+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:51.076 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:51.071+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:51.151 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:51.146+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:51.255 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:51.247+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:51.315 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:51.310+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:51.479 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:51.475+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:51.553 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:51.547+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:52.088 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:52.083+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:52.187 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:52.183+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:52.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:52.248+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:52.287 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:52.283+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:52.442 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:52.439+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:52.604 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:52.599+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:53.063 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:53.057+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:53.187 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:53.183+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:53.262 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:53.256+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:53.338 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:53.332+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:53.419 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:53.414+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:53.593 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:53.587+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:54.047 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:54.043+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:54.231 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:54.228+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:54.286 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:54.281+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:54.314 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:54.311+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:54.438 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:54.434+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:54.587 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:54.582+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:55.076 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:55.070+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:55.198 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:55.194+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:55.257 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:55.252+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:55.312 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:55.306+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:55.446 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:55.442+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:55.634 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:55.629+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:56.110 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:56.105+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:56.183 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:56.179+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:56.235 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:56.229+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:56.359 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:56.356+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:56.419 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:56.415+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:56.691 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:56.685+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:56.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~221s 2019-12-09T20:52:57.101 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:57.096+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:57.179 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:57.175+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:57.234 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:57.230+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:57.397 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:57.392+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:57.446 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:57.443+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:57.737 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:57.730+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:58.153 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:58.145+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:58.158 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:58.153+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:58.224 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:58.219+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:58.415 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:58.411+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:58.455 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:58.452+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:58.744 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:58.739+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:52:59.128 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:52:59.124+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:52:59.193 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:52:59.188+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:52:59.198 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:52:59.194+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:52:59.428 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:52:59.422+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:52:59.436 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:52:59.432+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:52:59.756 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:52:59.751+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:53:00.132 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:53:00.129+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:53:00.205 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:53:00.200+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:53:00.238 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:53:00.232+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:53:00.427 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:53:00.414+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:53:00.461 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:53:00.458+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:53:00.803 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:53:00.798+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:53:01.117 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:53:01.113+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:53:01.211 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:53:01.205+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:53:01.273 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:53:01.267+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:53:01.400 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:53:01.396+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:53:01.491 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:53:01.488+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:53:01.855 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:53:01.849+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:53:02.152 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:53:02.149+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:53:02.223 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:53:02.218+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:53:02.233 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:53:02.228+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:53:02.401 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:53:02.397+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:53:02.493 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:53:02.489+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:53:02.880 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:53:02.875+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:53:03.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~227s 2019-12-09T20:53:03.131 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:53:03.127+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:53:03.199 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:53:03.194+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:53:03.243 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:53:03.238+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:53:03.365 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:53:03.362+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:53:03.517 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:53:03.512+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:53:03.904 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:53:03.899+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:53:04.146 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:53:04.142+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:53:04.200 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:53:04.195+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:53:04.242 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:53:04.237+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:53:04.413 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:53:04.409+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:53:04.494 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:53:04.491+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:53:04.923 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:53:04.917+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:53:05.118 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:53:05.115+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:53:05.197 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:53:05.191+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:53:05.270 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:53:05.264+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:53:05.400 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:53:05.394+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:53:05.449 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:53:05.445+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:53:05.965 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:53:05.961+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:53:06.137 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:53:06.133+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:53:06.166 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:53:06.161+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:53:06.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:53:06.221+0000 1694f700 -1 osd.7 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:51.017261+0000 front 2019-12-09T20:51:50.249210+0000 (oldest deadline 2019-12-09T20:52:36.134214+0000) 2019-12-09T20:53:06.434 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:53:06.430+0000 1694f700 -1 osd.3 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.894935+0000 front 2019-12-09T20:51:49.958046+0000 (oldest deadline 2019-12-09T20:52:30.942000+0000) 2019-12-09T20:53:06.492 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:53:06.487+0000 1694f700 -1 osd.2 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:48.206084+0000 front 2019-12-09T20:51:49.043274+0000 (oldest deadline 2019-12-09T20:52:33.396076+0000) 2019-12-09T20:53:06.938 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:53:06.932+0000 1694f700 -1 osd.5 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.999906+0000 front 2019-12-09T20:51:50.269827+0000 (oldest deadline 2019-12-09T20:52:32.891228+0000) 2019-12-09T20:53:07.076 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:53:07.070+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e626 v626) 2019-12-09T20:53:07.146 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:53:07.142+0000 1694f700 -1 osd.1 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:46.402375+0000 front 2019-12-09T20:51:46.480409+0000 (oldest deadline 2019-12-09T20:52:32.226629+0000) 2019-12-09T20:53:07.195 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:53:07.184+0000 1694f700 -1 osd.4 626 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:51:49.259952+0000 front 2019-12-09T20:51:49.343182+0000 (oldest deadline 2019-12-09T20:52:34.388800+0000) 2019-12-09T20:53:08.489 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:47:29.548 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:08.492 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:47:29.551 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:08.500 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:47:29.559 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:08.504 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:47:29.563 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:08.522 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:47:29.557 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:08.532 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:47:29.567 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:08.537 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:47:29.596 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:08.549 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:47:29.608 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:08.671 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:47:29.706 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:09.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~234s 2019-12-09T20:53:15.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~240s 2019-12-09T20:53:21.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~246s 2019-12-09T20:53:28.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~253s 2019-12-09T20:53:34.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~259s 2019-12-09T20:53:40.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~265s 2019-12-09T20:53:47.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~271s 2019-12-09T20:53:51.812 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:53:51.727+0000 32788700 -1 osd.3 630 build_incremental_map_msg missing incremental map 630 2019-12-09T20:53:52.005 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:53:51.952+0000 36f91700 -1 osd.3 630 build_incremental_map_msg missing incremental map 630 2019-12-09T20:53:53.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~278s 2019-12-09T20:53:55.749 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T20:53:55.722+0000 20e25700 -1 RGWWatcher::handle_error cookie 5433787280 err (107) Transport endpoint is not connected 2019-12-09T20:53:59.861 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~284s 2019-12-09T20:54:06.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~290s 2019-12-09T20:54:12.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~297s 2019-12-09T20:54:18.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~303s 2019-12-09T20:54:18.804 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2019-12-09T20:54:18.804 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa/tasks/daemonwatchdog.py", line 38, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa/tasks/daemonwatchdog.py", line 114, in watch self.bark() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa/tasks/daemonwatchdog.py", line 54, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 253, in __getattr__ raise AttributeError(name) AttributeError: mounts 2019-12-09T20:54:51.434 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:54:51.429+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:54:52.433 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:54:52.428+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:54:52.442 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:54:52.438+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:54:52.780 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:54:52.776+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:54:53.400 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:54:53.397+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:54:53.451 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:54:53.444+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:54:53.597 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:54:53.593+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:54:53.781 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:54:53.776+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:54:54.398 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:54:54.393+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:54:54.416 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:54:54.411+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:54:54.603 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:54:54.599+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:54:54.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:54:54.614+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:54:54.822 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:54:54.820+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:54:55.373 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:54:55.369+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:54:55.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:54:55.450+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:54:55.615 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:54:55.609+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:54:55.651 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:54:55.648+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:54:55.857 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:54:55.850+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:54:56.289 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:54:56.283+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:54:56.362 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:54:56.358+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:54:56.450 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:54:56.444+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:54:56.588 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:54:56.583+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:54:56.677 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:54:56.672+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:54:56.821 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:54:56.817+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:54:57.335 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:54:57.324+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:54:57.373 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:54:57.370+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:54:57.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:54:57.492+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:54:57.555 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:54:57.551+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:54:57.665 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:54:57.662+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:54:57.804 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:54:57.800+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:54:58.364 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:54:58.360+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:54:58.366 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:54:58.361+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:54:58.489 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:54:58.485+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:54:58.532 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:54:58.527+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:54:58.619 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:54:58.615+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:54:58.789 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:54:58.784+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:54:59.387 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:54:59.381+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:54:59.417 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:54:59.412+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:54:59.533 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:54:59.527+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:54:59.540 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:54:59.535+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:54:59.665 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:54:59.661+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:54:59.814 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:54:59.810+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:00.379 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:00.375+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:00.441 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:00.433+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:00.531 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:00.526+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:00.586 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:00.581+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:00.700 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:00.697+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:00.857 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:00.853+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:01.337 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:01.334+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:01.417 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:01.412+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:01.485 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:01.481+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:01.574 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:01.567+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:01.683 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:01.680+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:01.847 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:01.843+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:02.385 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:02.376+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:02.409 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:02.401+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:02.507 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:02.497+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:02.608 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:02.602+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:02.735 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:02.731+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:02.809 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:02.804+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:03.356 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:03.345+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:03.410 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:03.404+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:03.556 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:03.551+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:03.594 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:03.587+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:03.728 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:03.723+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:03.799 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:03.793+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:04.389 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:04.386+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:04.436 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:04.430+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:04.585 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:04.579+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:04.610 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:04.605+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:04.750 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:04.746+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:04.779 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:04.775+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:05.420 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:05.415+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:05.447 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:05.441+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:05.545 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:05.541+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:05.616 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:05.605+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:05.789 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:05.786+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:05.799 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:05.796+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:06.430 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:06.425+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:06.464 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:06.462+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:06.567 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:06.562+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:06.579 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:06.573+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:06.802 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:06.799+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:06.827 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:06.823+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:07.476 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:07.470+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:07.480 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:07.477+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:07.540 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:07.536+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:07.620 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:07.613+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:07.815 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:07.811+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:07.848 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:07.845+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:08.449 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:08.444+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:08.509 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:08.505+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:08.592 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:08.587+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:08.643 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:08.638+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:08.807 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:08.804+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:08.866 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:08.863+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:09.495 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:09.490+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:09.547 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:09.544+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:09.601 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:09.596+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:09.664 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:09.658+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:09.796 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:09.792+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:09.865 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:09.861+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:10.515 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:10.511+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:10.530 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:10.525+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:10.577 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:10.572+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:10.644 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:10.639+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:10.836 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:10.831+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:10.899 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:10.894+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:11.514 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:11.511+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:11.581 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:11.576+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:11.631 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:11.626+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:11.671 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:11.666+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:11.848 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:11.843+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:11.901 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:11.898+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:12.491 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:12.489+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:12.591 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:12.586+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:12.618 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:12.612+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:12.638 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:12.634+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:12.866 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:12.863+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:12.888 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:12.885+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:13.472 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:13.468+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:13.622 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:13.618+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:13.640 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:13.636+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:13.682 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:13.678+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:13.899 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:13.894+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:13.926 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:13.922+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:14.463 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:14.459+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:14.637 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:14.624+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:14.637 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:14.625+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:14.670 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:14.665+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:14.880 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:14.876+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:14.907 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:14.903+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:15.484 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:15.480+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:15.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:15.664+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:15.681 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:15.676+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:15.687 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:15.683+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:15.898 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:15.895+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:15.900 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:15.897+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:16.475 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:16.472+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:16.638 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:16.633+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:16.649 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:16.644+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:16.697 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:16.692+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:16.873 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:16.868+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:16.925 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:16.922+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:17.444 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:17.439+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:17.660 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:17.654+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:17.691 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:17.687+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:17.736 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:17.731+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:17.828 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:17.824+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:17.907 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:17.901+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:18.492 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:18.488+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:18.654 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:18.649+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:18.710 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:18.705+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:18.785 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:18.780+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:18.819 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:18.815+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:18.924 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:18.920+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:19.509 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:19.506+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:19.628 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:19.624+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:19.769 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:19.763+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:19.791 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:19.786+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:19.816 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:19.811+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:19.970 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:19.966+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:20.547 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:20.543+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:20.594 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:20.589+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:20.748 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:20.743+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:20.766 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:20.761+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:20.855 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:20.851+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:20.932 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:20.929+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:21.543 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:21.540+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:21.567 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:21.563+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:21.786 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:21.772+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:21.814 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:21.808+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:21.886 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:21.883+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:21.938 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:21.935+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:22.543 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:22.539+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:22.565 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:22.562+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:22.766 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:22.760+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:22.814 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:22.808+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:22.911 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:22.908+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:22.926 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:22.922+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:23.576 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:23.565+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:23.577 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:23.568+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:23.774 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:23.769+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:23.813 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:23.808+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:23.942 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:23.938+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:23.946 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:23.941+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:24.604 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:24.601+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:24.616 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:24.607+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:24.818 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:24.813+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:24.868 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:24.858+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:24.920 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:24.917+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:24.944 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:24.941+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:25.593 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:25.589+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:25.606 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:25.603+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:25.825 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:25.821+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:25.890 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:25.884+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:25.934 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:25.930+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:25.954 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:25.950+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:26.571 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:26.566+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:55:26.598 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:55:26.593+0000 1694f700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:06.162191+0000 front 2019-12-09T20:54:06.190622+0000 (oldest deadline 2019-12-09T20:54:52.061481+0000) 2019-12-09T20:55:26.871 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:55:26.866+0000 1694f700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.140002+0000 front 2019-12-09T20:54:08.235557+0000 (oldest deadline 2019-12-09T20:54:53.989503+0000) 2019-12-09T20:55:26.878 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:55:26.874+0000 1694f700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:07.725587+0000 front 2019-12-09T20:54:07.389833+0000 (oldest deadline 2019-12-09T20:54:56.158935+0000) 2019-12-09T20:55:26.912 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:55:26.908+0000 1694f700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:10.724294+0000 front 2019-12-09T20:54:10.716895+0000 (oldest deadline 2019-12-09T20:54:52.393859+0000) 2019-12-09T20:55:26.963 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:55:26.959+0000 1694f700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:09.552347+0000 front 2019-12-09T20:54:09.556999+0000 (oldest deadline 2019-12-09T20:54:52.924758+0000) 2019-12-09T20:55:27.476 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:55:27.473+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e631 v631) 2019-12-09T20:55:27.574 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:55:27.545+0000 1694f700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:54:08.113285+0000 front 2019-12-09T20:54:08.235684+0000 (oldest deadline 2019-12-09T20:54:50.865626+0000) 2019-12-09T20:56:11.408 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:56:11.373+0000 36790700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-12-09T20:56:11.440 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:56:11.387+0000 31786700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-12-09T20:56:11.795 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:56:11.764+0000 3578e700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-12-09T20:56:11.836 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:56:11.820+0000 32f89700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-12-09T20:56:12.056 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:56:12.053+0000 38f95700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-12-09T20:56:14.447 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:56:14.420+0000 34f8d700 -1 osd.0 637 build_incremental_map_msg missing incremental map 636 2019-12-09T20:56:16.440 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T20:56:16.379+0000 20e25700 -1 RGWWatcher::handle_error cookie 5447052368 err (107) Transport endpoint is not connected 2019-12-09T20:57:10.996 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:10.990+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:11.289 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:11.285+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:11.961 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:11.956+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:12.320 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:12.316+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:12.978 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:12.972+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:13.336 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:13.332+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:13.764 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:13.761+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:14.007 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:14.002+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:14.051 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:14.046+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:14.084 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:14.078+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:14.325 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:14.321+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:14.720 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:14.716+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:14.722 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:14.717+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:15.044 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:15.041+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:15.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:15.054+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:15.133 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:15.129+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:15.345 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:15.341+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:15.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:15.673+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:15.709 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:15.702+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:16.016 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:16.011+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:16.032 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:16.027+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:16.133 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:16.124+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:16.357 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:16.354+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:16.643 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:16.640+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:16.725 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:16.722+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:16.982 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:16.974+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:16.999 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:16.994+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:17.107 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:17.100+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:17.321 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:17.319+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:17.647 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:17.643+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:17.740 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:17.737+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:17.949 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:51:39.008 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:17.966 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:51:39.018 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:17.966 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:51:39.025 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:17.969 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:51:39.028 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:17.981 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:51:39.014 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:18.004 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:51:39.039 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:18.012 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:18.007+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:18.047 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:18.042+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:18.079 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:18.075+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:18.245 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:51:39.303 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:18.284 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:51:39.343 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:18.294 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:18.291+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:18.300 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:51:39.335 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:18.662 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:18.658+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:18.696 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:18.694+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:18.991 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:18.987+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:19.048 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:19.044+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:19.121 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:19.115+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:19.270 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:19.266+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:19.641 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:19.638+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:19.733 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:19.731+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:19.993 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:19.988+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:20.014 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:20.009+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:20.076 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:20.070+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:20.236 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:20.234+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:20.640 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:20.636+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:20.737 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:20.734+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:20.992 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:20.986+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:21.009 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:21.004+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:21.058 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:21.053+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:21.240 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:21.237+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:21.597 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:21.594+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:21.767 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:21.763+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:22.026 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:22.021+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:22.029 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:22.025+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:22.057 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:22.053+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:22.243 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:22.240+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:22.573 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:22.570+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:22.752 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:22.747+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:23.007 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:23.002+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:23.068 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:23.063+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:23.090 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:23.086+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:23.288 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:23.285+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:23.557 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:23.552+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:23.757 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:23.754+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:24.001 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:23.993+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:24.043 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:24.038+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:24.130 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:24.125+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:24.310 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:24.307+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:24.513 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:24.510+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:24.735 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:24.731+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:25.005 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:25.000+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:25.034 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:25.029+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:25.154 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:25.149+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:25.289 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:25.283+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:25.516 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:25.509+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:25.769 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:25.765+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:25.983 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:25.978+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:26.034 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:26.028+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:26.177 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:26.172+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:26.289 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:26.286+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:26.551 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:26.547+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:26.820 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:26.815+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:26.943 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:26.938+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:27.009 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:27.000+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:27.161 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:27.156+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:27.264 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:27.259+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:27.547 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:27.542+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:27.862 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:27.857+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:27.993 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:27.985+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:28.025 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:28.019+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:28.161 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:57:28.156+0000 1694f700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:24.585687+0000 front 2019-12-09T20:56:24.571918+0000 (oldest deadline 2019-12-09T20:57:10.432544+0000) 2019-12-09T20:57:28.283 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:28.280+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:28.550 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:28.547+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:28.835 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:28.831+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:29.026 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:29.021+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:29.031 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:29.026+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:29.321 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:29.318+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:29.595 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:29.591+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:29.880 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:29.877+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:29.985 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:29.980+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:30.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:30.052+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:30.344 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:30.340+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:30.657 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:30.644+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:30.913 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:30.910+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:30.978 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:30.975+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:31.024 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:31.020+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:31.355 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:31.351+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:31.608 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:31.604+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:31.948 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:31.946+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:31.949 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:31.944+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:32.000 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:31.994+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:32.379 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:32.376+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:32.635 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:32.631+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:32.912 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:32.907+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:32.955 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:32.951+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:32.966 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:32.961+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:33.352 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:33.348+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:33.635 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:33.632+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:33.940 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:33.935+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:33.942 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:33.937+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:33.951 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:33.946+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:34.338 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:34.334+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:34.623 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:34.619+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:34.956 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:34.951+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:34.965 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:34.959+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:34.987 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:34.983+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:35.377 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:35.373+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:35.618 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:35.615+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:35.923 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:35.912+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:35.984 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:35.978+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:36.033 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:36.029+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:36.404 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:36.401+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:36.650 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:36.646+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:36.912 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:36.907+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:37.003 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:36.992+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:37.085 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:37.081+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:37.361 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:37.357+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:37.675 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:37.671+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:37.942 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:37.930+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:38.030 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:38.025+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:38.130 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:38.126+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:38.339 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:38.334+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:38.642 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:38.639+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:38.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:38.965+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:39.005 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:39.001+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:39.100 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:39.097+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:39.369 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:39.366+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:39.622 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:39.617+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:39.948 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:39.943+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:40.034 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:40.029+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:40.108 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:40.104+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:40.364 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:40.358+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:40.641 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:40.637+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:40.913 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:40.908+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:40.988 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:40.983+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:41.137 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:41.133+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:41.379 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:41.375+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:41.686 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:41.681+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:41.945 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:41.939+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:41.963 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:41.959+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:42.146 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:42.142+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:42.421 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:42.416+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:42.734 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:42.729+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:42.961 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:42.953+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:43.000 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:42.996+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:43.131 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:43.127+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:43.408 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:43.403+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:43.694 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:43.689+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:44.005 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:43.995+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:44.040 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:44.035+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:44.159 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:44.155+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:44.411 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:44.408+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:44.663 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:44.658+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:44.961 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:44.955+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:45.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:45.058+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:45.175 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:45.169+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:45.377 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:45.371+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:45.669 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:45.664+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:45.959 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:45.954+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:46.081 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:46.076+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:46.152 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:46.148+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:46.392 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:46.388+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:46.643 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:46.638+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:46.932 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:46.926+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:57:47.038 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:57:47.034+0000 1694f700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.753770+0000 front 2019-12-09T20:56:28.742191+0000 (oldest deadline 2019-12-09T20:57:13.753841+0000) 2019-12-09T20:57:47.212 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:57:47.200+0000 1694f700 -1 osd.3 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.602246+0000 front 2019-12-09T20:56:28.652108+0000 (oldest deadline 2019-12-09T20:57:14.474726+0000) 2019-12-09T20:57:47.420 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:57:47.416+0000 1694f700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.794633+0000 front 2019-12-09T20:56:27.150063+0000 (oldest deadline 2019-12-09T20:57:11.186789+0000) 2019-12-09T20:57:47.698 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:57:47.685+0000 1694f700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:27.659098+0000 front 2019-12-09T20:56:27.666026+0000 (oldest deadline 2019-12-09T20:57:13.463694+0000) 2019-12-09T20:57:47.933 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:57:47.912+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 49sec e637 v637) 2019-12-09T20:57:47.949 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:57:47.943+0000 1694f700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:56:28.654086+0000 front 2019-12-09T20:56:28.648583+0000 (oldest deadline 2019-12-09T20:57:13.986689+0000) 2019-12-09T20:58:25.753 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:58:25.746+0000 31786700 -1 osd.2 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:25.821 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:58:25.750+0000 34f8d700 -1 osd.1 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:25.918 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:58:25.795+0000 35f8f700 -1 osd.2 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:25.948 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:58:25.796+0000 35f8f700 -1 osd.2 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:25.960 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:58:25.776+0000 3578e700 -1 osd.1 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:26.030 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:58:25.786+0000 30f85700 -1 osd.1 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:26.040 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:58:25.916+0000 37792700 -1 osd.2 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:26.087 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:58:25.918+0000 31f87700 -1 osd.2 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:26.166 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:58:25.950+0000 31f87700 -1 osd.2 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:26.189 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:58:25.855+0000 31f87700 -1 osd.1 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:26.230 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:58:25.999+0000 31f87700 -1 osd.1 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:26.255 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:58:26.077+0000 3378a700 -1 osd.1 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:26.292 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:58:26.226+0000 38f95700 -1 osd.2 641 build_incremental_map_msg missing incremental map 641 2019-12-09T20:58:30.256 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T20:58:30.230+0000 20e25700 -1 RGWWatcher::handle_error cookie 386396400 err (107) Transport endpoint is not connected 2019-12-09T20:59:24.227 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:24.224+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:24.370 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:24.365+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:24.806 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:24.799+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:25.272 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:25.269+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:25.367 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:25.363+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:25.795 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:25.789+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:26.225 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:26.222+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:26.411 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:26.406+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:26.587 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:26.584+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:26.751 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:26.746+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:27.276 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:27.272+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:27.365 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:27.362+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:27.391 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:27.386+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:27.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:27.411+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:27.577 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:27.572+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:27.719 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:27.714+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:28.262 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:28.257+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:28.346 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:28.342+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:28.413 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:28.408+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:28.469 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:28.465+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:28.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:28.584+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:28.688 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:28.683+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:29.288 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:29.285+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:29.318 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:29.314+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:29.371 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:29.363+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:29.515 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:29.510+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:29.545 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:29.540+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:29.726 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:29.720+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:30.289 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:30.286+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:30.368 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:30.363+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:30.397 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:30.392+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:30.529 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:30.522+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:30.529 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:30.526+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:30.695 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:30.690+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:31.329 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:31.321+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:31.376 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:31.371+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:31.384 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:31.380+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:31.539 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:31.532+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:31.559 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:31.556+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:31.729 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:31.724+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:32.332 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:32.328+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:32.362 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:32.352+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:32.412 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:32.407+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:32.546 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:32.542+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:32.591 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:32.586+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:32.717 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:32.712+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:33.298 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:33.293+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:33.310 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:33.307+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:33.458 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:33.453+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:33.520 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:33.516+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:33.635 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:33.631+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:33.743 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:33.736+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:34.302 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:34.299+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:34.340 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:34.336+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:34.424 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:34.418+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:34.494 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:34.489+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:34.633 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:34.621+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:34.723 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:34.718+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:35.283 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:35.279+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:35.339 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:35.335+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:35.424 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:35.419+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:35.536 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:35.533+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:35.609 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:35.604+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:35.775 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:35.769+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:36.325 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:36.322+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:36.332 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:36.329+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:36.414 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:36.409+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:36.496 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:36.493+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:36.624 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:36.619+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:36.797 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:36.791+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:37.369 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:37.366+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:37.458 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:37.384+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:37.458 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:37.381+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:37.492 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:37.489+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:37.618 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:37.611+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:37.792 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:37.787+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:38.343 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:38.340+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:38.382 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:38.375+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:38.390 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:38.387+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:38.489 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:38.485+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:38.639 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:38.634+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:38.846 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:38.841+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:39.357 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:39.353+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:39.374 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:39.368+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:39.434 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:39.430+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:39.471 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:39.467+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:39.651 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:39.646+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:39.882 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:39.877+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:40.401 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:40.386+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:40.411 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:40.395+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:40.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:40.471+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:40.486 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:40.480+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:40.609 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:40.605+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:40.918 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:40.914+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:41.364 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:41.359+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:41.410 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:41.405+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:41.453 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:41.450+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:41.468 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:41.465+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:41.611 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:41.606+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:41.893 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:41.887+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:42.363 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:42.359+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:42.395 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:42.391+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:42.426 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:42.423+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:42.438 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:42.435+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:42.612 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:42.607+0000 1694f700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:42.932 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:42.927+0000 1694f700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:43.393 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:43.389+0000 1694f700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:43.405 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:43.400+0000 1694f700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:43.413 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:43.410+0000 1694f700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:43.438 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:43.435+0000 1694f700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:43.749 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:43.726+0000 1694f700 -1 osd.7 643 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:43.753 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:43.744+0000 3658b700 -1 osd.5 643 build_incremental_map_msg missing incremental map 616 2019-12-09T20:59:44.185 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:44.181+0000 1694f700 -1 osd.5 643 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:44.386 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:44.379+0000 1694f700 -1 osd.4 643 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:44.481 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:44.457+0000 1694f700 -1 osd.1 643 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:44.676 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:44.541+0000 1694f700 -1 osd.3 643 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:44.728 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:44.599+0000 1694f700 -1 osd.2 643 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:44.754 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:44.730+0000 1694f700 -1 osd.7 643 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:45.000 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:59:44.901+0000 3378a700 -1 osd.0 643 build_incremental_map_msg missing incremental map 605 2019-12-09T20:59:45.001 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:59:44.901+0000 3378a700 -1 osd.0 643 build_incremental_map_msg missing incremental map 606 2019-12-09T20:59:45.306 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:45.298+0000 1694f700 -1 osd.5 644 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:45.445 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:59:45.411+0000 3378a700 -1 osd.0 643 build_incremental_map_msg missing incremental map 626 2019-12-09T20:59:45.456 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:45.427+0000 1694f700 -1 osd.1 644 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:45.553 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:45.508+0000 1694f700 -1 osd.4 644 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:45.600 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:45.593+0000 1694f700 -1 osd.3 644 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:45.600 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:45.596+0000 1694f700 -1 osd.2 644 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:45.711 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:59:45.675+0000 37792700 -1 osd.0 643 build_incremental_map_msg missing incremental map 605 2019-12-09T20:59:45.711 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:45.694+0000 1694f700 -1 osd.7 644 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:45.836 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:59:45.801+0000 37792700 -1 osd.0 643 build_incremental_map_msg missing incremental map 606 2019-12-09T20:59:45.943 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:59:45.914+0000 3378a700 -1 osd.0 643 build_incremental_map_msg missing incremental map 636 2019-12-09T20:59:45.975 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:59:45.960+0000 37792700 -1 osd.0 643 build_incremental_map_msg missing incremental map 626 2019-12-09T20:59:45.981 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T20:59:45.960+0000 37792700 -1 osd.0 643 build_incremental_map_msg missing incremental map 636 2019-12-09T20:59:46.314 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:46.280+0000 1694f700 -1 osd.5 645 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:46.558 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:46.555+0000 1694f700 -1 osd.2 645 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:46.607 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:46.603+0000 1694f700 -1 osd.4 645 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:46.661 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:46.652+0000 1694f700 -1 osd.3 645 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:46.753 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:46.652+0000 1694f700 -1 osd.1 645 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:46.847 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:46.840+0000 1694f700 -1 osd.7 645 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:47.496 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:47.446+0000 1694f700 -1 osd.5 646 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:47.525 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:47.521+0000 1694f700 -1 osd.2 646 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:47.563 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:47.558+0000 1694f700 -1 osd.4 646 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:47.659 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:47.656+0000 1694f700 -1 osd.3 646 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:47.812 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:47.807+0000 1694f700 -1 osd.7 646 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:48.136 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:48.067+0000 1694f700 -1 osd.1 647 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:48.550 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:48.547+0000 1694f700 -1 osd.2 647 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:48.690 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:48.687+0000 1694f700 -1 osd.3 647 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:48.706 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:48.597+0000 1694f700 -1 osd.4 647 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:48.853 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:48.841+0000 1694f700 -1 osd.5 647 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:49.122 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:48.954+0000 1694f700 -1 osd.7 647 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:49.291 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:49.149+0000 1694f700 -1 osd.1 648 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:49.552 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:49.515+0000 1694f700 -1 osd.2 648 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:49.765 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:49.759+0000 1694f700 -1 osd.3 648 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:49.885 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:49.841+0000 1694f700 -1 osd.4 648 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:49.889 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:49.885+0000 1694f700 -1 osd.5 648 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:50.204 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:50.200+0000 1694f700 -1 osd.1 648 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:50.527 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:50.523+0000 1694f700 -1 osd.2 649 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:50.643 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:50.570+0000 1694f700 -1 osd.7 648 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:50.806 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:50.803+0000 1694f700 -1 osd.3 648 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:50.838 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:50.834+0000 1694f700 -1 osd.4 648 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:50.869 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:50.863+0000 1694f700 -1 osd.5 648 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:51.190 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:51.180+0000 1694f700 -1 osd.1 648 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:51.501 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:51.488+0000 1694f700 -1 osd.2 649 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:51.765 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:51.557+0000 1694f700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:51.813 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:51.810+0000 1694f700 -1 osd.3 650 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:51.884 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:51.849+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:51.884 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:51.881+0000 1694f700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:52.185 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:52.163+0000 1694f700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:52.469 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:52.462+0000 31f87700 -1 osd.1 650 build_incremental_map_msg missing incremental map 641 2019-12-09T20:59:52.485 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:52.476+0000 1694f700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:52.604 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:52.599+0000 1694f700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:52.781 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:52.768+0000 1694f700 -1 osd.3 651 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:52.815 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:52.810+0000 1694f700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:52.870 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:52.848+0000 1694f700 -1 osd.5 651 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:53.444 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:53.422+0000 1694f700 -1 osd.1 651 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:53.474 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:53.469+0000 1694f700 -1 osd.2 651 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:53.615 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:53.611+0000 1694f700 -1 osd.7 651 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:53.753 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:53.749+0000 1694f700 -1 osd.3 651 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:53.870 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:53.862+0000 1694f700 -1 osd.4 651 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:53.926 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:53.921+0000 1694f700 -1 osd.5 651 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:54.467 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:54.463+0000 1694f700 -1 osd.2 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:54.512 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:54.427+0000 1694f700 -1 osd.1 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:54.635 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:54.631+0000 1694f700 -1 osd.7 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:54.745 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:54.740+0000 1694f700 -1 osd.3 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:54.919 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:54.915+0000 1694f700 -1 osd.4 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:54.980 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:54.974+0000 1694f700 -1 osd.5 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:55.484 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:55.479+0000 1694f700 -1 osd.2 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:55.560 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:55.556+0000 1694f700 -1 osd.1 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:55.594 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:55.589+0000 1694f700 -1 osd.7 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:55.742 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:55.738+0000 1694f700 -1 osd.3 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:55.879 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:55.869+0000 1694f700 -1 osd.4 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:55.963 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:55.958+0000 1694f700 -1 osd.5 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:56.445 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:56.440+0000 1694f700 -1 osd.2 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:56.571 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:56.566+0000 1694f700 -1 osd.7 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:56.585 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:56.571+0000 1694f700 -1 osd.1 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:56.715 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:56.710+0000 1694f700 -1 osd.3 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:56.911 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:56.907+0000 1694f700 -1 osd.4 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:56.990 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:56.985+0000 1694f700 -1 osd.5 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:57.488 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:57.483+0000 1694f700 -1 osd.2 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:57.545 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:57.541+0000 1694f700 -1 osd.1 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:57.608 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:57.604+0000 1694f700 -1 osd.7 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:57.726 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:57.723+0000 1694f700 -1 osd.3 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:57.878 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:57.873+0000 1694f700 -1 osd.4 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:57.983 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:57.979+0000 1694f700 -1 osd.5 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:58.457 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T20:59:58.450+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e642 v642) 2019-12-09T20:59:58.509 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:58.505+0000 1694f700 -1 osd.2 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:58.516 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:58.512+0000 1694f700 -1 osd.1 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:58.587 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:58.583+0000 1694f700 -1 osd.7 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T20:59:58.748 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:58.743+0000 1694f700 -1 osd.3 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:58.917 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:58.913+0000 1694f700 -1 osd.4 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T20:59:59.028 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T20:59:59.023+0000 1694f700 -1 osd.5 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T20:59:59.519 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T20:59:59.514+0000 1694f700 -1 osd.1 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T20:59:59.531 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T20:59:59.513+0000 1694f700 -1 osd.2 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T20:59:59.899 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T20:59:59.793+0000 1694f700 -1 osd.3 653 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T20:59:59.960 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T20:59:59.955+0000 1694f700 -1 osd.4 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T21:00:00.068 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:00:00.063+0000 1694f700 -1 osd.5 652 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T21:00:00.090 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T20:59:59.846+0000 1694f700 -1 osd.7 653 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T21:00:00.503 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:00:00.499+0000 1694f700 -1 osd.1 653 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T21:00:00.533 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:00:00.529+0000 1694f700 -1 osd.2 653 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T21:00:00.820 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:00.811+0000 1694f700 -1 osd.3 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T21:00:01.013 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:00:01.004+0000 1694f700 -1 osd.4 653 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T21:00:01.049 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:00:01.009+0000 1694f700 -1 osd.7 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T21:00:01.167 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:00:01.110+0000 1694f700 -1 osd.5 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T21:00:01.524 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:00:01.520+0000 1694f700 -1 osd.2 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T21:00:01.675 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:00:01.544+0000 1694f700 -1 osd.1 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T21:00:01.801 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:01.796+0000 1694f700 -1 osd.3 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T21:00:02.016 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:00:02.012+0000 1694f700 -1 osd.7 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T21:00:02.043 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:00:02.039+0000 1694f700 -1 osd.4 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T21:00:02.080 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:00:02.076+0000 1694f700 -1 osd.5 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T21:00:02.527 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:00:02.522+0000 1694f700 -1 osd.2 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T21:00:02.588 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:00:02.582+0000 1694f700 -1 osd.1 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T21:00:02.824 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:02.820+0000 1694f700 -1 osd.3 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.071095+0000 front 2019-12-09T20:58:42.293375+0000 (oldest deadline 2019-12-09T20:59:27.336065+0000) 2019-12-09T21:00:03.044 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:00:03.039+0000 1694f700 -1 osd.7 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.800457+0000 front 2019-12-09T20:58:41.873326+0000 (oldest deadline 2019-12-09T20:59:25.874099+0000) 2019-12-09T21:00:03.081 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:00:03.076+0000 1694f700 -1 osd.4 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:38.449597+0000 front 2019-12-09T20:58:38.423308+0000 (oldest deadline 2019-12-09T20:59:24.295894+0000) 2019-12-09T21:00:03.128 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:00:03.123+0000 1694f700 -1 osd.5 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:42.613595+0000 front 2019-12-09T20:58:42.537055+0000 (oldest deadline 2019-12-09T20:59:24.179949+0000) 2019-12-09T21:00:03.516 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:00:03.510+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e642 v642) 2019-12-09T21:00:03.551 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:00:03.547+0000 1694f700 -1 osd.2 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:39.440204+0000 front 2019-12-09T20:58:39.604029+0000 (oldest deadline 2019-12-09T20:59:24.088426+0000) 2019-12-09T21:00:03.569 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:00:03.565+0000 1694f700 -1 osd.1 654 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T20:58:41.499872+0000 front 2019-12-09T20:58:41.211406+0000 (oldest deadline 2019-12-09T20:59:27.091098+0000) 2019-12-09T21:00:14.972 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:00:14.966+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T21:00:21.626 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:21.598+0000 36f91700 -1 osd.3 663 build_incremental_map_msg missing incremental map 630 2019-12-09T21:00:23.565 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:00:23.558+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 3 pgs recovery_unfound (PG_DAMAGED) 2019-12-09T21:00:35.644 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:35.637+0000 1694f700 -1 osd.3 673 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:36.711 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:36.693+0000 1694f700 -1 osd.3 674 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:37.649 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:37.646+0000 1694f700 -1 osd.3 674 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:38.464 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:54:59.520 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:00:38.466 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:54:59.525 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:00:38.470 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:54:59.506 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:00:38.475 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:54:59.534 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:00:38.476 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:54:59.511 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:00:38.479 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:54:59.538 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:00:38.697 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:38.693+0000 1694f700 -1 osd.3 674 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:38.768 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:54:59.803 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:00:38.796 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:54:59.855 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:00:38.887 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:54:59.946 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:00:39.744 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:39.741+0000 1694f700 -1 osd.3 675 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:40.888 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:40.801+0000 1694f700 -1 osd.3 676 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:41.801 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:41.780+0000 1694f700 -1 osd.3 677 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:42.807 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:42.795+0000 1694f700 -1 osd.3 677 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:43.821 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:43.818+0000 1694f700 -1 osd.3 678 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:44.822 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:44.819+0000 1694f700 -1 osd.3 680 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:45.801 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:45.799+0000 1694f700 -1 osd.3 680 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:46.824 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:46.821+0000 1694f700 -1 osd.3 681 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:47.872 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:47.851+0000 1694f700 -1 osd.3 681 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:48.894 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:48.866+0000 1694f700 -1 osd.3 682 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:49.951 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:49.852+0000 1694f700 -1 osd.3 683 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:50.963 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:50.935+0000 1694f700 -1 osd.3 684 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:52.116 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:51.981+0000 1694f700 -1 osd.3 685 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:53.677 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:53.600+0000 1694f700 -1 osd.3 686 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:54.639 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:54.634+0000 1694f700 -1 osd.3 687 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:55.243 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:00:55.235+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2019-12-09T21:00:55.644 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:55.639+0000 1694f700 -1 osd.3 688 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:56.652 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:56.647+0000 1694f700 -1 osd.3 688 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:57.650 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:57.610+0000 1694f700 -1 osd.3 689 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:58.824 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:58.799+0000 1694f700 -1 osd.3 690 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:00:59.783 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:00:59.761+0000 1694f700 -1 osd.3 691 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:01:00.774 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:01:00.771+0000 1694f700 -1 osd.3 691 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:01:01.801 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:01:01.797+0000 1694f700 -1 osd.3 692 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:01:02.836 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:01:02.832+0000 1694f700 -1 osd.3 693 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:01:03.828 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:01:03.825+0000 1694f700 -1 osd.3 694 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:01:04.828 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:01:04.825+0000 1694f700 -1 osd.3 694 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:01:06.060 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:01:06.014+0000 1694f700 -1 osd.3 695 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:01:07.027 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:01:07.024+0000 1694f700 -1 osd.3 696 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:01:08.054 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:01:08.050+0000 1694f700 -1 osd.3 697 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:01:08.086 INFO:tasks.rgw.client.0.smithi146.stdout:2019-12-09T21:01:08.050+0000 20e25700 -1 RGWWatcher::handle_error cookie 5429873984 err (107) Transport endpoint is not connected 2019-12-09T21:01:09.095 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:01:09.089+0000 1694f700 -1 osd.3 698 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:01:09.322 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:55:30.381 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:01:09.366 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:55:30.425 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:01:09.384 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:55:30.419 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:01:09.389 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:55:30.424 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:01:09.402 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:55:30.461 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:01:09.409 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:55:30.468 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:01:09.475 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:55:30.510 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:01:09.483 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:55:30.542 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:01:09.514 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:55:30.573 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:01:10.130 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:01:10.057+0000 1694f700 -1 osd.3 698 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4382.0:126880 7.7 7.56ef4467 (undecoded) ondisk+retry+read+known_if_redirected e656) 2019-12-09T21:02:06.721 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:06.717+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:07.773 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:07.768+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:08.072 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:08.067+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:08.435 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:08.430+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:08.759 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:08.754+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:09.053 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:09.047+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:09.159 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:09.154+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:09.403 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:09.399+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:09.730 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:09.725+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:10.097 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:10.088+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:10.128 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:10.122+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:10.148 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:10.143+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:10.413 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:10.408+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:10.766 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:10.760+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:11.090 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:11.084+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:11.119 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:11.114+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:11.145 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:11.140+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:11.146 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:11.141+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:11.451 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:11.446+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:11.775 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:11.768+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:12.057 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:12.052+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:12.105 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:12.099+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:12.128 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:12.123+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:12.165 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:12.158+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:12.443 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:12.439+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:12.810 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:12.804+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:13.047 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:13.041+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:13.062 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:13.057+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:13.112 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:13.107+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:13.168 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:13.163+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:13.418 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:13.412+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:13.863 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:13.858+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:14.063 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:14.058+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:14.114 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:14.108+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:14.135 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:14.130+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:14.158 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:14.151+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:14.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:14.419+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:14.869 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:14.858+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:15.040 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:15.035+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:15.107 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:15.101+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:15.123 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:15.117+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:15.148 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:15.143+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:15.451 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:15.447+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:15.911 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:15.906+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:16.026 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:16.021+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:16.080 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:16.075+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:16.132 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:16.127+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:16.138 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:16.133+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:16.431 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:16.427+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:16.906 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:16.901+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:17.005 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:17.000+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:17.080 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:17.074+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:17.095 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:17.085+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:17.135 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:17.130+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:17.446 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:17.441+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:17.956 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:17.951+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:18.022 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:18.016+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:18.111 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:18.106+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:18.144 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:18.137+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:18.161 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:18.155+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:18.414 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:18.410+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:18.932 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:18.928+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:19.031 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:19.026+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:19.074 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:19.070+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:19.144 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:19.135+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:19.152 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:19.147+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:19.431 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:19.426+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:19.787 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:56:40.846 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:02:19.805 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:56:40.864 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:02:19.829 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:56:40.888 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:02:19.869 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:56:40.923 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:02:19.900 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:56:40.935 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:02:19.909 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:56:40.945 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:02:19.930 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:19.925+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:19.958 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:56:41.017 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:02:19.996 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:56:41.055 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:02:20.009 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:20.006+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:20.035 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:56:41.070 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:02:20.048 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:20.044+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:20.109 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:20.105+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:20.115 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:20.109+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:20.412 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:20.407+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:20.945 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:20.940+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:21.049 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:21.047+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:21.091 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:21.086+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:21.109 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:21.105+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:21.117 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:21.112+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:21.408 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:21.405+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:21.945 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:21.940+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:22.034 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:22.031+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:22.111 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:22.105+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:22.134 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:22.130+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:22.152 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:22.147+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:22.434 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:22.430+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:22.910 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:22.906+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:23.061 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:23.057+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:23.110 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:23.104+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:23.124 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:23.119+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:23.202 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:23.196+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:23.452 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:23.449+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:23.917 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:23.911+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:24.088 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:24.084+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:24.092 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:24.088+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:24.152 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:24.143+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:24.171 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:24.165+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:24.415 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:24.412+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:24.895 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:24.890+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:25.072 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:25.067+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:25.135 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:25.131+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:25.152 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:25.148+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:25.157 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:25.153+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:25.417 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:25.413+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:25.942 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:25.937+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:26.117 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:26.114+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:26.141 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:26.138+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:26.168 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:26.154+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:26.210 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:26.205+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:26.428 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:26.426+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:26.985 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:26.979+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:27.124 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:27.117+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:27.156 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:27.151+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:27.180 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:27.176+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:27.210 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:27.205+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:27.397 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:27.392+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:27.978 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:27.973+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:28.109 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:28.105+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:28.177 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:28.172+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:28.210 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:28.207+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:28.218 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:28.213+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:28.398 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:28.394+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:28.978 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:28.973+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:29.109 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:29.106+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:29.181 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:29.174+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:29.236 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:29.231+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:29.243 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:29.239+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:29.382 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:29.377+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:29.953 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:29.948+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:30.070 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:30.067+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:30.155 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:30.150+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:30.209 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:30.200+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:30.265 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:30.261+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:30.399 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:30.396+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:30.937 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:30.933+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:31.064 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:31.061+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:31.201 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:31.195+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:31.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:31.203+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:31.287 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:31.283+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:31.384 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:31.378+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:31.985 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:31.979+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:32.079 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:32.075+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:32.187 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:32.182+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:32.203 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:32.197+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:32.329 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:32.325+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:32.348 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:32.345+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:33.016 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:33.010+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:33.071 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:33.068+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:33.240 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:33.236+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:33.247 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:33.242+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:33.350 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:33.346+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:33.382 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:33.379+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:33.991 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:33.985+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:34.123 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:34.119+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:34.284 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:34.280+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:34.292 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:34.288+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:34.380 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:34.377+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:34.391 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:34.388+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:34.976 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:34.970+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:35.087 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:35.084+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:35.278 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:35.273+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:35.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:35.332+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:35.338 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:35.334+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:35.430 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:35.426+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:35.995 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:35.990+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:36.129 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:36.126+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:36.319 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:36.314+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:36.324 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:36.321+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:36.325 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:36.320+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:36.441 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:36.437+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:37.002 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:36.996+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:37.183 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:37.179+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:37.280 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:37.274+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:37.347 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:37.342+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:37.350 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:37.347+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:37.447 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:37.443+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:38.017 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:37.997+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:38.231 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:38.229+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:38.307 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:38.302+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:38.385 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:38.381+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:38.387 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:38.383+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:38.438 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:38.431+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:39.020 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:39.015+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:39.235 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:39.231+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:39.314 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:39.309+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:39.390 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:39.386+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:39.392 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:39.387+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:39.435 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:39.432+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:39.819 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:02:39.816+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e702 v702) 2019-12-09T21:02:39.998 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:39.994+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:40.237 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:40.233+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:40.273 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:40.267+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:40.370 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:40.367+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:40.430 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:40.426+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:40.433 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:40.428+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:40.985 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:40.978+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:41.267 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:41.262+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:41.310 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:41.302+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:41.349 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:41.346+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:41.441 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:41.435+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:41.479 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:41.476+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:41.986 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:41.981+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:42.240 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:42.236+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:42.310 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:42.307+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:42.328 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:42.323+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:42.410 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:42.404+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:42.467 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:42.463+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:43.027 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:43.022+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:43.197 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:43.193+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:43.282 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:43.277+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:43.296 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:43.290+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:43.413 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:43.407+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:43.519 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:43.514+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:43.984 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:43.979+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:44.235 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:44.232+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:44.279 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:44.276+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:44.310 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:44.305+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:44.377 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:44.372+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:44.545 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:44.542+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:44.839 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:02:44.836+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e702 v702) 2019-12-09T21:02:45.012 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:45.006+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:45.218 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:45.213+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:45.283 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:45.279+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:45.301 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:45.295+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:45.386 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:45.381+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:45.592 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:45.587+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:46.044 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:46.039+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:46.199 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:46.195+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:46.265 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:46.262+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:46.332 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:46.327+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:46.439 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:46.434+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:46.642 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:46.639+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:47.009 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:47.004+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:47.209 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:47.204+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:47.290 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:47.285+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:47.297 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:47.292+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:47.432 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:47.427+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:47.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:47.614+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:47.975 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:47.970+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:48.216 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:48.212+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:48.307 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:48.303+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:48.328 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:48.322+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:48.387 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:48.382+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:48.662 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:48.658+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:49.003 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:02:48.997+0000 1694f700 -1 osd.7 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:23.666146+0000 front 2019-12-09T21:01:23.696903+0000 (oldest deadline 2019-12-09T21:02:05.936835+0000) 2019-12-09T21:02:49.222 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:02:49.218+0000 1694f700 -1 osd.2 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:24.800670+0000 front 2019-12-09T21:01:24.883973+0000 (oldest deadline 2019-12-09T21:02:10.691683+0000) 2019-12-09T21:02:49.318 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:02:49.312+0000 1694f700 -1 osd.4 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.116803+0000 front 2019-12-09T21:01:25.282837+0000 (oldest deadline 2019-12-09T21:02:07.283078+0000) 2019-12-09T21:02:49.348 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:02:49.344+0000 1694f700 -1 osd.3 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.720715+0000 front 2019-12-09T21:01:25.747441+0000 (oldest deadline 2019-12-09T21:02:09.158499+0000) 2019-12-09T21:02:49.354 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:02:49.349+0000 1694f700 -1 osd.5 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:25.875976+0000 front 2019-12-09T21:01:25.833848+0000 (oldest deadline 2019-12-09T21:02:08.706209+0000) 2019-12-09T21:02:49.651 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:02:49.647+0000 1694f700 -1 osd.1 702 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:01:22.220684+0000 front 2019-12-09T21:01:22.219492+0000 (oldest deadline 2019-12-09T21:02:07.667874+0000) 2019-12-09T21:02:49.914 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:02:49.910+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e702 v702) 2019-12-09T21:03:51.287 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:58:12.346 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:03:51.296 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:58:12.355 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:03:51.302 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:58:12.360 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:03:51.304 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:58:12.363 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:03:51.360 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:58:12.395 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:03:51.376 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:58:12.412 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:03:51.441 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:09:58:12.499 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:03:51.475 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:09:58:12.534 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:03:51.547 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:09:58:12.582 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:04:45.072 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:45.068+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:46.089 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:46.086+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:46.118 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:46.112+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:46.121 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:46.116+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:46.524 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:46.518+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:47.050 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:47.045+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:47.081 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:47.075+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:47.099 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:47.096+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:47.104 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:47.097+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:47.495 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:47.488+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:48.054 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:48.049+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:48.112 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:48.108+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:48.123 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:48.119+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:48.124 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:48.119+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:48.359 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:04:48.355+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:04:48.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:48.508+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:49.048 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:49.038+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:49.083 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:49.078+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:49.102 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:49.098+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:49.111 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:49.106+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:49.399 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:04:49.395+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:04:49.471 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:49.463+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:50.040 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:50.036+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:50.058 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:50.054+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:50.135 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:50.130+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:50.143 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:50.137+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:50.448 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:04:50.444+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:04:50.497 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:50.492+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:51.015 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:51.010+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:51.050 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:51.047+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:51.154 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:51.149+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:51.170 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:51.161+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:51.480 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:04:51.474+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:04:51.512 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:51.506+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:51.993 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:51.989+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:52.021 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:52.017+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:52.134 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:52.130+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:52.161 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:52.156+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:52.436 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:04:52.433+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:04:52.537 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:52.533+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:53.009 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:53.004+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:53.037 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:53.034+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:53.125 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:53.119+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:53.151 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:53.145+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:53.395 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:04:53.391+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:04:53.516 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:53.511+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:54.060 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:54.054+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:54.080 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:54.070+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:54.132 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:54.128+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:54.202 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:54.198+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:54.393 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:04:54.390+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:04:54.525 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:54.516+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:55.064 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:55.058+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:55.095 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:55.091+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:55.137 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:55.130+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:55.208 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:55.204+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:55.413 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:04:55.408+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:04:55.557 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:55.552+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:56.094 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:56.087+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:56.096 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:56.091+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:56.100 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:56.095+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:56.199 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:56.196+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:56.432 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:04:56.429+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:04:56.558 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:56.553+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:57.064 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:57.059+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:57.083 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:57.078+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:57.129 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:57.124+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:57.187 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:57.183+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:57.453 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:04:57.448+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:04:57.571 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:57.566+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:58.080 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:58.074+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:58.126 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:58.121+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:58.162 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:58.155+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:58.165 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:58.162+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:58.476 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:04:58.472+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:04:58.629 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:58.621+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:04:59.125 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:04:59.120+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:04:59.130 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:04:59.125+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:04:59.160 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:04:59.157+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:04:59.196 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:04:59.192+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:04:59.504 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:04:59.499+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:04:59.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:04:59.584+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:00.137 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:00.134+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:00.157 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:00.151+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:00.175 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:00.169+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:00.229 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:00.226+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:00.484 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:00.479+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:00.557 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:00.551+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:01.100 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:01.095+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:01.189 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:01.184+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:01.195 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:01.190+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:01.250 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:01.247+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:01.486 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:01.482+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:01.569 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:01.564+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:02.095 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:02.091+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:02.164 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:02.159+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:02.210 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:02.205+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:02.257 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:02.252+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:02.449 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:02.446+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:02.572 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:02.565+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:03.082 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:03.078+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:03.217 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:03.212+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:03.228 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:03.222+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:03.308 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:03.304+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:03.496 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:03.493+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:03.544 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:03.539+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:04.129 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:04.125+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:04.213 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:04.208+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:04.223 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:04.218+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:04.276 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:04.270+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:04.515 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:04.512+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:04.525 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:04.520+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:05.169 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:05.166+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:05.188 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:05.184+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:05.276 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:05.273+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:05.277 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:05.271+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:05.547 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:05.542+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:05.556 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:05.553+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:06.163 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:06.158+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:06.172 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:06.166+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:06.248 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:06.245+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:06.305 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:06.300+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:06.507 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:06.500+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:06.515 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:06.509+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:07.156 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:07.152+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:07.216 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:07.211+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:07.267 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:07.263+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:07.280 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:07.275+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:07.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:07.500+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:07.552 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:07.547+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:08.183 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:08.179+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:08.249 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:08.244+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:08.276 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:08.271+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:08.330 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:08.324+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:08.526 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:08.521+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:08.587 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:08.584+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:09.180 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:09.176+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:09.279 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:09.274+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:09.291 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:09.288+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:09.310 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:09.305+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:09.562 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:09.557+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:09.581 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:09.576+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:10.153 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:10.148+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:10.254 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:10.249+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:10.267 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:10.261+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:10.268 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:10.264+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:10.572 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:10.567+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:10.582 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:10.579+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:11.204 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:11.199+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:11.220 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:11.215+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:11.242 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:11.237+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:11.306 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:11.294+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:11.547 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:11.543+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:11.576 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:11.570+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:12.175 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:12.171+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:12.188 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:12.184+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:12.289 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:12.279+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:12.297 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:12.292+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:12.587 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:12.583+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:12.591 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:12.587+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:13.149 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:13.141+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:13.173 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:13.168+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:13.251 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:13.247+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:13.345 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:13.340+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:13.576 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:13.572+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:13.583 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:13.576+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:14.118 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:14.112+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:14.201 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:14.195+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:14.241 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:14.233+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:14.399 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:14.394+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:14.592 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:14.587+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:14.621 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:14.617+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:15.166 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:15.160+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:15.203 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:15.199+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:15.207 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:15.203+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:15.416 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:15.411+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:15.587 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:15.582+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:15.659 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:15.654+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:16.181 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:16.174+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:16.234 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:16.228+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:16.252 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:16.246+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:16.379 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:16.374+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:16.628 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:16.624+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:16.636 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:16.630+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:17.170 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:17.164+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:17.215 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:17.210+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:17.220 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:17.215+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:17.397 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:17.392+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:17.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:17.673+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:17.679 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:17.675+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:18.177 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:18.172+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:18.205 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:18.200+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:18.215 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:18.210+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:18.447 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:18.443+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:18.650 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:18.646+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:18.733 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:18.730+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:19.146 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:19.140+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:19.217 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:19.211+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:19.236 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:19.231+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:19.419 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:19.414+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:19.658 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:19.653+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:19.695 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:19.690+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:20.120 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:20.115+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:20.246 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:20.241+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:20.251 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:20.245+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:20.311 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:05:20.308+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e716 v716) 2019-12-09T21:05:20.402 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:20.398+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:20.682 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:20.676+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:20.706 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:20.701+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:21.162 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:21.158+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:21.259 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:21.254+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:21.271 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:21.267+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:21.401 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:21.397+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:21.673 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:21.667+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:21.691 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:21.686+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:22.208 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:22.203+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:22.272 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:22.262+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:22.273 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:22.268+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:22.418 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:22.413+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:22.726 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:22.721+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:22.730 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:22.725+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:23.190 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:23.185+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:23.231 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:23.226+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:23.274 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:23.269+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:23.378 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:23.374+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:23.688 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:23.683+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:23.764 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:23.759+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:24.209 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:24.205+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:24.261 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:24.256+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:24.322 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:24.316+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:24.409 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:24.403+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:24.725 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:24.719+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:24.755 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:24.751+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:25.224 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:25.218+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:25.234 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:25.228+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:25.330 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:05:25.326+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e716 v716) 2019-12-09T21:05:25.331 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:25.326+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:25.449 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:25.444+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:25.731 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:25.727+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:25.762 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:25.756+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:26.215 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:26.210+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:26.233 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:26.228+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:26.372 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:26.367+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:26.493 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:26.488+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:26.709 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:26.704+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:26.716 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:26.711+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:27.258 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:27.253+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:27.262 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:27.258+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:27.372 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:27.367+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:27.498 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:27.493+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:27.744 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:27.739+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:27.765 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:27.761+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:28.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:28.226+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:28.269 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:28.265+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:28.355 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:28.350+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:28.533 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:28.527+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:28.739 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:28.735+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:28.752 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:28.747+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:29.216 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:29.209+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:29.233 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:29.229+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:29.396 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:29.392+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:29.529 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:29.524+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:29.742 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:29.738+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:05:29.782 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:05:29.778+0000 1694f700 -1 osd.2 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.834090+0000 front 2019-12-09T21:04:02.928773+0000 (oldest deadline 2019-12-09T21:04:47.339834+0000) 2019-12-09T21:05:30.201 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:05:30.194+0000 1694f700 -1 osd.3 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.876143+0000 front 2019-12-09T21:04:01.892555+0000 (oldest deadline 2019-12-09T21:04:44.886155+0000) 2019-12-09T21:05:30.226 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:05:30.221+0000 1694f700 -1 osd.1 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:04.149891+0000 front 2019-12-09T21:04:04.159700+0000 (oldest deadline 2019-12-09T21:04:46.283209+0000) 2019-12-09T21:05:30.395 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:05:30.389+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e716 v716) 2019-12-09T21:05:30.418 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:05:30.413+0000 1694f700 -1 osd.4 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.109705+0000 front 2019-12-09T21:04:02.123763+0000 (oldest deadline 2019-12-09T21:04:45.548408+0000) 2019-12-09T21:05:30.582 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:05:30.573+0000 1694f700 -1 osd.5 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:01.601269+0000 front 2019-12-09T21:04:01.568544+0000 (oldest deadline 2019-12-09T21:04:45.464563+0000) 2019-12-09T21:05:30.786 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:05:30.782+0000 1694f700 -1 osd.7 716 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:04:02.290921+0000 front 2019-12-09T21:04:02.241385+0000 (oldest deadline 2019-12-09T21:04:45.571599+0000) 2019-12-09T21:06:20.995 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:20.985+0000 31786700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-12-09T21:06:21.025 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:20.992+0000 31786700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-12-09T21:06:21.095 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:21.018+0000 31786700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-12-09T21:06:21.096 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:21.021+0000 31786700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-12-09T21:06:21.099 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:21.034+0000 35f8f700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-12-09T21:06:21.300 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:21.121+0000 36790700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-12-09T21:06:21.303 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:21.126+0000 38794700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-12-09T21:06:21.306 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:21.137+0000 37792700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-12-09T21:06:21.924 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:21.906+0000 3578e700 -1 osd.0 723 build_incremental_map_msg missing incremental map 723 2019-12-09T21:06:22.287 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:22.171+0000 35f8f700 -1 osd.0 723 build_incremental_map_msg missing incremental map 723 2019-12-09T21:06:23.445 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:23.321+0000 38f95700 -1 osd.0 724 build_incremental_map_msg missing incremental map 722 2019-12-09T21:06:23.462 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:23.322+0000 38f95700 -1 osd.0 724 build_incremental_map_msg missing incremental map 723 2019-12-09T21:06:23.470 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:23.341+0000 38f95700 -1 osd.0 724 build_incremental_map_msg missing incremental map 722 2019-12-09T21:06:23.525 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:23.410+0000 38f95700 -1 osd.0 724 build_incremental_map_msg missing incremental map 723 2019-12-09T21:06:33.400 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:33.390+0000 35f8f700 -1 osd.0 726 build_incremental_map_msg missing incremental map 722 2019-12-09T21:06:33.410 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:06:33.391+0000 35f8f700 -1 osd.0 726 build_incremental_map_msg missing incremental map 723 2019-12-09T21:07:23.441 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:23.436+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:23.890 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:23.886+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:24.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:24.204+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:24.396 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:24.393+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:24.881 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:24.874+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:24.929 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:24.924+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:25.215 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:25.211+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:25.378 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:25.368+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:25.886 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:25.881+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:25.980 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:25.974+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:26.177 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:26.172+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:26.362 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:26.357+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:26.571 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:26.565+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:26.906 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:26.895+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:26.981 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:26.975+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:27.177 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:27.169+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:27.361 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:27.356+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:27.550 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:27.544+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:27.908 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:27.904+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:27.992 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:27.984+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:28.143 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:28.138+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:28.404 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:28.398+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:28.578 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:28.570+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:28.903 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:28.898+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:28.973 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:28.968+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:29.107 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:29.102+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:29.381 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:29.376+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:29.586 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:29.581+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:29.872 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:29.867+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:29.964 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:29.960+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:30.096 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:30.092+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:30.435 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:30.430+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:30.624 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:30.619+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:30.865 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:30.861+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:30.995 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:30.990+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:31.097 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:31.092+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:31.460 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:31.455+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:31.644 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:31.639+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:31.854 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:31.850+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:31.953 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:31.947+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:32.144 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:32.139+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:32.431 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:32.422+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:32.636 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:32.627+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:32.889 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:32.884+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:32.922 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:32.918+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:33.139 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:33.133+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:33.450 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:33.445+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:33.614 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:33.609+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:33.913 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:33.908+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:33.914 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:33.909+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:34.116 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:34.110+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:34.450 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:34.445+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:34.636 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:34.633+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:34.928 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:34.924+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:34.972 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:34.965+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:35.119 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:35.113+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:35.463 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:35.458+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:35.643 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:35.639+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:35.905 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:35.901+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:35.980 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:35.976+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:36.163 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:36.157+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:36.482 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:36.478+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:36.679 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:36.674+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:36.917 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:36.905+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:36.943 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:36.937+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:37.130 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:37.125+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:37.469 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:37.463+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:37.639 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:37.636+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:37.902 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:37.896+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:37.965 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:37.960+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:38.150 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:38.145+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:38.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:38.451+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:38.652 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:38.647+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:38.914 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:38.909+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:38.958 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:38.954+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:39.185 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:39.180+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:39.415 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:39.409+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:39.657 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:39.653+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:39.943 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:39.939+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:39.967 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:39.962+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:40.191 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:40.187+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:40.449 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:40.445+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:40.658 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:40.654+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:40.937 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:40.930+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:40.970 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:40.966+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:41.170 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:41.167+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:41.416 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:41.411+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:41.648 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:41.643+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:41.957 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:41.952+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:41.976 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:41.972+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:42.151 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:42.146+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:42.380 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:42.375+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:42.641 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:42.634+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:42.976 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:42.973+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:42.984 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:42.980+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:43.193 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:43.188+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:43.419 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:43.414+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:43.594 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:43.590+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:43.955 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:43.950+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:43.997 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:43.994+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:44.155 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:44.150+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:44.405 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:44.400+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:44.636 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:44.633+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:44.987 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:44.982+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:45.046 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:45.042+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:45.163 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:45.158+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:45.371 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:45.364+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:45.623 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:45.618+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:45.961 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:45.956+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:46.081 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:46.078+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:46.195 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:46.188+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:46.365 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:46.356+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:46.580 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:46.577+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:47.008 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:47.004+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:47.068 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:47.065+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:47.181 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:47.171+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:47.351 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:47.346+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:47.602 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:47.597+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:48.049 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:48.044+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:48.070 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:48.066+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:48.132 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:48.127+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:48.392 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:48.387+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:48.600 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:48.596+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:48.766 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:02:09.826 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:07:48.771 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:02:09.830 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:07:48.797 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:02:09.832 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:07:48.814 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:02:09.850 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:07:48.842 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:02:09.901 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:07:48.845 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:02:09.905 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:07:49.033 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:02:10.092 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:07:49.077 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:49.071+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:49.100 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:49.095+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:49.120 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:49.117+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:49.133 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:02:10.169 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:07:49.133 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:02:10.192 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:07:49.347 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:49.342+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:49.560 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:49.556+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:50.070 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:50.065+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:50.113 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:50.110+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:50.144 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:50.141+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:50.302 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:50.297+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:50.529 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:50.526+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:51.054 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:51.049+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:51.128 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:51.123+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:51.137 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:51.134+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:51.305 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:51.300+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:51.551 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:51.548+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:52.072 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:52.067+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:52.150 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:52.146+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:52.163 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:52.158+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:52.329 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:52.324+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:52.570 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:52.568+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:53.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:53.056+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:53.112 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:53.109+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:53.127 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:53.121+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:53.291 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:53.285+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:53.572 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:53.567+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:54.085 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:54.081+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:54.086 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:54.081+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:54.133 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:54.128+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:54.315 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:54.309+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:54.613 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:54.608+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:55.073 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:55.068+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:55.107 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:55.102+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:55.151 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:55.147+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:55.320 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:55.315+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:55.645 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:55.639+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:56.075 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:56.070+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:56.141 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:56.137+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:56.162 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:56.159+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:56.285 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:56.277+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:56.662 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:56.659+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:57.119 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:57.116+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:57.133 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:57.123+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:57.134 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:57.120+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:57.270 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:57.264+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:57.649 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:57.645+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:58.097 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:58.092+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:58.105 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:58.100+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:58.174 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:58.170+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:58.267 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:58.262+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:58.633 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:58.629+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:07:59.055 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:07:59.050+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:07:59.140 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:07:59.132+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:07:59.158 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:07:59.155+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:07:59.291 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:07:59.287+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:07:59.665 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:07:59.660+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:08:00.056 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:08:00.047+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:08:00.150 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:08:00.146+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:08:00.169 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:08:00.164+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:08:00.302 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:08:00.296+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:08:00.662 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:08:00.659+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:08:00.866 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:08:00.863+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 47sec e728 v728) 2019-12-09T21:08:01.094 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:08:01.090+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:08:01.140 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:08:01.138+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:08:01.159 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:08:01.154+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:08:01.333 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:08:01.328+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:08:01.619 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:08:01.615+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:08:02.109 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:08:02.098+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:08:02.122 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:08:02.117+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:08:02.189 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:08:02.180+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:08:02.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:08:02.302+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:08:02.582 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:08:02.578+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:08:03.087 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:08:03.079+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:08:03.144 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:08:03.141+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:08:03.161 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:08:03.157+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:08:03.296 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:08:03.292+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:08:03.551 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:08:03.547+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:08:04.107 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:08:04.104+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:08:04.141 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:08:04.136+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:08:04.167 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:08:04.163+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:08:04.346 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:08:04.340+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:08:04.513 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:08:04.510+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:08:05.100 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:08:05.095+0000 1694f700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:39.801431+0000 front 2019-12-09T21:06:39.848662+0000 (oldest deadline 2019-12-09T21:07:23.772122+0000) 2019-12-09T21:08:05.153 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:08:05.150+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:08:05.181 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:08:05.174+0000 1694f700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:38.640013+0000 front 2019-12-09T21:06:38.646813+0000 (oldest deadline 2019-12-09T21:07:23.730691+0000) 2019-12-09T21:08:05.395 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:08:05.390+0000 1694f700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:41.131397+0000 front 2019-12-09T21:06:41.133624+0000 (oldest deadline 2019-12-09T21:07:22.714257+0000) 2019-12-09T21:08:05.549 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:08:05.538+0000 1694f700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.746102+0000 front 2019-12-09T21:06:40.819977+0000 (oldest deadline 2019-12-09T21:07:25.958770+0000) 2019-12-09T21:08:05.925 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:08:05.918+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 47sec e728 v728) 2019-12-09T21:08:06.124 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:08:06.103+0000 1694f700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:06:40.804747+0000 front 2019-12-09T21:06:40.745972+0000 (oldest deadline 2019-12-09T21:07:24.598739+0000) 2019-12-09T21:09:31.293 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:03:52.353 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.352 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:03:52.411 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.398 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:03:52.457 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.421 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:03:52.480 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.442 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:03:52.478 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.445 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:03:52.481 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.519 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:03:52.578 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.559 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:03:52.618 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.631 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:03:52.667 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:10:00.416 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:00.413+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:00.922 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:00.918+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:01.462 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:01.459+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:01.887 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:01.883+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:02.077 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:02.064+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:02.354 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:02.348+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:02.430 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:02.427+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:02.875 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:02.870+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:02.882 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:02.877+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:03.000 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:02.996+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:03.080 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:03.075+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:03.341 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:03.332+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:03.417 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:03.413+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:03.873 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:03.869+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:03.881 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:03.872+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:04.051 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:04.045+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:04.086 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:04.081+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:04.304 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:04.301+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:04.396 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:04.392+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:04.855 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:04.851+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:04.883 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:04.875+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:05.017 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:05.012+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:05.097 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:05.092+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:05.346 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:05.343+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:05.449 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:05.439+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:05.907 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:05.904+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:05.908 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:05.903+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:06.049 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:06.044+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:06.084 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:06.079+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:06.365 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:06.360+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:06.474 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:06.470+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:06.877 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:06.872+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:06.882 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:06.880+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:07.043 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:07.038+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:07.081 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:07.065+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:07.351 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:07.347+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:07.443 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:07.438+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:07.864 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:07.859+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:07.914 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:07.911+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:08.033 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:08.029+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:08.094 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:08.088+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:08.374 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:08.370+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:08.434 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:08.429+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:08.875 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:08.870+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:08.957 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:08.952+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:09.071 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:09.066+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:09.119 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:09.114+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:09.400 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:09.396+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:09.477 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:09.467+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:09.849 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:09.843+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:10.007 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:10.001+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:10.074 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:10.069+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:10.114 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:10.109+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:10.364 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:10.357+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:10.480 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:10.474+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:10.846 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:10.823+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:11.049 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:11.045+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:11.105 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:11.096+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:11.169 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:11.161+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:11.386 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:11.383+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:11.493 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:11.489+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:11.860 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:11.856+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:12.048 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:12.044+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:12.084 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:12.078+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:12.175 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:12.170+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:12.363 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:12.359+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:12.471 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:12.459+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:12.884 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:12.879+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:13.047 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:13.041+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:13.092 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:13.084+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:13.194 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:13.188+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:13.352 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:13.347+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:13.505 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:13.496+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:13.867 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:13.864+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:14.024 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:14.013+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:14.085 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:14.080+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:14.245 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:14.240+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:14.317 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:14.314+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:14.539 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:14.536+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:14.856 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:14.851+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:15.005 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:15.000+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:15.136 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:15.132+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:15.287 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:15.280+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:15.303 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:15.296+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:15.555 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:15.542+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:15.860 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:15.814+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:15.968 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:15.963+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:16.104 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:16.101+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:16.244 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:16.238+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:16.285 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:16.280+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:16.529 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:16.526+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:16.866 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:16.858+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:16.955 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:16.949+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:17.145 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:17.142+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:17.206 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:17.201+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:17.256 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:17.250+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:17.524 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:17.521+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:17.894 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:17.890+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:17.930 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:17.925+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:18.193 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:18.189+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:18.245 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:18.240+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:18.255 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:18.250+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:18.498 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:18.494+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:18.880 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:18.876+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:18.962 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:18.957+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:19.203 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:19.200+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:19.249 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:19.239+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:19.276 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:19.270+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:19.514 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:19.508+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:19.913 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:19.909+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:20.012 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:20.008+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:20.160 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:20.157+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:20.242 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:20.239+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:20.243 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:20.238+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:20.512 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:20.508+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:20.955 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:20.948+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:21.063 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:21.058+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:21.199 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:21.196+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:21.201 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:21.199+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:21.259 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:21.252+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:21.560 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:21.557+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:22.000 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:21.995+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:22.089 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:22.085+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:22.184 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:22.181+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:22.248 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:22.245+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:22.309 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:22.304+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:22.545 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:22.542+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:23.039 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:23.035+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:23.058 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:23.055+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:23.227 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:23.224+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:23.230 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:23.227+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:23.329 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:23.317+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:23.593 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:23.589+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:24.053 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:24.047+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:24.075 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:24.071+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:24.201 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:24.190+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:24.229 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:24.226+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:24.333 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:24.329+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:24.562 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:24.557+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:25.048 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:25.043+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:25.124 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:25.120+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:25.205 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:25.201+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:25.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:25.225+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:25.389 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:25.384+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:25.601 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:25.597+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:26.079 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:26.072+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:26.134 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:26.129+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:26.234 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:26.216+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:26.282 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:26.272+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:26.348 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:26.343+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:26.604 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:26.601+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:27.085 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:27.080+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:27.130 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:27.120+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:27.193 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:27.187+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:27.321 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:27.313+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:27.374 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:27.366+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:27.585 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:27.582+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:28.082 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:28.077+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:28.137 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:28.130+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:28.220 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:28.216+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:28.329 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:28.325+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:28.345 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:28.340+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:28.561 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:28.557+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:29.045 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:29.040+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:29.102 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:29.095+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:29.221 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:29.216+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:29.316 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:29.312+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:29.381 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:29.376+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:29.528 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:29.524+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:30.041 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:30.035+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:30.058 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:30.054+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:30.215 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:30.211+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:30.291 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:30.285+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:30.364 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:30.359+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:30.485 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:30.481+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:31.028 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:31.023+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:31.065 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:31.060+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:31.232 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:31.229+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:31.296 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:31.291+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:31.365 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:31.359+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:31.451 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:10:31.447+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 40sec e737 v737) 2019-12-09T21:10:31.509 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:31.503+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:32.016 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:32.009+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:32.114 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:32.109+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:32.242 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:32.239+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:32.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:32.261+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:32.413 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:32.409+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:32.473 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:32.469+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:32.998 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:32.993+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:33.144 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:33.140+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:33.218 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:33.214+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:33.242 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:33.238+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:33.431 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:33.427+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:33.445 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:33.441+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:34.020 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:34.010+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:34.108 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:34.101+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:34.212 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:34.207+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:34.227 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:34.221+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:34.477 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:34.457+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:34.481 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:34.468+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:35.034 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:35.030+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:35.146 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:35.141+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:35.186 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:35.182+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:35.211 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:35.208+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:35.425 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:35.421+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:35.518 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:35.514+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:36.029 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:36.024+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:36.172 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:36.168+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:36.228 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:36.222+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:36.265 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:36.261+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:36.460 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:10:36.457+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 40sec e737 v737) 2019-12-09T21:10:36.470 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:36.465+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:36.574 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:36.569+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:37.003 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:36.998+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:37.139 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:37.134+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:37.202 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:37.198+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:37.244 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:37.240+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:37.508 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:37.504+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:37.589 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:37.583+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:38.023 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:38.018+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:38.094 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:38.090+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:38.233 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:38.227+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:38.254 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:38.247+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:38.485 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:38.480+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:38.574 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:38.570+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:39.004 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:38.998+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:39.074 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:39.069+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:39.224 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:39.219+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:39.288 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:39.284+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:39.529 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:39.523+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:39.619 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:39.605+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:39.996 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:39.991+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:40.093 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:40.089+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:40.266 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:40.261+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:40.275 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:40.271+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:40.513 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:40.505+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:40.617 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:40.613+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:40.986 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:40.983+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:41.130 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:41.126+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:41.268 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:41.263+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:41.317 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:41.311+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:41.483 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:10:41.479+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 40sec e737 v737) 2019-12-09T21:10:41.495 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:41.489+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:41.658 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:41.647+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:42.039 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:42.034+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:42.166 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:42.156+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:42.300 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:42.292+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:42.333 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:42.324+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:42.493 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:42.487+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:42.703 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:42.700+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:43.071 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:43.066+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:43.155 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:43.149+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:43.299 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:43.288+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:43.371 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:43.366+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:43.541 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:43.536+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:43.752 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:43.747+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:44.046 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:44.041+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:44.169 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:44.164+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:44.307 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:44.303+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:44.384 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:44.378+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:44.534 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:44.530+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:44.805 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:44.793+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:45.002 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:44.997+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:45.215 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:45.209+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:45.344 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:45.339+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:45.368 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:45.364+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:45.590 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:45.584+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:10:45.833 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:10:45.828+0000 1694f700 -1 osd.4 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.683186+0000 front 2019-12-09T21:09:18.374728+0000 (oldest deadline 2019-12-09T21:10:01.818019+0000) 2019-12-09T21:10:45.995 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:10:45.987+0000 1694f700 -1 osd.5 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.611917+0000 front 2019-12-09T21:09:18.499531+0000 (oldest deadline 2019-12-09T21:10:02.315932+0000) 2019-12-09T21:10:46.222 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:10:46.215+0000 1694f700 -1 osd.7 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.709295+0000 front 2019-12-09T21:09:18.508524+0000 (oldest deadline 2019-12-09T21:10:02.522598+0000) 2019-12-09T21:10:46.358 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:10:46.354+0000 1694f700 -1 osd.1 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.410782+0000 front 2019-12-09T21:09:19.404073+0000 (oldest deadline 2019-12-09T21:10:02.257683+0000) 2019-12-09T21:10:46.411 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:10:46.408+0000 1694f700 -1 osd.3 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:18.517262+0000 front 2019-12-09T21:09:18.644080+0000 (oldest deadline 2019-12-09T21:09:59.983717+0000) 2019-12-09T21:10:46.568 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:10:46.557+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 40sec e737 v737) 2019-12-09T21:10:46.589 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:10:46.585+0000 1694f700 -1 osd.2 737 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:09:19.863404+0000 front 2019-12-09T21:09:19.890664+0000 (oldest deadline 2019-12-09T21:10:00.300052+0000) 2019-12-09T21:11:37.365 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:05:58.424 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:11:37.371 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:05:58.431 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:11:37.376 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:05:58.413 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:11:37.381 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:05:58.417 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:11:37.382 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:05:58.442 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:11:37.389 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:05:58.448 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:11:37.547 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:05:58.580 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:11:37.547 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:05:58.601 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:11:37.573 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:05:58.630 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:12:34.369 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:34.365+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:34.559 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:34.555+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:34.883 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:34.878+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:35.365 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:35.362+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:35.570 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:35.567+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:35.655 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:35.651+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:35.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:35.915+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:36.395 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:36.391+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:36.598 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:36.594+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:36.623 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:36.617+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:36.795 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:36.791+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:36.895 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:36.890+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:37.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:37.411+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:37.580 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:37.575+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:37.631 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:37.627+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:37.805 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:37.793+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:37.888 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:37.883+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:37.995 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:37.993+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:38.426 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:38.422+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:38.574 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:38.569+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:38.661 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:38.656+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:38.853 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:38.847+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:38.935 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:38.931+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:39.014 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:39.011+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:39.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:39.423+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:39.559 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:39.553+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:39.688 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:39.683+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:39.887 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:39.882+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:39.941 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:39.932+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:39.976 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:39.972+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:40.469 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:40.457+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:40.600 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:40.594+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:40.683 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:40.678+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:40.918 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:40.915+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:40.963 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:40.960+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:40.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:40.964+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:41.489 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:41.485+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:41.588 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:41.584+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:41.681 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:41.676+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:41.918 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:41.913+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:41.997 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:41.993+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:42.009 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:42.002+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:42.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:42.478+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:42.625 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:42.620+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:42.661 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:42.652+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:42.922 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:42.909+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:43.015 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:43.011+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:43.034 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:43.030+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:43.513 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:43.507+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:43.594 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:43.584+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:43.691 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:43.685+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:43.895 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:43.890+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:44.051 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:44.046+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:44.061 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:44.055+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:44.479 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:44.475+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:44.588 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:44.583+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:44.681 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:44.674+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:44.909 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:44.903+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:45.007 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:45.003+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:45.023 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:45.018+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:45.526 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:45.522+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:45.562 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:45.557+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:45.673 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:45.668+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:45.895 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:45.891+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:45.994 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:45.990+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:46.002 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:45.996+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:46.535 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:46.530+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:46.539 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:46.535+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:46.691 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:46.685+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:46.939 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:46.935+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:46.952 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:46.947+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:46.993 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:46.988+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:47.566 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:47.561+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:47.571 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:47.567+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:47.744 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:47.737+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:47.929 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:47.921+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:47.973 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:47.952+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:47.973 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:47.946+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:48.552 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:48.547+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:48.613 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:48.609+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:48.704 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:48.699+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:48.945 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:48.940+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:48.950 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:48.945+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:49.001 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:48.994+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:49.563 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:49.559+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:49.648 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:49.642+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:49.705 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:49.698+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:49.923 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:49.919+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:49.965 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:49.957+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:49.982 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:49.978+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:50.574 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:50.569+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:50.627 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:50.623+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:50.753 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:50.748+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:50.958 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:50.953+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:50.961 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:50.956+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:50.979 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:50.976+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:51.563 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:51.559+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:51.655 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:51.651+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:51.757 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:51.752+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:51.937 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:51.933+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:51.990 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:51.986+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:52.007 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:52.003+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:52.551 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:52.547+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:52.662 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:52.658+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:52.777 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:52.762+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:52.987 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:52.981+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:53.026 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:53.022+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:53.044 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:53.039+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:53.595 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:53.590+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:53.622 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:53.617+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:53.773 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:53.767+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:54.029 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:54.025+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:54.034 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:54.031+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:54.075 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:54.070+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:54.645 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:54.640+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:54.666 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:54.661+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:54.762 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:54.758+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:55.022 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:55.017+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:55.047 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:55.041+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:55.082 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:55.077+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:55.613 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:55.608+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:55.712 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:55.707+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:55.754 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:55.747+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:56.047 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:56.043+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:56.055 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:56.052+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:56.073 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:56.070+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:56.619 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:56.615+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:56.724 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:56.717+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:56.755 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:56.750+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:57.045 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:57.038+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:57.078 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:57.074+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:57.088 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:57.084+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:57.592 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:57.587+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:57.754 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:57.750+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:57.767 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:57.762+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:58.003 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:57.998+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:58.035 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:58.031+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:58.120 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:58.114+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:58.575 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:58.570+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:58.724 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:58.720+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:58.784 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:58.780+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:58.980 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:58.974+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:12:59.011 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:12:58.997+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:12:59.116 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:12:59.110+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:12:59.531 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:12:59.526+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:12:59.777 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:12:59.772+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:12:59.783 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:12:59.778+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:12:59.946 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:12:59.941+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:00.025 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:00.020+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:00.164 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:00.160+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:00.554 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:00.550+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:00.756 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:00.743+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:00.775 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:00.770+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:00.995 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:00.990+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:01.000 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:00.995+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:01.181 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:01.178+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:01.583 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:01.579+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:01.722 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:01.718+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:01.769 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:01.759+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:01.955 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:01.950+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:02.033 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:02.028+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:02.175 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:02.171+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:02.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:02.571+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:02.689 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:02.685+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:02.776 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:02.771+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:03.006 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:03.000+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:03.020 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:03.014+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:03.157 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:03.153+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:03.585 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:03.577+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:03.720 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:03.712+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:03.737 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:03.732+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:03.976 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:03.971+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:04.047 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:04.041+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:04.155 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:04.151+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:04.539 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:04.534+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:04.689 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:04.685+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:04.780 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:04.776+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:04.965 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:04.961+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:05.030 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:05.025+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:05.198 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:05.195+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:05.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:05.541+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:05.708 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:05.703+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:05.785 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:05.773+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:05.995 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:05.987+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:06.012 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:06.007+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:06.195 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:06.192+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:06.522 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:06.517+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:06.671 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:06.667+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:06.818 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:06.813+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:07.008 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:07.002+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:07.047 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:13:07.044+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e748 v748) 2019-12-09T21:13:07.050 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:07.046+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:07.215 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:07.212+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:07.481 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:07.477+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:07.638 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:07.631+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:07.871 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:07.858+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:08.047 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:08.042+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:08.086 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:08.082+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:08.171 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:08.166+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:08.472 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:08.467+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:08.634 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:08.629+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:08.844 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:08.838+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:09.060 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:09.057+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:09.095 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:09.091+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:09.130 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:09.127+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:09.520 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:09.515+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:09.615 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:09.610+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:09.893 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:09.888+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:10.068 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:10.062+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:10.104 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:10.101+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:10.121 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:10.119+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:10.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:10.563+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:10.580 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:10.576+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:10.912 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:10.904+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:11.110 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:11.085+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:11.113 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:11.103+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:11.157 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:11.144+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:11.601 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:11.593+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:11.604 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:11.599+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:11.883 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:11.879+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:12.079 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:13:12.067+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e748 v748) 2019-12-09T21:13:12.109 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:12.104+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:12.110 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:12.101+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:12.158 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:12.155+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:12.596 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:12.592+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:12.646 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:12.631+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:12.910 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:12.906+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:13.066 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:13.064+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:13.149 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:13.145+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:13.153 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:13.151+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:13.626 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:13.622+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:13.631 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:13.627+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:13.865 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:13.861+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:14.073 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:14.070+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:14.115 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:14.110+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:14.165 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:14.161+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:14.642 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:14.631+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:14.668 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:14.663+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:14.870 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:14.866+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:15.029 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:15.023+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:15.132 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:15.129+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:15.141 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:15.134+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:15.617 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:15.591+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:15.667 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:15.663+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:15.854 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:15.846+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:16.047 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:16.043+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:16.087 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:16.084+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:16.104 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:16.098+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:16.633 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:13:16.631+0000 1694f700 -1 osd.3 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:50.162735+0000 front 2019-12-09T21:11:50.018372+0000 (oldest deadline 2019-12-09T21:12:33.955532+0000) 2019-12-09T21:13:16.637 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:16.632+0000 1694f700 -1 osd.5 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:51.299888+0000 front 2019-12-09T21:11:52.704931+0000 (oldest deadline 2019-12-09T21:12:35.192843+0000) 2019-12-09T21:13:16.861 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:13:16.857+0000 1694f700 -1 osd.4 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.708691+0000 front 2019-12-09T21:11:53.632471+0000 (oldest deadline 2019-12-09T21:12:34.066547+0000) 2019-12-09T21:13:17.035 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:13:17.031+0000 1694f700 -1 osd.2 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.730595+0000 front 2019-12-09T21:11:53.809813+0000 (oldest deadline 2019-12-09T21:12:37.781512+0000) 2019-12-09T21:13:17.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:13:17.063+0000 1694f700 -1 osd.7 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:52.796142+0000 front 2019-12-09T21:11:53.573672+0000 (oldest deadline 2019-12-09T21:12:34.434488+0000) 2019-12-09T21:13:17.113 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:13:17.109+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e748 v748) 2019-12-09T21:13:17.129 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:13:17.125+0000 1694f700 -1 osd.1 748 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:11:53.582979+0000 front 2019-12-09T21:11:52.589448+0000 (oldest deadline 2019-12-09T21:12:36.660282+0000) 2019-12-09T21:13:47.996 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:13:47.990+0000 1694f700 -1 osd.5 750 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:125827 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 5419134048 gen 10] snapc 0=[] ondisk+write+known_if_redirected e749) 2019-12-09T21:13:52.439 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:08:13.498 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:13:52.488 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:08:13.547 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:13:52.489 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:08:13.548 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:13:52.500 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:08:13.559 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:13:52.563 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:08:13.598 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:13:52.564 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:08:13.600 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:13:52.636 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:08:13.695 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:13:52.682 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:08:13.741 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:13:52.718 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:08:13.754 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:14:06.361 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:14:06.289+0000 32f89700 -1 osd.0 753 build_incremental_map_msg missing incremental map 753 2019-12-09T21:14:06.931 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:14:06.878+0000 31786700 -1 osd.0 754 build_incremental_map_msg missing incremental map 754 2019-12-09T21:14:07.256 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:14:07.218+0000 31f87700 -1 osd.0 754 build_incremental_map_msg missing incremental map 754 2019-12-09T21:14:07.403 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:14:07.278+0000 3478c700 -1 osd.0 754 build_incremental_map_msg missing incremental map 754 2019-12-09T21:14:07.472 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:14:07.347+0000 32788700 -1 osd.0 754 build_incremental_map_msg missing incremental map 754 2019-12-09T21:14:07.695 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:14:07.665+0000 36f91700 -1 osd.0 754 build_incremental_map_msg missing incremental map 754 2019-12-09T21:14:07.700 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:14:07.667+0000 3378a700 -1 osd.0 754 build_incremental_map_msg missing incremental map 754 2019-12-09T21:14:07.706 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:14:07.691+0000 31f87700 -1 osd.0 754 build_incremental_map_msg missing incremental map 754 2019-12-09T21:14:07.713 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:14:07.694+0000 32f89700 -1 osd.0 754 build_incremental_map_msg missing incremental map 754 2019-12-09T21:14:09.541 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:14:09.514+0000 37f93700 -1 osd.0 756 build_incremental_map_msg missing incremental map 754 2019-12-09T21:14:12.229 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:14:12.226+0000 34f8d700 -1 osd.0 758 build_incremental_map_msg missing incremental map 753 2019-12-09T21:14:12.229 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:14:12.227+0000 34f8d700 -1 osd.0 758 build_incremental_map_msg missing incremental map 754 2019-12-09T21:15:10.549 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:10.544+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:11.220 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:11.216+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:11.525 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:11.522+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:12.209 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:12.202+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:12.580 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:12.575+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:12.984 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:12.980+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:13.165 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:13.160+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:13.524 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:13.519+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:13.579 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:13.575+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:13.963 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:13.958+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:14.071 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:14.067+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:14.214 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:14.209+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:14.227 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:14.224+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:14.507 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:14.503+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:14.599 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:14.580+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:15.001 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:14.996+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:15.062 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:15.058+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:15.257 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:15.253+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:15.262 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:15.258+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:15.528 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:15.523+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:15.564 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:15.560+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:16.046 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:16.044+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:16.046 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:16.042+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:16.219 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:16.215+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:16.298 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:16.290+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:16.547 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:16.542+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:16.565 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:16.562+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:17.003 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:17.000+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:17.049 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:17.042+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:17.211 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:17.202+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:17.294 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:17.282+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:17.535 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:17.530+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:17.540 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:17.536+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:18.014 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:18.011+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:18.026 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:18.022+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:18.243 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:18.238+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:18.245 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:18.240+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:18.496 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:18.494+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:18.508 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:18.503+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:19.045 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:19.039+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:19.067 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:19.064+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:19.254 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:19.246+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:19.285 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:19.281+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:19.521 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:19.517+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:19.549 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:19.545+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:20.039 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:20.034+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:20.058 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:20.054+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:20.261 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:20.257+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:20.327 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:20.323+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:20.481 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:20.475+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:20.562 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:20.557+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:21.021 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:21.018+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:21.050 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:21.044+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:21.270 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:21.267+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:21.338 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:21.334+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:21.498 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:21.494+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:21.578 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:21.573+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:22.003 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:21.999+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:22.041 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:22.027+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:22.249 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:22.242+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:22.350 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:22.347+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:22.520 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:22.517+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:22.607 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:22.603+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:23.040 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:23.034+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:23.041 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:23.034+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:23.287 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:23.283+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:23.325 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:23.321+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:23.477 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:23.475+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:23.615 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:23.611+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:24.017 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:24.012+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:24.031 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:24.027+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:24.290 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:24.287+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:24.365 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:24.357+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:24.467 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:24.466+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:24.648 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:24.644+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:25.025 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:25.022+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:25.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:25.053+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:25.287 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:25.284+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:25.388 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:25.384+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:25.445 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:25.443+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:25.701 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:25.692+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:25.988 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:25.975+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:26.071 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:26.066+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:26.310 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:26.306+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:26.351 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:26.347+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:26.432 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:26.428+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:26.682 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:26.678+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:26.956 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:26.954+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:27.060 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:27.056+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:27.274 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:27.271+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:27.331 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:27.327+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:27.406 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:27.403+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:27.655 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:27.652+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:27.942 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:27.918+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:28.083 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:28.079+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:28.322 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:28.316+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:28.338 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:28.333+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:28.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:28.421+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:28.628 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:28.622+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:28.918 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:28.914+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:29.043 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:29.038+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:29.337 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:29.332+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:29.390 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:29.385+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:29.422 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:29.420+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:29.597 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:29.593+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:29.961 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:29.959+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:30.047 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:30.042+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:30.337 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:30.324+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:30.365 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:30.360+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:30.426 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:30.423+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:30.585 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:30.580+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:30.964 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:30.961+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:31.017 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:31.012+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:31.350 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:31.346+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:31.351 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:31.348+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:31.456 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:31.453+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:31.575 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:31.570+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:31.996 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:31.993+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:32.069 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:32.062+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:32.354 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:32.351+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:32.370 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:32.364+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:32.430 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:32.427+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:32.538 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:32.533+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:32.985 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:32.976+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:33.101 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:33.096+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:33.319 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:33.316+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:33.347 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:33.342+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:33.448 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:33.445+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:33.511 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:33.507+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:34.021 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:34.018+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:34.059 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:34.053+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:34.319 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:34.316+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:34.378 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:34.374+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:34.497 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:34.494+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:34.521 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:34.515+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:34.985 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:34.977+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:35.082 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:35.078+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:35.334 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:35.330+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:35.352 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:35.344+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:35.500 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:35.496+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:35.505 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:35.501+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:36.013 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:36.011+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:36.126 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:36.122+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:36.328 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:36.323+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:36.343 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:36.339+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:36.527 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:36.524+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:36.548 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:36.544+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:37.064 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:37.061+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:37.129 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:37.123+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:37.360 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:37.357+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:37.370 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:37.366+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:37.534 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:37.530+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:37.580 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:37.577+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:38.086 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:38.082+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:38.092 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:38.089+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:38.316 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:38.313+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:38.399 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:38.394+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:38.520 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:38.516+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:38.632 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:38.630+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:39.078 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:39.074+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:39.096 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:39.091+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:39.304 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:39.300+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:39.381 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:39.377+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:39.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:39.564+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:39.608 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:39.605+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:40.038 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:40.035+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:40.142 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:40.138+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:40.312 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:40.307+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:40.339 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:40.336+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:40.609 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:40.606+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:40.655 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:40.652+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:41.028 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:41.025+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:41.110 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:41.105+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:41.357 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:41.354+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:41.365 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:41.360+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:41.618 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:41.615+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:41.689 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:41.686+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:42.059 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:42.055+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:42.081 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:42.075+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:42.360 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:42.356+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:42.373 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:42.370+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:42.615 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:42.611+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:42.735 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:42.730+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:43.022 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:43.019+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:43.088 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:43.084+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:43.389 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:43.385+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:43.426 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:43.423+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:43.657 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:43.653+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:43.720 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:43.717+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:43.980 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:43.976+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:44.122 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:44.117+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:44.422 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:44.418+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:44.434 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:44.430+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:44.672 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:44.670+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:44.721 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:44.713+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:44.981 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:44.979+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:45.153 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:45.149+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:45.388 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:45.384+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:45.408 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:45.405+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:45.635 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:45.632+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:45.749 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:45.746+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:45.979 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:45.977+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:46.135 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:46.127+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:46.358 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:46.353+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:46.461 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:46.457+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:46.679 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:46.675+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:46.716 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:46.711+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:46.988 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:46.986+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:47.123 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:10:08.181 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:15:47.134 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:10:08.193 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:15:47.140 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:47.131+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:47.141 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:10:08.200 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:15:47.148 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:10:08.208 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:15:47.151 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:10:08.187 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:15:47.166 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:10:08.203 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:15:47.264 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:10:08.324 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:15:47.281 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:10:08.340 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:15:47.342 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:47.334+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:47.410 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:10:08.446 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:15:47.449 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:47.447+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:47.706 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:47.704+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:47.762 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:47.757+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:47.799 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:15:47.787+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e759 v759) 2019-12-09T21:15:48.012 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:48.009+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:48.146 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:48.143+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:48.346 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:48.342+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:48.441 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:48.438+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:48.674 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:48.671+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:48.789 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:48.786+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:48.975 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:48.973+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:49.192 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:49.188+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:49.398 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:49.390+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:49.434 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:49.432+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:49.666 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:49.664+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:49.763 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:49.758+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:49.954 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:49.951+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:50.157 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:50.152+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:50.413 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:50.408+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:50.454 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:50.450+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:50.690 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:50.687+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:50.819 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:50.812+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:51.001 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:50.998+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:51.118 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:51.113+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:51.443 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:51.438+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:51.502 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:51.498+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:51.645 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:51.643+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:51.832 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:51.825+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:52.029 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:15:52.025+0000 1694f700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.488181+0000 front 2019-12-09T21:14:29.006190+0000 (oldest deadline 2019-12-09T21:15:13.680119+0000) 2019-12-09T21:15:52.102 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:15:52.098+0000 1694f700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:27.943566+0000 front 2019-12-09T21:14:27.934886+0000 (oldest deadline 2019-12-09T21:15:12.010318+0000) 2019-12-09T21:15:52.476 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:15:52.471+0000 1694f700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:29.775597+0000 front 2019-12-09T21:14:29.784941+0000 (oldest deadline 2019-12-09T21:15:11.137632+0000) 2019-12-09T21:15:52.509 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:15:52.507+0000 1694f700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.257543+0000 front 2019-12-09T21:14:28.260905+0000 (oldest deadline 2019-12-09T21:15:13.531064+0000) 2019-12-09T21:15:52.645 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:15:52.640+0000 1694f700 -1 osd.3 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.934201+0000 front 2019-12-09T21:14:29.202751+0000 (oldest deadline 2019-12-09T21:15:09.973956+0000) 2019-12-09T21:15:52.823 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:15:52.818+0000 1694f700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:14:28.090311+0000 front 2019-12-09T21:14:28.169799+0000 (oldest deadline 2019-12-09T21:15:12.706913+0000) 2019-12-09T21:15:52.899 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:15:52.892+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e759 v759) 2019-12-09T21:16:23.311 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:10:44.370 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:16:23.331 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:10:44.390 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:16:23.373 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:10:44.429 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:16:23.381 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:10:44.439 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:16:23.393 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:10:44.452 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:16:23.424 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:10:44.460 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:16:23.429 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:10:44.465 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:16:23.443 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:10:44.500 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:16:23.527 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:10:44.563 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:17:46.047 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:46.043+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:46.282 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:46.279+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:46.454 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:46.449+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:47.100 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:47.095+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:47.301 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:47.294+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:47.426 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:47.424+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:47.688 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:47.685+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:17:48.109 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:48.099+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:48.282 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:48.278+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:48.434 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:48.431+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:48.653 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:48.648+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:17:49.104 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:49.099+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:49.330 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:49.327+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:49.405 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:49.403+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:49.665 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:49.661+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:17:50.086 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:50.081+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:50.363 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:50.360+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:50.384 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:50.381+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:50.473 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:17:50.463+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:17:50.629 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:50.626+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:17:51.068 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:51.064+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:51.320 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:51.316+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:51.350 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:51.345+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:51.495 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:17:51.491+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:17:51.650 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:51.646+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:17:52.046 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:52.039+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:52.336 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:52.332+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:52.394 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:52.389+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:52.484 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:17:52.479+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:17:52.656 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:52.652+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:17:53.079 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:53.074+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:53.349 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:53.346+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:53.443 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:53.440+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:53.466 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:17:53.462+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:17:53.615 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:12:14.674 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:17:53.651 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:12:14.711 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:17:53.671 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:12:14.707 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:17:53.673 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:53.669+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:17:53.689 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:12:14.748 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:17:53.693 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:12:14.752 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:17:53.701 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:12:14.737 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:17:53.792 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:12:14.851 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:17:53.810 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:12:14.846 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:17:53.856 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:12:14.915 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:17:54.042 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:54.039+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:54.399 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:54.396+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:54.436 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:54.434+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:54.477 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:17:54.475+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:17:54.676 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:54.673+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:17:55.019 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:55.012+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:55.422 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:55.419+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:55.455 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:55.452+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:55.503 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:17:55.500+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:17:55.700 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:55.696+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:17:56.058 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:56.053+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:56.378 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:56.374+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:56.503 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:56.499+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:56.506 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:17:56.503+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:17:56.744 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:56.740+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:17:57.025 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:57.015+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:57.333 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:57.331+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:57.553 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:17:57.546+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:17:57.553 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:57.545+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:57.732 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:57.728+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:17:58.008 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:58.004+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:58.220 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:17:58.216+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:17:58.304 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:58.300+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:58.504 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:58.501+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:58.537 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:17:58.534+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:17:58.758 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:58.754+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:17:58.993 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:58.977+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:17:59.257 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:17:59.252+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:17:59.260 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:17:59.257+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:17:59.515 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:17:59.511+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:17:59.520 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:17:59.515+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:17:59.765 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:17:59.762+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:00.002 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:17:59.999+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:00.225 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:00.220+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:00.229 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:00.225+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:00.487 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:00.484+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:00.540 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:00.537+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:00.776 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:00.771+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:01.005 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:01.000+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:01.196 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:01.193+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:01.267 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:01.261+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:01.458 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:01.454+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:01.534 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:01.530+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:01.789 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:01.786+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:01.971 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:01.967+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:02.195 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:02.191+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:02.297 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:02.292+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:02.485 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:02.482+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:02.570 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:02.567+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:02.745 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:02.742+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:03.017 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:03.014+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:03.163 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:03.159+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:03.348 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:03.344+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:03.465 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:03.457+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:03.533 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:03.526+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:03.802 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:03.798+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:04.062 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:04.058+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:04.145 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:04.136+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:04.394 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:04.389+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:04.486 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:04.482+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:04.511 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:04.508+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:04.855 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:04.851+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:05.024 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:05.020+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:05.113 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:05.110+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:05.435 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:05.431+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:05.509 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:05.499+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:05.551 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:05.546+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:05.820 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:05.815+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:06.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:06.058+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:06.167 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:06.162+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:06.418 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:06.413+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:06.492 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:06.489+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:06.512 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:06.508+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:06.802 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:06.797+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:07.033 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:07.030+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:07.150 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:07.147+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:07.421 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:07.417+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:07.505 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:07.499+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:07.505 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:07.500+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:07.828 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:07.818+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:08.044 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:08.040+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:08.135 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:08.131+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:08.396 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:08.382+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:08.511 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:08.501+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:08.561 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:08.550+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:08.823 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:08.818+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:09.041 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:09.027+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:09.170 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:09.166+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:09.405 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:09.396+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:09.496 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:09.491+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:09.584 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:09.579+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:09.855 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:09.850+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:10.041 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:10.036+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:10.150 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:10.147+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:10.438 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:10.434+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:10.461 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:10.449+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:10.583 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:10.579+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:10.845 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:10.840+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:11.078 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:11.074+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:11.193 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:11.188+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:11.467 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:11.463+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:11.491 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:11.487+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:11.612 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:11.609+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:11.882 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:11.876+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:12.100 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:12.096+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:12.229 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:12.226+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:12.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:12.460+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:12.506 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:12.502+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:12.581 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:12.576+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:12.915 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:12.910+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:13.108 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:13.104+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:13.185 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:13.181+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:13.495 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:13.490+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:13.517 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:13.513+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:13.613 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:13.608+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:13.928 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:13.922+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:14.129 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:14.124+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:14.181 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:14.176+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:14.514 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:14.509+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:14.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:14.509+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:14.617 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:14.612+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:14.955 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:14.951+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:15.164 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:15.159+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:15.167 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:15.163+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:15.493 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:15.488+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:15.541 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:15.538+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:15.606 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:15.598+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:15.975 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:15.971+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:16.124 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:16.118+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:16.142 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:16.138+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:16.472 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:16.468+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:16.561 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:16.557+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:16.564 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:16.560+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:16.960 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:16.956+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:17.086 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:17.083+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:17.105 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:17.100+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:17.459 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:17.455+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:17.543 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:17.539+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:17.557 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:17.552+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:17.993 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:17.989+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:18.067 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:18.062+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:18.107 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:18.102+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:18.480 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:18.469+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:18.548 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:18.544+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:18.581 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:18.577+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:18.659 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:18:18.652+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e772 v772) 2019-12-09T21:18:19.001 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:18.997+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:19.060 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:19.056+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:19.151 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:19.149+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:19.493 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:19.488+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:19.507 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:19.503+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:19.625 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:19.615+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:19.973 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:19.969+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:20.080 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:20.074+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:20.157 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:20.153+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:20.466 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:20.460+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:20.541 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:20.537+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:20.604 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:20.599+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:20.968 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:20.964+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:21.073 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:21.068+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:21.142 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:21.137+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:21.466 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:21.462+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:21.541 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:21.537+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:21.635 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:21.630+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:21.989 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:21.979+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:22.113 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:22.108+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:22.179 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:22.175+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:22.486 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:22.481+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:22.585 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:22.581+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:22.665 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:22.656+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:22.963 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:22.959+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:23.080 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:23.076+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:23.147 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:23.143+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:23.457 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:23.451+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:23.632 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:23.628+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:23.670 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:18:23.667+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e772 v772) 2019-12-09T21:18:23.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:23.673+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:23.942 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:23.937+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:24.060 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:24.055+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:24.107 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:24.103+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:24.486 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:24.481+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:24.659 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:24.655+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:24.661 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:24.658+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:24.944 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:24.940+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:25.040 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:25.037+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:25.135 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:25.132+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:25.487 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:25.483+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:25.638 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:25.633+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:25.642 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:25.637+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:25.997 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:25.993+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:26.073 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:26.070+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:26.142 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:26.138+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:26.499 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:26.493+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:26.645 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:26.640+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:26.680 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:26.674+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:27.047 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:27.043+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:27.068 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:27.065+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:27.196 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:27.192+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:27.452 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:27.449+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:27.599 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:27.595+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:27.727 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:27.723+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:28.019 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:18:28.016+0000 1694f700 -1 osd.4 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.351821+0000 front 2019-12-09T21:17:01.370815+0000 (oldest deadline 2019-12-09T21:17:46.980859+0000) 2019-12-09T21:18:28.097 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:18:28.093+0000 1694f700 -1 osd.1 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:00.077288+0000 front 2019-12-09T21:17:00.472342+0000 (oldest deadline 2019-12-09T21:17:45.971538+0000) 2019-12-09T21:18:28.198 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:18:28.195+0000 1694f700 -1 osd.5 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:01.437721+0000 front 2019-12-09T21:17:01.163271+0000 (oldest deadline 2019-12-09T21:17:45.815459+0000) 2019-12-09T21:18:28.415 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:18:28.412+0000 1694f700 -1 osd.3 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:02.108577+0000 front 2019-12-09T21:17:02.150185+0000 (oldest deadline 2019-12-09T21:17:45.574679+0000) 2019-12-09T21:18:28.637 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:18:28.632+0000 1694f700 -1 osd.7 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:16:59.869848+0000 front 2019-12-09T21:16:59.867401+0000 (oldest deadline 2019-12-09T21:17:57.697319+0000) 2019-12-09T21:18:28.690 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:18:28.688+0000 1694f700 -1 osd.2 772 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:17:04.465023+0000 front 2019-12-09T21:17:04.954345+0000 (oldest deadline 2019-12-09T21:17:49.719097+0000) 2019-12-09T21:18:28.741 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:18:28.734+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e772 v772) 2019-12-09T21:19:26.417 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:19:26.313+0000 37792700 -1 osd.0 783 build_incremental_map_msg missing incremental map 753 2019-12-09T21:19:26.466 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:19:26.314+0000 37792700 -1 osd.0 783 build_incremental_map_msg missing incremental map 754 2019-12-09T21:19:29.835 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:13:50.894 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:19:29.847 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:13:50.906 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:19:29.861 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:13:50.898 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:19:29.864 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:13:50.924 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:19:29.864 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:13:50.901 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:19:29.868 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:13:50.927 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:19:30.010 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:13:51.069 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:19:30.020 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:13:51.080 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:19:30.038 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:13:51.071 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:20:19.500 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:19.495+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:20.369 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:20.365+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:20.508 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:20.503+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:21.205 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:21.199+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:21.345 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:21.341+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:21.521 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:21.517+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:22.232 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:22.227+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:22.349 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:22.345+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:22.517 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:22.513+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:23.075 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:23.071+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:23.203 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:23.199+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:23.281 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:23.277+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:23.397 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:23.393+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:23.517 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:23.511+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:23.820 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:23.815+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:24.089 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:24.080+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:24.220 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:24.216+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:24.254 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:24.247+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:24.454 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:24.445+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:24.479 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:24.473+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:24.836 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:24.826+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:25.094 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:25.091+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:25.182 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:25.177+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:25.213 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:25.208+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:25.458 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:25.449+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:25.476 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:25.473+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:25.880 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:25.876+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:26.086 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:26.083+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:26.209 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:26.206+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:26.252 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:26.247+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:26.459 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:26.456+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:26.482 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:26.477+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:26.911 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:26.907+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:27.133 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:27.129+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:27.216 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:27.209+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:27.234 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:27.229+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:27.460 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:27.455+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:27.484 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:27.480+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:27.885 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:27.879+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:28.158 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:28.154+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:28.215 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:28.210+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:28.273 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:28.268+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:28.484 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:28.480+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:28.527 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:28.523+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:28.885 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:28.881+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:29.201 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:29.196+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:29.220 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:29.215+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:29.239 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:29.228+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:29.500 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:29.487+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:29.533 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:29.529+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:29.899 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:29.895+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:30.176 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:30.172+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:30.241 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:30.237+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:30.274 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:30.270+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:30.511 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:30.503+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:30.559 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:30.554+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:30.953 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:30.948+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:31.224 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:31.221+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:31.286 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:31.280+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:31.316 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:31.308+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:31.550 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:31.545+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:31.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:31.563+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:31.943 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:31.938+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:32.238 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:32.233+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:32.275 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:32.271+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:32.289 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:32.285+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:32.585 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:32.581+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:32.616 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:32.612+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:32.908 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:32.905+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:33.249 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:33.245+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:33.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:33.249+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:33.254 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:33.250+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:33.596 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:33.591+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:33.626 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:33.622+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:33.876 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:33.871+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:34.247 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:34.243+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:34.260 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:34.253+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:34.260 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:34.256+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:34.609 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:34.602+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:34.648 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:34.642+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:34.873 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:34.869+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:35.222 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:35.218+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:35.272 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:35.270+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:35.302 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:35.298+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:35.632 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:35.628+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:35.664 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:35.660+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:35.838 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:35.833+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:36.260 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:36.251+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:36.305 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:36.297+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:36.305 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:36.301+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:36.591 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:36.588+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:36.625 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:36.622+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:36.870 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:36.864+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:37.277 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:37.271+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:37.325 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:37.318+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:37.345 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:37.333+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:37.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:37.571+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:37.579 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:37.575+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:37.860 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:37.853+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:38.236 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:38.232+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:38.330 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:38.327+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:38.345 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:38.342+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:38.559 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:38.552+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:38.631 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:38.627+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:38.871 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:38.865+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:39.254 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:39.250+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:39.344 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:39.342+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:39.383 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:39.380+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:39.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:39.564+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:39.610 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:39.607+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:39.882 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:39.878+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:40.215 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:40.211+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:40.358 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:40.355+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:40.369 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:40.366+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:40.567 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:40.563+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:40.593 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:40.589+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:40.857 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:40.849+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:41.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:41.242+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:41.367 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:41.365+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:41.400 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:41.397+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:41.565 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:41.561+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:41.639 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:41.635+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:41.880 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:41.875+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:42.295 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:42.291+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:42.397 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:42.394+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:42.433 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:42.429+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:42.559 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:42.547+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:42.673 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:42.669+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:42.858 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:42.854+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:43.306 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:43.301+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:43.427 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:43.425+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:43.466 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:43.463+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:43.553 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:43.547+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:43.633 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:43.629+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:43.871 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:43.867+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:44.285 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:44.281+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:44.443 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:44.440+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:44.475 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:44.471+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:44.545 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:44.542+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:44.641 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:44.636+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:44.909 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:44.904+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:45.275 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:45.271+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:45.458 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:45.456+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:45.468 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:45.465+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:45.515 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:45.511+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:45.651 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:45.647+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:45.933 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:45.929+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:46.325 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:46.317+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:46.440 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:46.436+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:46.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:46.479+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:46.497 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:46.490+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:46.631 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:46.625+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:46.942 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:46.938+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:47.304 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:47.300+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:47.397 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:47.393+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:47.456 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:47.452+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:47.469 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:47.466+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:47.603 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:47.600+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:47.908 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:47.905+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:48.314 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:48.303+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:48.371 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:48.358+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:48.476 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:48.473+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:48.482 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:48.479+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:48.569 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:48.563+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:48.894 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:48.889+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:49.269 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:49.265+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:49.326 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:49.324+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:49.435 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:49.432+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:49.499 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:49.495+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:49.569 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:49.565+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:49.957 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:49.946+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:50.238 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:50.234+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:50.300 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:50.295+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:50.391 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:50.389+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:50.471 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:50.468+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:50.544 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:50.540+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:50.969 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:50.965+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:51.271 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:51.267+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:51.279 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:51.275+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:51.428 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:51.424+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:51.432 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:51.428+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:51.529 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:51.519+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:51.977 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:51.966+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:52.257 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:52.253+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:52.325 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:52.322+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:52.399 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:52.397+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:52.401 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:52.395+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:52.551 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:52.547+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:52.976 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:52.971+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:53.256 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:53.252+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:53.373 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:53.369+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:53.373 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:53.370+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:53.374 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:53.370+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:53.534 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:53.530+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:53.950 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:53.945+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:54.216 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:54.211+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:54.276 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:20:54.272+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e784 v784) 2019-12-09T21:20:54.405 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:54.403+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:54.407 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:54.404+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:54.422 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:54.419+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:54.549 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:54.546+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:54.916 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:54.913+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:55.192 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:55.188+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:55.391 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:55.389+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:55.424 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:55.422+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:55.424 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:55.422+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:55.572 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:55.569+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:55.913 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:55.909+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:56.241 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:56.237+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:56.393 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:56.389+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:56.434 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:56.429+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:56.476 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:56.472+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:56.532 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:56.528+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:56.953 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:56.943+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:57.278 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:57.274+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:57.389 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:57.386+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:57.437 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:57.428+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:57.529 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:57.525+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:57.536 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:57.526+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:57.979 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:57.975+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:58.256 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:58.252+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:58.366 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:58.363+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:58.440 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:58.437+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:58.527 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:58.522+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:20:58.528 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:58.524+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:59.027 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:20:59.022+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:20:59.283 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:20:59.278+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:20:59.336 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:20:59.333+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e784 v784) 2019-12-09T21:20:59.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:20:59.414+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:20:59.486 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:20:59.482+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:20:59.491 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:20:59.486+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:20:59.523 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:20:59.520+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:21:00.048 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:21:00.043+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:21:00.242 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:21:00.238+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:21:00.391 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:21:00.387+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:21:00.466 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:21:00.461+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:21:00.471 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:21:00.465+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:21:00.543 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:21:00.539+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:21:01.020 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:21:01.016+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:21:01.230 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:21:01.224+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:21:01.415 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:21:01.413+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:21:01.444 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:21:01.440+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:21:01.474 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:21:01.471+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:21:01.548 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:21:01.545+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:21:02.013 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:21:02.009+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:21:02.272 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:21:02.267+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:21:02.429 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:21:02.424+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:21:02.463 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:21:02.460+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:21:02.512 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:21:02.509+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:21:02.523 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:21:02.519+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:21:03.050 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:21:03.045+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:21:03.323 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:21:03.319+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:21:03.386 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:21:03.382+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:21:03.446 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:21:03.441+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:21:03.504 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:21:03.501+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:21:03.525 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:21:03.521+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:21:04.011 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:21:04.007+0000 1694f700 -1 osd.4 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.366907+0000 front 2019-12-09T21:19:38.192922+0000 (oldest deadline 2019-12-09T21:20:22.869526+0000) 2019-12-09T21:21:04.295 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:21:04.290+0000 1694f700 -1 osd.7 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.366672+0000 front 2019-12-09T21:19:37.703043+0000 (oldest deadline 2019-12-09T21:20:23.171961+0000) 2019-12-09T21:21:04.416 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:21:04.408+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e784 v784) 2019-12-09T21:21:04.434 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:21:04.430+0000 1694f700 -1 osd.5 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.665756+0000 front 2019-12-09T21:19:37.673081+0000 (oldest deadline 2019-12-09T21:20:19.513157+0000) 2019-12-09T21:21:04.466 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:21:04.464+0000 1694f700 -1 osd.3 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.833746+0000 front 2019-12-09T21:19:38.844109+0000 (oldest deadline 2019-12-09T21:20:22.930202+0000) 2019-12-09T21:21:04.502 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:21:04.489+0000 1694f700 -1 osd.2 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:38.181904+0000 front 2019-12-09T21:19:37.539639+0000 (oldest deadline 2019-12-09T21:20:20.415950+0000) 2019-12-09T21:21:04.514 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:21:04.511+0000 1694f700 -1 osd.1 784 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:19:37.321965+0000 front 2019-12-09T21:19:37.341979+0000 (oldest deadline 2019-12-09T21:20:19.472620+0000) 2019-12-09T21:22:51.465 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:22:51.461+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:22:51.505 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:22:51.502+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:22:52.488 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:22:52.484+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:22:52.546 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:22:52.544+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:22:52.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:22:52.616+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:22:52.960 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:22:52.956+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:22:53.498 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:22:53.495+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:22:53.556 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:22:53.552+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:22:53.596 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:22:53.593+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:22:53.611 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:22:53.609+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:22:53.948 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:22:53.944+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:22:54.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:22:54.450+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:22:54.533 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:22:54.519+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:22:54.569 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:22:54.562+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:22:54.587 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:22:54.581+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:22:54.626 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:22:54.622+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:22:54.950 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:22:54.947+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:22:55.452 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:22:55.447+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:22:55.509 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:22:55.504+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:22:55.553 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:22:55.548+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:22:55.579 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:22:55.577+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:22:55.616 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:22:55.613+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:22:55.908 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:22:55.904+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:22:56.425 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:22:56.421+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:22:56.545 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:22:56.540+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:22:56.572 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:22:56.570+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:22:56.587 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:22:56.583+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:22:56.631 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:22:56.628+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:22:56.899 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:22:56.895+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:22:57.469 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:22:57.466+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:22:57.528 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:22:57.525+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:22:57.549 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:22:57.540+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:22:57.581 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:22:57.577+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:22:57.669 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:22:57.666+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:22:57.931 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:22:57.926+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:22:58.507 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:22:58.503+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:22:58.514 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:22:58.511+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:22:58.554 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:22:58.550+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:22:58.581 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:22:58.579+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:22:58.628 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:22:58.622+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:22:58.888 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:22:58.885+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:22:59.465 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:22:59.459+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:22:59.480 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:22:59.477+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:22:59.607 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:22:59.604+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:22:59.608 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:22:59.604+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:22:59.660 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:22:59.657+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:22:59.874 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:22:59.870+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:00.458 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:00.453+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:00.483 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:00.478+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:00.616 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:00.611+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:00.622 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:00.617+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:00.693 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:00.688+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:00.880 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:00.873+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:01.467 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:01.465+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:01.489 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:01.485+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:01.628 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:01.625+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:01.640 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:01.635+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:01.664 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:01.661+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:01.862 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:01.857+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:02.444 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:02.440+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:02.473 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:02.469+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:02.635 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:02.631+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:02.678 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:02.675+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:02.678 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:02.674+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:02.852 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:02.847+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:03.417 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:03.413+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:03.427 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:03.424+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:03.633 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:03.626+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:03.698 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:03.695+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:03.699 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:03.695+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:03.861 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:03.857+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:04.390 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:04.386+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:04.412 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:04.409+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:04.604 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:04.601+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:04.672 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:04.668+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:04.709 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:04.705+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:04.868 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:04.864+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:05.432 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:05.428+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:05.445 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:05.442+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:05.635 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:05.632+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:05.638 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:05.635+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:05.737 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:05.732+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:05.829 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:05.825+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:06.456 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:06.448+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:06.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:06.460+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:06.663 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:06.660+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:06.683 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:06.671+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:06.713 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:06.709+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:06.850 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:06.846+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:07.434 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:07.431+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:07.466 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:07.462+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:07.624 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:07.617+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:07.678 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:07.674+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:07.752 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:07.748+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:07.897 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:07.892+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:08.432 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:08.429+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:08.484 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:08.480+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:08.671 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:08.667+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:08.709 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:08.702+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:08.731 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:08.727+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:08.928 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:08.919+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:09.432 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:09.428+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:09.504 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:09.501+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:09.624 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:09.621+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:09.685 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:09.682+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:09.751 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:09.747+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:09.973 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:09.968+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:10.459 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:10.454+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:10.514 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:10.511+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:10.596 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:10.592+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:10.647 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:10.641+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:10.800 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:10.796+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:10.937 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:10.933+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:11.428 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:11.425+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:11.509 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:11.506+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:11.624 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:11.620+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:11.648 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:11.639+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:11.793 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:11.785+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:11.944 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:11.934+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:12.387 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:12.382+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:12.529 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:12.526+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:12.596 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:12.593+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:12.665 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:12.661+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:12.794 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:12.790+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:12.954 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:12.950+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:13.388 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:13.384+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:13.503 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:13.500+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:13.604 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:13.601+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:13.685 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:13.682+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:13.845 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:13.841+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:13.994 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:13.990+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:14.416 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:14.412+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:14.519 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:14.516+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:14.644 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:14.641+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:14.664 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:14.660+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:14.852 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:14.849+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:14.987 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:14.983+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:15.438 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:15.434+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:15.485 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:15.479+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:15.649 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:15.646+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:15.662 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:15.658+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:15.808 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:15.805+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:16.030 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:16.025+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:16.453 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:16.450+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:16.477 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:16.473+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:16.648 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:16.643+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:16.698 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:16.692+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:16.789 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:16.787+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:17.044 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:17.040+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:17.410 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:17.407+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:17.445 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:17.441+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:17.629 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:17.625+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:17.683 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:17.679+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:17.778 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:17.775+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:18.051 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:18.044+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:18.427 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:18.424+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:18.455 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:18.451+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:18.649 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:18.646+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:18.670 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:18.665+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:18.831 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:18.828+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:19.016 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:19.012+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:19.458 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:19.455+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:19.477 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:19.468+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:19.639 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:19.635+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:19.668 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:19.664+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:19.871 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:19.868+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:20.036 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:20.031+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:20.472 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:20.465+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:20.496 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:20.490+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:20.671 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:20.665+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:20.706 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:20.697+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:20.834 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:20.831+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:21.064 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:21.053+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:21.454 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:21.450+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:21.479 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:21.476+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:21.720 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:21.717+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:21.756 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:21.751+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:21.817 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:21.814+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:22.016 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:22.013+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:22.419 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:22.415+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:22.472 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:22.469+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:22.772 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:22.766+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:22.772 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:22.764+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:22.781 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:22.778+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:23.005 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:23.002+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:23.446 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:23.442+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:23.491 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:23.487+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:23.749 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:23.745+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:23.751 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:23.747+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:23.808 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:23.803+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:23.998 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:23.994+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:24.410 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:24.406+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:24.521 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:24.517+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:24.718 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:24.711+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:24.720 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:24.716+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:24.827 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:24.822+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:24.834 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:23:24.831+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e794 v794) 2019-12-09T21:23:24.978 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:24.976+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:25.421 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:25.417+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:25.574 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:25.570+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:25.696 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:25.692+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:25.722 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:25.718+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:25.815 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:25.811+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:26.009 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:26.006+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:26.408 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:26.403+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:26.625 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:26.620+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:26.716 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:26.713+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:26.723 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:26.720+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:26.784 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:26.780+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:27.064 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:27.060+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:27.393 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:27.389+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:27.579 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:27.575+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:27.713 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:27.709+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:27.742 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:27.736+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:27.835 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:27.830+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:28.041 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:28.038+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:28.355 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:28.351+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:28.585 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:28.581+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:28.709 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:28.703+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:28.735 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:28.730+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:28.801 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:28.797+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:29.013 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:29.009+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:29.395 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:29.392+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:29.620 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:29.617+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:29.717 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:29.713+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:29.746 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:29.743+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:29.805 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:29.801+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:29.847 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:23:29.845+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e794 v794) 2019-12-09T21:23:30.003 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:29.999+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:30.373 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:30.367+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:30.610 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:30.606+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:30.719 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:30.716+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:30.720 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:30.716+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:30.854 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:30.850+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:31.060 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:31.057+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:31.339 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:31.328+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:31.627 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:31.623+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:31.686 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:31.682+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:31.694 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:31.691+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:31.834 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:31.831+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:32.045 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:32.042+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:32.297 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:32.293+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:32.653 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:32.647+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:32.657 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:32.652+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:32.735 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:32.730+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:32.855 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:32.851+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:33.085 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:33.081+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:33.297 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:33.292+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:33.656 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:33.652+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:33.684 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:33.678+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:33.728 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:33.724+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:33.821 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:33.817+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:34.044 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:23:34.039+0000 1694f700 -1 osd.5 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.693349+0000 front 2019-12-09T21:22:10.657882+0000 (oldest deadline 2019-12-09T21:22:52.827176+0000) 2019-12-09T21:23:34.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:23:34.300+0000 1694f700 -1 osd.7 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.053085+0000 front 2019-12-09T21:22:10.399932+0000 (oldest deadline 2019-12-09T21:22:54.142600+0000) 2019-12-09T21:23:34.614 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:23:34.610+0000 1694f700 -1 osd.4 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.101410+0000 front 2019-12-09T21:22:06.621676+0000 (oldest deadline 2019-12-09T21:22:51.186018+0000) 2019-12-09T21:23:34.697 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:23:34.692+0000 1694f700 -1 osd.2 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:07.463683+0000 front 2019-12-09T21:22:07.523792+0000 (oldest deadline 2019-12-09T21:22:50.944557+0000) 2019-12-09T21:23:34.768 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:23:34.765+0000 1694f700 -1 osd.1 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:10.521796+0000 front 2019-12-09T21:22:10.678122+0000 (oldest deadline 2019-12-09T21:22:52.134278+0000) 2019-12-09T21:23:34.793 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:23:34.780+0000 1694f700 -1 osd.3 794 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:22:09.361731+0000 front 2019-12-09T21:22:09.305203+0000 (oldest deadline 2019-12-09T21:22:52.800702+0000) 2019-12-09T21:23:34.904 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:23:34.899+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e794 v794) 2019-12-09T21:23:38.566 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:17:59.626 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:23:38.574 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:17:59.634 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:23:38.585 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:17:59.645 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:23:38.587 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:17:59.647 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:23:38.602 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:17:59.638 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:23:38.615 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:17:59.651 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:23:38.822 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:17:59.881 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:23:38.904 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:17:59.964 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:23:38.932 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:17:59.968 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:25:27.206 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:27.203+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:28.165 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:28.163+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:28.171 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:28.168+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:28.212 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:28.209+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:28.336 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:28.333+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:29.170 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:29.165+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:29.195 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:29.191+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:29.218 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:29.216+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:29.227 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:29.223+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:29.310 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:29.308+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:30.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:30.129+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:30.150 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:30.147+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:30.251 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:30.249+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:30.265 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:30.262+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:30.311 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:30.309+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:31.089 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:31.085+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:31.143 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:31.140+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:31.241 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:31.237+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:31.265 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:31.261+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:31.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:31.271+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:31.933 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:31.928+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:32.096 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:32.092+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:32.146 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:32.144+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:32.252 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:32.250+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:32.268 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:32.264+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:32.278 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:32.276+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:32.909 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:32.899+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:33.086 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:33.084+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:33.118 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:33.114+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:33.249 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:33.244+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:33.275 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:33.271+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:33.278 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:33.274+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:33.909 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:33.904+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:34.115 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:34.111+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:34.147 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:34.143+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:34.219 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:34.216+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:34.261 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:34.257+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:34.292 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:34.289+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:34.950 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:34.945+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:35.080 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:35.075+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:35.177 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:35.173+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:35.185 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:35.181+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:35.246 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:35.243+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:35.252 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:35.248+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:35.966 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:35.963+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:36.043 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:36.040+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:36.146 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:36.143+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:36.184 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:36.180+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:36.211 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:36.206+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:36.277 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:36.273+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:36.948 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:36.944+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:37.045 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:37.040+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:37.185 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:37.180+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:37.185 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:37.181+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:37.186 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:37.182+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:37.319 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:37.313+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:37.959 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:37.955+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:38.074 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:38.070+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:38.202 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:38.193+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:38.202 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:38.185+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:38.237 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:38.233+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:38.362 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:38.357+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:38.929 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:38.924+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:39.062 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:39.058+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:39.206 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:39.203+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:39.238 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:39.234+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:39.266 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:39.262+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:39.407 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:39.403+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:39.958 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:39.954+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:40.026 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:40.022+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:40.247 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:40.243+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:40.256 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:40.249+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:40.302 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:40.298+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:40.409 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:40.406+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:40.915 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:40.911+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:41.003 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:40.998+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:41.213 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:41.206+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:41.289 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:41.285+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:41.303 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:41.300+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:41.434 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:41.430+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:41.934 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:41.931+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:42.027 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:42.022+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:42.254 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:42.250+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:42.288 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:42.284+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:42.297 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:42.293+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:42.414 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:42.411+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:42.973 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:42.969+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:43.064 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:43.061+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:43.215 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:43.211+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:43.321 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:43.317+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:43.321 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:43.317+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:43.427 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:43.423+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:43.973 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:43.968+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:44.049 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:44.046+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:44.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:44.250+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:44.350 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:44.346+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:44.360 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:44.357+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:44.406 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:44.403+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:45.015 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:45.011+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:45.058 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:45.053+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:45.275 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:45.270+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:45.309 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:45.305+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:45.394 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:45.389+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:45.395 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:45.391+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:45.989 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:45.985+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:46.090 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:46.086+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:46.238 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:46.234+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:46.265 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:46.261+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:46.381 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:46.377+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:46.435 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:46.431+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:46.964 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:46.960+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:47.088 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:47.084+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:47.244 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:47.239+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:47.270 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:47.266+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:47.363 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:47.360+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:47.439 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:47.435+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:48.011 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:48.007+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:48.058 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:48.054+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:48.247 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:48.243+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:48.280 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:48.276+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:48.387 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:48.384+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:48.445 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:48.441+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:49.027 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:49.021+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:49.030 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:49.025+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:49.213 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:49.209+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:49.292 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:49.287+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:49.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:49.348+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:49.461 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:49.456+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:50.011 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:50.007+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:50.083 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:50.079+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:50.184 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:50.181+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:50.260 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:50.255+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:50.320 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:50.316+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:50.482 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:50.479+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:51.028 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:51.024+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:51.046 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:51.042+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:51.211 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:51.207+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:51.274 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:51.269+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:51.290 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:51.286+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:51.534 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:51.531+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:52.010 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:52.006+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:52.045 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:52.041+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:52.249 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:52.244+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:52.257 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:52.253+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:52.275 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:52.271+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:52.516 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:52.512+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:53.005 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:53.000+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:53.076 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:53.071+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:53.262 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:53.258+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:53.275 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:53.272+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:53.292 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:53.286+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:53.539 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:53.535+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:54.018 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:54.014+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:54.069 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:54.065+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:54.239 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:54.234+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:54.311 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:54.307+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:54.340 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:54.335+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:54.496 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:54.492+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:55.024 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:55.021+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:55.026 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:55.022+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:55.209 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:55.204+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:55.300 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:55.296+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:55.356 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:55.351+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:55.493 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:55.489+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:56.011 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:56.007+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:56.062 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:56.059+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:56.180 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:56.177+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:56.260 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:56.256+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:56.371 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:56.369+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:56.500 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:56.498+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:56.987 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:56.984+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:57.065 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:57.061+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:57.219 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:57.216+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:57.261 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:57.257+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:57.387 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:57.385+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:57.462 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:57.460+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:58.027 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:58.023+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:58.036 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:58.033+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:58.214 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:58.212+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:58.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:58.249+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:58.383 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:58.380+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:25:58.420 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:58.418+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:59.004 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:25:59.001+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:25:59.088 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:25:59.084+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:25:59.241 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:25:59.238+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:25:59.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:25:59.303+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:25:59.410 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:25:59.408+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:25:59.412 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:25:59.410+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:26:00.046 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:26:00.042+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:26:00.078 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:26:00.074+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:26:00.229 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:26:00.226+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:26:00.323 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:26:00.318+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:26:00.383 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:26:00.381+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e803 v803) 2019-12-09T21:26:00.389 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:26:00.384+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:26:00.416 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:26:00.413+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:26:01.014 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:26:01.011+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:26:01.118 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:26:01.115+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:26:01.276 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:26:01.273+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:26:01.308 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:26:01.303+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:26:01.428 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:26:01.426+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:26:01.430 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:26:01.428+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:26:02.068 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:26:02.064+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:26:02.073 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:26:02.070+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:26:02.319 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:26:02.315+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:26:02.326 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:26:02.323+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:26:02.425 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:26:02.422+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:26:02.462 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:26:02.459+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:26:03.068 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:26:03.064+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:26:03.089 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:26:03.085+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:26:03.285 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:26:03.281+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:26:03.291 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:26:03.285+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:26:03.471 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:26:03.467+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:26:03.500 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:26:03.498+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:26:04.065 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:26:04.056+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:26:04.078 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:26:04.075+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:26:04.268 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:26:04.265+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:26:04.324 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:26:04.320+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:26:04.505 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:26:04.503+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:26:04.544 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:26:04.540+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:26:05.052 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:26:05.049+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:26:05.110 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:26:05.107+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:26:05.263 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:26:05.259+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:26:05.283 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:26:05.278+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:26:05.424 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:26:05.421+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e803 v803) 2019-12-09T21:26:05.482 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:26:05.480+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:26:05.536 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:26:05.533+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:26:06.064 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:26:06.060+0000 1694f700 -1 osd.4 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:26:06.089 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:26:06.085+0000 1694f700 -1 osd.5 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:26:06.284 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:26:06.278+0000 1694f700 -1 osd.3 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:26:06.289 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:26:06.285+0000 1694f700 -1 osd.7 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:26:06.462 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:26:06.459+0000 1694f700 -1 osd.2 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:26:06.555 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:26:06.552+0000 1694f700 -1 osd.1 803 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:26:07.130 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:26:07.123+0000 1694f700 -1 osd.5 804 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:26:07.174 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:26:07.087+0000 1694f700 -1 osd.4 804 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:26:07.376 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:26:07.354+0000 1694f700 -1 osd.3 804 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:26:07.418 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:26:07.415+0000 1694f700 -1 osd.2 804 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:26:07.511 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:26:07.509+0000 1694f700 -1 osd.1 804 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:26:07.549 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:26:07.416+0000 1694f700 -1 osd.7 804 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:26:08.098 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:26:08.095+0000 1694f700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:26:08.196 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:26:08.151+0000 1694f700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:26:08.377 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:26:08.375+0000 1694f700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:26:08.433 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:26:08.431+0000 1694f700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:26:08.470 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:26:08.466+0000 1694f700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:26:08.497 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:26:08.495+0000 1694f700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:26:09.113 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:26:09.109+0000 1694f700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:26:09.210 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:26:09.205+0000 1694f700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:26:09.371 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:26:09.369+0000 1694f700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:26:09.457 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:26:09.453+0000 1694f700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:26:09.482 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:26:09.479+0000 1694f700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:26:09.484 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:26:09.480+0000 1694f700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:26:10.078 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:26:10.074+0000 1694f700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.998453+0000 front 2019-12-09T21:24:46.013628+0000 (oldest deadline 2019-12-09T21:25:31.867245+0000) 2019-12-09T21:26:10.208 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:26:10.204+0000 1694f700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:45.205922+0000 front 2019-12-09T21:24:45.229401+0000 (oldest deadline 2019-12-09T21:25:28.066352+0000) 2019-12-09T21:26:10.373 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:26:10.372+0000 1694f700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.379242+0000 front 2019-12-09T21:24:44.380037+0000 (oldest deadline 2019-12-09T21:25:27.815957+0000) 2019-12-09T21:26:10.479 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:26:10.472+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e803 v803) 2019-12-09T21:26:10.483 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:26:10.479+0000 1694f700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:44.903164+0000 front 2019-12-09T21:24:44.984413+0000 (oldest deadline 2019-12-09T21:25:28.309410+0000) 2019-12-09T21:26:10.499 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:26:10.496+0000 1694f700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.921312+0000 front 2019-12-09T21:24:46.594717+0000 (oldest deadline 2019-12-09T21:25:26.732221+0000) 2019-12-09T21:26:10.512 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:26:10.506+0000 1694f700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:24:46.525157+0000 front 2019-12-09T21:24:46.275046+0000 (oldest deadline 2019-12-09T21:25:27.324179+0000) 2019-12-09T21:26:15.617 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:20:36.673 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:26:15.618 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:20:36.678 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:26:15.666 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:20:36.726 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:26:15.670 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:20:36.728 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:26:15.714 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:20:36.739 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:26:15.714 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:20:36.742 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:26:15.828 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:20:36.888 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:26:15.897 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:20:36.956 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:26:15.927 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:20:36.964 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:27:21.574 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:21:42.634 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:27:21.584 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:21:42.644 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:27:21.593 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:21:42.653 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:27:21.597 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:21:42.657 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:27:21.601 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:21:42.637 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:27:21.616 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:21:42.653 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:27:21.688 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:21:42.740 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:27:21.749 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:21:42.809 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:27:21.774 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:21:42.810 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:28:05.633 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:05.630+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:06.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:06.460+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:06.632 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:06.629+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:06.763 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:06.759+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:07.424 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:07.420+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:07.632 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:07.630+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:07.777 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:07.774+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:07.892 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:07.888+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:08.381 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:08.376+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:08.613 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:08.605+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:08.753 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:08.752+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:08.879 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:08.876+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:09.339 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:09.334+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:09.432 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:09.418+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:09.632 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:09.628+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:09.731 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:09.729+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:09.928 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:09.925+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:10.099 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:10.095+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:10.366 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:10.361+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:10.473 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:10.469+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:10.659 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:10.657+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:10.720 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:10.717+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:10.945 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:10.943+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:11.148 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:11.143+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:11.355 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:11.351+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:11.437 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:11.434+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:11.646 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:11.643+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:11.746 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:11.743+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:11.956 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:11.953+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:12.166 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:12.162+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:12.387 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:12.384+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:12.453 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:12.449+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:12.643 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:12.640+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:12.790 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:12.783+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:13.002 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:12.998+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:13.180 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:13.176+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:13.389 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:13.385+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:13.448 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:13.443+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:13.632 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:13.629+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:13.799 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:13.797+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:14.052 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:14.050+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:14.189 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:14.178+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:14.423 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:14.420+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:14.443 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:14.440+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:14.632 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:14.626+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:14.770 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:14.767+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:15.091 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:15.088+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:15.188 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:15.183+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:15.453 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:15.449+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:15.479 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:15.476+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:15.597 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:15.594+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:15.824 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:15.821+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:16.112 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:16.108+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:16.224 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:16.220+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:16.441 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:16.436+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:16.446 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:16.442+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:16.576 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:16.573+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:16.807 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:16.805+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:17.130 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:17.127+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:17.267 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:17.263+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:17.437 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:17.433+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:17.445 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:17.441+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:17.531 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:17.529+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:17.811 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:17.808+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:18.097 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:18.093+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:18.304 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:18.301+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:18.426 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:18.421+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:18.471 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:18.467+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:18.527 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:18.523+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:18.827 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:18.824+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:19.068 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:19.065+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:19.280 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:19.275+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:19.445 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:19.441+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:19.475 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:19.471+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:19.489 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:19.487+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:19.829 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:19.825+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:20.041 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:20.033+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:20.331 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:20.327+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:20.466 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:20.463+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:20.476 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:20.472+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:20.523 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:20.519+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:20.881 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:20.878+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:21.029 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:21.026+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:21.341 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:21.338+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:21.440 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:21.436+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:21.500 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:21.496+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:21.536 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:21.532+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:21.844 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:21.840+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:21.994 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:21.992+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:22.372 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:22.369+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:22.435 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:22.432+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:22.485 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:22.481+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:22.571 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:22.566+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:22.806 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:22.801+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:23.019 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:23.017+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:23.386 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:23.383+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:23.442 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:23.439+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:23.499 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:23.494+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:23.553 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:23.549+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:23.804 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:23.795+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:23.986 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:23.984+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:24.407 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:24.405+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:24.426 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:24.423+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:24.501 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:24.496+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:24.586 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:24.582+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:24.803 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:24.800+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:24.989 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:24.982+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:25.382 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:25.379+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:25.444 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:25.440+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:25.472 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:25.468+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:25.624 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:25.622+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:25.792 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:25.785+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:25.953 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:25.948+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:26.401 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:26.397+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:26.412 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:26.409+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:26.498 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:26.492+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:26.620 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:26.616+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:26.816 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:26.813+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:26.959 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:26.956+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:27.379 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:27.375+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:27.432 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:27.430+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:27.520 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:27.517+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:27.625 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:27.621+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:27.847 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:27.841+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:27.956 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:27.952+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:28.372 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:28.368+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:28.407 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:28.404+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:28.542 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:28.537+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:28.650 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:28.639+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:28.851 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:28.849+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:28.930 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:28.927+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:29.350 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:29.346+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:29.407 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:29.405+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:29.540 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:29.536+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:29.697 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:29.692+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:29.858 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:29.854+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:29.971 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:29.968+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:30.401 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:30.398+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:30.419 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:30.416+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:30.500 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:30.496+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:30.709 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:30.705+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:30.855 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:30.852+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:31.030 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:31.020+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:31.409 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:31.406+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:31.440 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:31.436+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:31.525 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:31.520+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:31.673 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:31.670+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:31.894 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:31.890+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:32.027 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:32.025+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:32.412 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:32.408+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:32.430 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:32.427+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:32.493 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:32.489+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:32.634 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:32.632+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:32.855 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:32.853+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:33.031 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:33.027+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:33.448 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:33.445+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:33.454 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:33.451+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:33.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:33.509+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:33.621 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:33.618+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:33.841 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:33.837+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:34.041 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:34.035+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:34.436 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:34.433+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:34.467 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:34.463+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:34.490 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:34.485+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:34.621 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:34.615+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:34.809 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:34.800+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:35.000 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:34.994+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:35.402 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:35.398+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:35.424 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:35.420+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:35.468 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:35.463+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:35.653 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:35.646+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:35.772 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:35.767+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:36.044 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:36.030+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:36.365 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:36.363+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:36.474 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:36.467+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:36.475 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:36.468+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:36.651 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:36.642+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:36.734 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:36.725+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:37.058 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:37.055+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:37.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:37.414+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:37.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:37.447+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:37.515 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:37.511+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:37.637 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:37.624+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:37.736 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:37.729+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:38.061 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:38.055+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:38.427 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:38.416+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:38.430 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:38.426+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:38.564 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:38.558+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:38.640 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:38.629+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:38.698 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:38.694+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:39.033 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:39.029+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:39.438 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:39.434+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:39.473 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:39.459+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:39.537 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:39.531+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:39.592 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:39.588+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:39.661 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:39.653+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:40.025 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:40.019+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:40.481 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:40.474+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:40.500 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:40.497+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:40.553 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:40.550+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:40.570 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:40.563+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:40.676 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:40.674+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:40.981 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:40.978+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:40.986 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:28:40.984+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e813 v813) 2019-12-09T21:28:41.459 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:41.456+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:41.488 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:41.484+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:41.593 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:41.589+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:41.603 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:41.595+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:41.642 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:41.633+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:42.008 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:42.003+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:42.493 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:42.471+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:42.530 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:42.526+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:42.557 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:42.553+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:42.640 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:42.638+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:42.641 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:42.638+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:43.038 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:43.035+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:43.443 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:43.440+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:43.500 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:43.495+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:43.553 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:43.549+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:43.631 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:43.628+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:43.656 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:43.652+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:44.084 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:44.082+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:44.490 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:44.487+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:44.518 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:44.513+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:44.531 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:44.524+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:44.641 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:28:44.639+0000 1694f700 -1 osd.2 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.399626+0000 front 2019-12-09T21:27:24.484437+0000 (oldest deadline 2019-12-09T21:28:06.087924+0000) 2019-12-09T21:28:44.645 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:44.641+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:45.056 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:45.053+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:45.463 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:45.459+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:45.544 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:45.541+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:45.563 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:45.560+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:45.658 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:45.656+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:46.006 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:28:46.003+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e813 v813) 2019-12-09T21:28:46.049 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:46.040+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:46.495 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:46.490+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:46.501 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:46.498+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:46.596 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:46.593+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:46.662 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:46.658+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:47.056 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:47.047+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:47.502 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:47.492+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:47.509 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:47.499+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:47.593 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:47.590+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:47.654 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:47.650+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:48.082 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:48.079+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:48.532 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:48.528+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:48.556 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:48.551+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:48.570 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:48.567+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:48.673 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:48.668+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:49.076 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:49.072+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:49.535 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:49.530+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:49.541 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:49.537+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:49.563 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:49.556+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:49.637 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:49.633+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:50.085 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:50.081+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:28:50.491 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:28:50.486+0000 1694f700 -1 osd.7 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.417054+0000 front 2019-12-09T21:27:21.485779+0000 (oldest deadline 2019-12-09T21:28:05.434276+0000) 2019-12-09T21:28:50.533 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:28:50.529+0000 1694f700 -1 osd.5 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:24.563290+0000 front 2019-12-09T21:27:24.592024+0000 (oldest deadline 2019-12-09T21:28:09.864066+0000) 2019-12-09T21:28:50.580 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:28:50.575+0000 1694f700 -1 osd.1 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:22.707491+0000 front 2019-12-09T21:27:23.004311+0000 (oldest deadline 2019-12-09T21:28:04.856020+0000) 2019-12-09T21:28:50.625 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:28:50.619+0000 1694f700 -1 osd.4 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:23.286294+0000 front 2019-12-09T21:27:23.340662+0000 (oldest deadline 2019-12-09T21:28:09.115260+0000) 2019-12-09T21:28:51.083 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:28:51.079+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e813 v813) 2019-12-09T21:28:51.099 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:28:51.094+0000 1694f700 -1 osd.3 813 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:27:21.490009+0000 front 2019-12-09T21:27:21.492222+0000 (oldest deadline 2019-12-09T21:28:07.360890+0000) 2019-12-09T21:30:01.691 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:24:22.750 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:30:01.713 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:24:22.772 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:30:01.760 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:24:22.819 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:30:01.776 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:24:22.836 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:30:01.825 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:24:22.862 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:30:01.839 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:24:22.876 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:30:01.905 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:24:22.961 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:30:01.969 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:24:23.023 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:30:02.123 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:24:23.154 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:30:42.187 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:42.182+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:42.324 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:42.321+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:42.802 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:42.798+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:43.236 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:43.233+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:43.349 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:43.346+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:43.852 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:43.847+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:44.232 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:44.227+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:44.308 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:44.305+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:44.848 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:44.843+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:45.242 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:45.238+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:45.257 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:45.254+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:45.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:45.262+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:45.413 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:45.409+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:45.827 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:45.824+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:46.272 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:46.269+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:46.273 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:46.270+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:46.275 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:46.272+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:46.468 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:46.464+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:46.852 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:46.849+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:47.265 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:47.260+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:47.295 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:47.293+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:47.306 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:47.303+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:47.436 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:47.433+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:47.863 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:47.860+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:48.281 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:48.278+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:48.307 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:48.303+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:48.308 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:48.305+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:48.448 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:48.444+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:48.839 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:48.835+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:49.245 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:49.242+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:49.275 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:49.273+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:49.282 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:49.279+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:49.465 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:49.458+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:49.871 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:49.868+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:50.238 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:50.233+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:50.306 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:50.302+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:50.334 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:50.330+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:50.508 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:50.503+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:50.849 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:50.845+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:51.289 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:51.285+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:51.291 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:51.287+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:51.361 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:51.358+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:51.540 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:51.536+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:51.818 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:51.814+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:52.258 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:52.255+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:52.281 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:52.277+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:52.379 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:52.375+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:52.584 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:52.581+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:52.825 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:52.821+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:53.267 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:53.263+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:53.274 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:53.271+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:53.362 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:53.349+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:53.548 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:53.544+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:53.867 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:53.863+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:54.231 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:54.228+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:54.309 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:54.305+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:54.403 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:54.398+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:54.568 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:54.564+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:54.832 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:54.828+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:55.261 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:55.258+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:55.296 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:55.292+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:55.392 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:55.388+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:55.531 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:55.528+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:55.825 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:55.821+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:56.258 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:56.254+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:56.326 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:56.321+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:56.439 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:56.435+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:56.540 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:56.536+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:56.850 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:56.847+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:57.301 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:57.297+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:57.316 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:57.312+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:57.424 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:57.420+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:57.495 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:57.491+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:57.889 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:57.886+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:58.272 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:58.266+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:58.347 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:58.343+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:58.382 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:58.378+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:58.464 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:58.461+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:58.866 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:58.861+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:30:59.311 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:30:59.308+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:30:59.324 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:30:59.321+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:30:59.424 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:30:59.420+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:30:59.516 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:30:59.512+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:30:59.833 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:30:59.829+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:00.291 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:00.286+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:00.338 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:00.335+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:00.429 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:00.425+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:00.539 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:00.534+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:00.793 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:00.791+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:01.265 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:01.260+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:01.368 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:01.364+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:01.472 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:01.469+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:01.603 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:01.594+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:01.821 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:01.817+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:02.241 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:02.238+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:02.332 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:02.328+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:02.501 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:02.497+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:02.567 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:02.564+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:02.820 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:02.816+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:03.247 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:03.244+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:03.319 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:03.315+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:03.484 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:03.481+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:03.603 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:03.598+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:03.828 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:03.825+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:04.215 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:04.211+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:04.279 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:04.276+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:04.441 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:04.437+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:04.621 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:04.618+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:04.837 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:04.833+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:05.180 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:05.176+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:05.301 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:05.296+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:05.421 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:05.417+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:05.640 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:05.637+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:05.832 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:05.829+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:06.212 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:06.207+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:06.286 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:06.282+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:06.390 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:06.386+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:06.639 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:06.635+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:06.815 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:06.810+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:07.205 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:07.202+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:07.267 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:07.263+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:07.376 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:07.372+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:07.666 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:07.661+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:07.867 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:07.863+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:08.166 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:08.163+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:08.283 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:08.280+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:08.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:08.421+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:08.702 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:08.698+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:08.918 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:08.914+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:09.132 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:09.127+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:09.154 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:09.151+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:09.285 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:09.271+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:09.413 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:09.410+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:09.706 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:09.702+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:09.969 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:09.965+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:10.170 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:10.165+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:10.172 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:10.168+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:10.245 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:10.241+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:10.418 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:10.414+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:10.666 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:10.662+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:10.955 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:10.950+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:11.154 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:11.149+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:11.212 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:11.208+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:11.247 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:11.243+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:11.431 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:11.427+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:11.672 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:11.668+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:11.986 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:11.982+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:12.172 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:12.167+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:12.219 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:12.216+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:12.229 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:12.225+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:12.405 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:12.400+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:12.678 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:12.675+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:13.033 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:13.029+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:13.126 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:13.122+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:13.212 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:13.208+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:13.243 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:13.240+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:13.399 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:13.395+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:13.666 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:13.662+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:14.034 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:14.030+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:14.090 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:14.080+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:14.195 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:14.191+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:14.252 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:14.248+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:14.359 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:14.355+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:14.642 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:14.639+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:15.009 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:15.003+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:15.102 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:15.098+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:15.234 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:15.231+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:15.264 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:15.260+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:15.368 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:15.364+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:15.693 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:15.688+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:16.009 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:16.007+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:16.150 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:16.146+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:16.251 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:16.248+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:16.275 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:16.272+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:16.401 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:16.394+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:16.668 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:16.665+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:16.806 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:31:16.803+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e823 v823) 2019-12-09T21:31:17.063 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:17.059+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:17.184 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:17.180+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:17.230 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:17.227+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:17.247 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:17.244+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:17.448 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:17.446+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:17.675 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:17.671+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:18.044 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:18.041+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:18.144 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:18.141+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:18.258 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:18.255+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:18.259 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:18.256+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:18.475 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:18.472+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:18.647 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:18.641+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:19.030 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:19.027+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:19.197 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:19.193+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:19.270 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:19.266+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:19.307 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:19.303+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:19.474 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:19.472+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:19.665 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:19.663+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:20.067 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:20.064+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:20.238 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:20.234+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:20.263 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:20.260+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:20.301 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:20.298+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:20.469 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:20.460+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:20.666 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:20.662+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:21.053 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:21.050+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:21.229 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:21.224+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:21.289 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:21.286+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:21.323 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:21.320+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:21.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:21.479+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:21.652 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:21.649+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:21.818 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:31:21.816+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e823 v823) 2019-12-09T21:31:22.028 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:22.024+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:22.209 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:22.203+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:22.278 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:22.276+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:22.374 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:22.370+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:22.479 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:22.476+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:22.614 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:22.611+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:23.041 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:23.038+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:23.236 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:23.232+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:23.303 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:23.297+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:23.414 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:23.412+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:23.470 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:23.468+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:23.627 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:23.624+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:24.091 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:24.087+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:24.225 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:24.221+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:24.317 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:24.311+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:24.394 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:24.390+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:24.454 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:24.451+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:24.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:24.666+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:25.059 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:25.054+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:25.193 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:25.190+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:25.355 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:25.352+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:25.414 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:25.410+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:25.433 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:25.430+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:25.708 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:25.703+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:26.099 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:26.096+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:26.234 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:31:26.230+0000 1694f700 -1 osd.7 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.430087+0000 front 2019-12-09T21:29:57.439200+0000 (oldest deadline 2019-12-09T21:30:41.752362+0000) 2019-12-09T21:31:26.336 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:31:26.333+0000 1694f700 -1 osd.2 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.781368+0000 front 2019-12-09T21:29:54.496362+0000 (oldest deadline 2019-12-09T21:30:44.397894+0000) 2019-12-09T21:31:26.447 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:31:26.443+0000 1694f700 -1 osd.3 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:58.090638+0000 front 2019-12-09T21:29:58.428293+0000 (oldest deadline 2019-12-09T21:30:42.125040+0000) 2019-12-09T21:31:26.469 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:31:26.466+0000 1694f700 -1 osd.1 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.341325+0000 front 2019-12-09T21:29:57.400497+0000 (oldest deadline 2019-12-09T21:31:09.105394+0000) 2019-12-09T21:31:26.696 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:31:26.692+0000 1694f700 -1 osd.4 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:59.256468+0000 front 2019-12-09T21:29:58.962649+0000 (oldest deadline 2019-12-09T21:30:44.854644+0000) 2019-12-09T21:31:26.893 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:31:26.890+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e823 v823) 2019-12-09T21:31:27.079 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:31:27.070+0000 1694f700 -1 osd.5 823 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:29:57.401287+0000 front 2019-12-09T21:29:57.305333+0000 (oldest deadline 2019-12-09T21:30:42.379720+0000) 2019-12-09T21:31:31.893 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:25:52.953 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:31:31.900 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:25:52.960 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:31:31.906 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:25:52.966 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:31:31.911 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:25:52.971 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:31:31.916 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:25:52.953 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:31:31.931 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:25:52.967 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:31:31.997 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:25:53.056 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:31:32.004 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:25:53.064 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:31:32.137 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:25:53.174 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:32:11.021 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:32:10.963+0000 31786700 -1 osd.7 827 build_incremental_map_msg missing incremental map 827 2019-12-09T21:32:11.308 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:32:11.082+0000 31f87700 -1 osd.7 827 build_incremental_map_msg missing incremental map 827 2019-12-09T21:32:11.313 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:32:11.097+0000 3578e700 -1 osd.7 827 build_incremental_map_msg missing incremental map 827 2019-12-09T21:32:11.353 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:32:11.205+0000 34f8d700 -1 osd.7 827 build_incremental_map_msg missing incremental map 827 2019-12-09T21:32:11.373 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:32:11.212+0000 31f87700 -1 osd.7 827 build_incremental_map_msg missing incremental map 827 2019-12-09T21:32:14.417 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:32:14.256+0000 3578e700 -1 osd.0 829 build_incremental_map_msg missing incremental map 829 2019-12-09T21:32:14.469 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:32:14.271+0000 3578e700 -1 osd.0 829 build_incremental_map_msg missing incremental map 829 2019-12-09T21:32:14.593 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:32:14.295+0000 3478c700 -1 osd.0 829 build_incremental_map_msg missing incremental map 829 2019-12-09T21:32:14.596 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:32:14.304+0000 3478c700 -1 osd.0 829 build_incremental_map_msg missing incremental map 829 2019-12-09T21:32:14.604 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:32:14.343+0000 37792700 -1 osd.0 829 build_incremental_map_msg missing incremental map 829 2019-12-09T21:32:16.204 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:32:16.166+0000 34f8d700 -1 osd.0 831 build_incremental_map_msg missing incremental map 829 2019-12-09T21:32:16.206 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:32:16.168+0000 34f8d700 -1 osd.0 831 build_incremental_map_msg missing incremental map 829 2019-12-09T21:32:19.512 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:32:19.500+0000 3478c700 -1 osd.7 833 build_incremental_map_msg missing incremental map 827 2019-12-09T21:33:18.231 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:18.226+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:18.971 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:18.967+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:19.251 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:19.247+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:19.558 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:19.555+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:19.618 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:19.614+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:19.975 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:19.972+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:20.136 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:20.132+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:20.251 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:20.247+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:20.591 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:20.587+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:20.622 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:20.616+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:20.958 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:20.956+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:21.145 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:21.140+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:21.273 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:21.269+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:21.592 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:21.589+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:21.610 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:21.603+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:21.987 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:21.983+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:22.175 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:22.170+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:22.305 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:22.300+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:22.560 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:22.556+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:22.561 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:22.558+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:22.601 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:22.597+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:22.969 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:22.965+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:23.197 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:23.193+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:23.309 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:23.305+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:23.521 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:23.517+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:23.607 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:23.604+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:23.654 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:23.651+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:23.933 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:23.930+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:24.153 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:24.150+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:24.328 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:24.324+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:24.485 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:24.482+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:24.584 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:24.579+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:24.645 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:24.641+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:24.932 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:24.928+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:25.195 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:25.192+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:25.302 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:25.298+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:25.448 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:25.444+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:25.595 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:25.592+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:25.639 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:25.635+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:25.929 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:25.923+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:26.154 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:26.151+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:26.278 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:26.274+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:26.450 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:26.446+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:26.584 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:26.581+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:26.595 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:26.591+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:26.946 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:26.943+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:27.108 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:27.105+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:27.263 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:27.260+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:27.409 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:27.405+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:27.617 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:27.614+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:27.635 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:27.633+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:27.977 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:27.974+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:28.148 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:28.146+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:28.227 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:28.223+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:28.464 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:28.460+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:28.573 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:28.570+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:28.668 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:28.666+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:28.966 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:28.963+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:29.131 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:29.122+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:29.184 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:29.179+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:29.519 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:29.514+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:29.536 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:29.532+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:29.688 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:29.685+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:29.921 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:29.918+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:30.161 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:30.159+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:30.234 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:30.230+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:30.547 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:30.545+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:30.559 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:30.555+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:30.645 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:30.641+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:30.897 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:30.895+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:31.117 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:31.112+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:31.215 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:31.211+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:31.526 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:31.523+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:31.541 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:31.537+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:31.607 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:31.604+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:31.905 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:31.903+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:32.161 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:32.159+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:32.180 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:32.176+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:32.567 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:32.564+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:32.579 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:32.576+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:32.648 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:32.644+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:32.928 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:32.926+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:33.146 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:33.142+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:33.209 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:33.206+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:33.527 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:33.524+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:33.630 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:33.627+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:33.684 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:33.681+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:33.909 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:33.907+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:34.178 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:34.174+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:34.181 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:34.179+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:34.546 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:34.543+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:34.600 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:34.597+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:34.688 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:34.685+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:34.924 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:34.921+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:35.182 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:35.179+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:35.212 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:35.206+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:35.509 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:35.505+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:35.568 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:35.564+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:35.737 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:35.731+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:35.902 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:35.900+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:36.219 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:36.215+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:36.220 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:36.217+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:36.537 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:36.533+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:36.541 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:36.538+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:36.691 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:36.688+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:36.882 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:36.878+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:37.184 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:37.180+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:37.207 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:37.199+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:37.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:37.566+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:37.581 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:37.578+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:37.706 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:37.704+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:37.884 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:37.879+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:38.198 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:38.194+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:38.225 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:38.221+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:38.559 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:38.555+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:38.575 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:38.559+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:38.710 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:38.707+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:38.915 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:38.912+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:39.171 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:39.169+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:39.277 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:39.271+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:39.547 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:39.544+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:39.616 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:39.612+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:39.738 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:39.736+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:39.896 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:39.893+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:40.207 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:40.203+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:40.302 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:40.298+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:40.576 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:40.572+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:40.615 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:40.612+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:40.755 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:40.751+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:40.868 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:40.866+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:41.171 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:41.169+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:41.317 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:41.313+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:41.553 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:41.548+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:41.616 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:41.613+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:41.801 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:41.796+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:41.862 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:41.860+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:42.165 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:42.158+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:42.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:42.304+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:42.599 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:42.594+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:42.652 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:42.648+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:42.804 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:42.802+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:42.872 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:42.867+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:43.135 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:43.131+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:43.293 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:43.289+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:43.570 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:43.567+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:43.697 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:43.693+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:43.765 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:43.763+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:43.856 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:43.854+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:44.103 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:44.100+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:44.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:44.303+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:44.617 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:44.614+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:44.668 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:44.664+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:44.765 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:44.763+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:44.825 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:44.823+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:45.080 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:45.077+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:45.297 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:45.293+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:45.584 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:45.581+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:45.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:45.717+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:45.788 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:45.785+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:45.837 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:45.833+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:46.038 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:46.034+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:46.347 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:46.343+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:46.622 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:46.617+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:46.722 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:46.718+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:46.788 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:46.786+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:46.882 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:46.879+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:47.010 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:47.003+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:47.389 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:47.384+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:47.577 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:47.574+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:47.709 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:47.706+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:47.820 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:47.817+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:47.884 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:47.882+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:47.981 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:47.971+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:48.429 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:48.423+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:48.620 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:48.613+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:48.696 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:48.689+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:48.870 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:48.866+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:48.898 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:48.893+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:49.025 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:49.020+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:49.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:49.448+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:49.621 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:49.617+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:49.710 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:49.707+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:49.865 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:49.863+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:49.872 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:49.870+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:50.030 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:50.028+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:50.505 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:50.501+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:50.598 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:50.595+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:50.692 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:50.688+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:50.871 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:50.869+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:50.896 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:50.894+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:51.047 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:51.043+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:51.550 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:51.546+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:51.580 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:51.578+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:51.740 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:51.736+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:51.871 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:51.869+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:51.932 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:51.930+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:52.035 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:52.032+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:52.580 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:52.576+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:52.583 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:52.580+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:52.699 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:33:52.697+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e833 v833) 2019-12-09T21:33:52.734 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:52.731+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:52.825 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:52.823+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:52.967 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:52.964+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:53.026 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:53.024+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:53.582 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:53.579+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:53.596 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:53.590+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:53.736 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:53.732+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:53.837 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:53.834+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:53.921 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:53.918+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:54.073 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:54.071+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:54.612 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:54.608+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:54.622 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:54.619+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:54.702 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:54.687+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:54.886 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:54.882+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:54.933 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:54.930+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:55.047 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:55.043+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:55.612 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:55.609+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:55.637 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:55.634+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:55.677 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:55.673+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:55.873 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:55.871+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:55.953 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:55.951+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:56.095 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:56.092+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:56.653 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:56.648+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:56.659 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:56.656+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:56.670 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:56.667+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:56.834 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:56.830+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:56.905 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:56.903+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:57.134 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:57.131+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:57.663 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:57.659+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:57.670 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:57.665+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:57.695 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:57.691+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:57.707 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:33:57.706+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e833 v833) 2019-12-09T21:33:57.825 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:57.823+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:57.959 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:57.956+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:58.172 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:58.170+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:58.645 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:58.641+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:58.657 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:58.653+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:58.699 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:58.696+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:58.825 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:58.823+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:58.953 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:58.950+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:33:59.152 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:33:59.150+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:33:59.661 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:33:59.658+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:33:59.696 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:33:59.693+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:33:59.699 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:33:59.696+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:33:59.864 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:33:59.861+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:33:59.908 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:33:59.906+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:34:00.202 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:34:00.199+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:34:00.682 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:34:00.678+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:34:00.725 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:34:00.721+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:34:00.726 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:34:00.723+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:34:00.887 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:34:00.884+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:34:00.924 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:34:00.921+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:34:01.222 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:34:01.218+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:34:01.666 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:34:01.660+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:34:01.714 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:34:01.711+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:34:01.716 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:34:01.712+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:34:01.864 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:34:01.860+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:34:01.969 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:34:01.966+0000 1694f700 -1 osd.2 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:37.005178+0000 front 2019-12-09T21:32:36.442370+0000 (oldest deadline 2019-12-09T21:33:18.566981+0000) 2019-12-09T21:34:02.266 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:34:02.264+0000 1694f700 -1 osd.1 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.688197+0000 front 2019-12-09T21:32:34.740690+0000 (oldest deadline 2019-12-09T21:33:19.207515+0000) 2019-12-09T21:34:02.646 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:34:02.642+0000 1694f700 -1 osd.7 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:32.278764+0000 front 2019-12-09T21:32:32.323718+0000 (oldest deadline 2019-12-09T21:33:17.853253+0000) 2019-12-09T21:34:02.677 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:34:02.673+0000 1694f700 -1 osd.4 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:33.154568+0000 front 2019-12-09T21:32:33.144749+0000 (oldest deadline 2019-12-09T21:33:19.011538+0000) 2019-12-09T21:34:02.700 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:34:02.696+0000 1694f700 -1 osd.5 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:36.357708+0000 front 2019-12-09T21:32:36.368184+0000 (oldest deadline 2019-12-09T21:33:21.632429+0000) 2019-12-09T21:34:02.794 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:34:02.791+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e833 v833) 2019-12-09T21:34:02.883 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:34:02.880+0000 1694f700 -1 osd.3 833 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:32:34.173610+0000 front 2019-12-09T21:32:34.162582+0000 (oldest deadline 2019-12-09T21:33:18.844498+0000) 2019-12-09T21:34:38.023 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:28:59.082 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:34:38.036 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:28:59.096 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:34:38.075 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:28:59.134 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:34:38.076 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:28:59.136 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:34:38.100 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:28:59.136 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:34:38.102 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:28:59.139 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:34:38.225 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:28:59.284 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:34:38.260 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:28:59.320 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:34:38.317 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:28:59.354 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:34:49.222 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:34:49.220+0000 114ae700 -1 osd.0 840 build_incremental_map_msg missing incremental map 840 2019-12-09T21:34:50.683 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:34:50.631+0000 37f93700 -1 osd.0 841 build_incremental_map_msg missing incremental map 840 2019-12-09T21:34:52.184 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:34:52.176+0000 38f95700 -1 osd.0 842 build_incremental_map_msg missing incremental map 840 2019-12-09T21:35:21.954 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:29:43.014 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:35:21.964 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:29:43.023 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:35:21.966 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:29:43.026 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:35:21.969 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:29:43.029 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:35:21.984 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:29:43.020 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:35:22.000 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:29:43.037 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:35:22.040 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:29:43.100 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:35:22.050 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:29:43.110 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:35:22.157 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:29:43.194 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:35:50.716 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:35:50.712+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:35:50.910 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:35:50.909+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:35:51.690 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:35:51.685+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:35:51.893 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:35:51.890+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:35:52.362 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:35:52.358+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:35:52.737 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:35:52.733+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:35:52.775 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:35:52.772+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:35:52.923 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:35:52.919+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:35:53.347 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:35:53.344+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:35:53.741 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:35:53.738+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:35:53.751 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:35:53.748+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:35:53.927 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:35:53.923+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:35:54.172 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:35:54.169+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:35:54.393 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:35:54.389+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:35:54.404 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:35:54.401+0000 1694f700 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.562821+0000 front 2019-12-09T21:35:09.795752+0000 (oldest deadline 2019-12-09T21:35:54.243952+0000) 2019-12-09T21:35:54.706 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:35:54.703+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:35:54.714 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:35:54.711+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:35:54.937 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:35:54.935+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:35:55.201 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:35:55.196+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:35:55.388 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:35:55.383+0000 1694f700 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.562821+0000 front 2019-12-09T21:35:09.795752+0000 (oldest deadline 2019-12-09T21:35:54.243952+0000) 2019-12-09T21:35:55.411 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:35:55.407+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:35:55.714 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:35:55.710+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:35:55.760 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:35:55.756+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:35:55.916 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:35:55.914+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:35:56.186 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:35:56.182+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:35:56.376 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:35:56.372+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:35:56.390 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:35:56.388+0000 1694f700 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.562821+0000 front 2019-12-09T21:35:09.795752+0000 (oldest deadline 2019-12-09T21:35:54.243952+0000) 2019-12-09T21:35:56.687 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:35:56.683+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:35:56.765 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:35:56.761+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:35:56.904 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:35:56.903+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:35:57.145 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:35:57.142+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:35:57.380 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:35:57.376+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:35:57.433 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:35:57.430+0000 1694f700 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.562821+0000 front 2019-12-09T21:35:09.795752+0000 (oldest deadline 2019-12-09T21:35:54.243952+0000) 2019-12-09T21:35:57.700 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:35:57.696+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:35:57.769 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:35:57.766+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:35:57.901 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:35:57.899+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:35:58.154 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:35:58.150+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:35:58.428 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:35:58.425+0000 1694f700 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.562821+0000 front 2019-12-09T21:35:09.795752+0000 (oldest deadline 2019-12-09T21:35:54.243952+0000) 2019-12-09T21:35:58.428 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:35:58.425+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:35:58.723 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:35:58.719+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:35:58.750 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:35:58.746+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:35:58.900 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:35:58.897+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:35:59.198 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:35:59.195+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:35:59.389 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:35:59.385+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:35:59.430 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:35:59.426+0000 1694f700 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.562821+0000 front 2019-12-09T21:35:09.795752+0000 (oldest deadline 2019-12-09T21:35:54.243952+0000) 2019-12-09T21:35:59.700 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:35:59.696+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:35:59.771 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:35:59.767+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:35:59.859 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:35:59.855+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:00.214 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:00.211+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:00.383 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:00.379+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:00.465 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:36:00.462+0000 1694f700 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.562821+0000 front 2019-12-09T21:35:09.795752+0000 (oldest deadline 2019-12-09T21:35:54.243952+0000) 2019-12-09T21:36:00.753 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:00.749+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:00.759 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:00.756+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:00.902 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:00.899+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:01.220 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:01.218+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:01.345 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:01.341+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:01.506 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:36:01.503+0000 1694f700 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.562821+0000 front 2019-12-09T21:35:09.795752+0000 (oldest deadline 2019-12-09T21:35:54.243952+0000) 2019-12-09T21:36:01.731 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:01.728+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:01.797 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:01.793+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:01.866 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:01.863+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:02.247 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:02.244+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:02.317 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:02.312+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:02.515 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:36:02.512+0000 1694f700 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.562821+0000 front 2019-12-09T21:35:09.795752+0000 (oldest deadline 2019-12-09T21:35:54.243952+0000) 2019-12-09T21:36:02.701 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:02.697+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:02.762 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:02.758+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:02.879 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:02.876+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:03.269 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:03.266+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:03.366 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:03.360+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:03.488 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:36:03.485+0000 1694f700 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.562821+0000 front 2019-12-09T21:35:09.795752+0000 (oldest deadline 2019-12-09T21:35:54.243952+0000) 2019-12-09T21:36:03.750 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:03.746+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:03.792 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:03.789+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:03.835 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:03.832+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:04.313 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:04.311+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:04.324 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:04.320+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:04.535 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:36:04.531+0000 1694f700 -1 osd.3 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.562821+0000 front 2019-12-09T21:35:09.795752+0000 (oldest deadline 2019-12-09T21:35:54.243952+0000) 2019-12-09T21:36:04.708 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:04.704+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:04.747 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:04.744+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:04.868 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:04.865+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:05.362 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:05.360+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:05.378 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:05.374+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:05.726 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:05.722+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:05.726 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:05.722+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:05.858 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:05.857+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:06.380 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:06.378+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:06.408 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:06.406+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:06.739 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:06.736+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:06.763 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:06.759+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:06.854 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:06.852+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:07.364 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:07.361+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:07.370 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:07.366+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:07.751 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:07.749+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:07.765 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:07.758+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:07.885 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:07.883+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:08.331 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:08.328+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:08.349 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:08.346+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:08.737 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:08.733+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:08.788 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:08.784+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:08.869 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:08.865+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:09.344 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:09.342+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:09.384 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:09.378+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:09.732 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:09.728+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:09.792 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:09.788+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:09.918 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:09.916+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:10.381 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:10.376+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:10.394 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:10.390+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:10.766 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:10.763+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:10.767 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:10.763+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:10.949 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:10.947+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:11.383 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:11.379+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:11.392 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:11.389+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:11.770 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:11.766+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:11.795 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:11.792+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:11.971 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:11.968+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:12.439 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:12.433+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:12.445 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:12.438+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:12.753 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:12.750+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:12.853 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:12.840+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:12.972 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:12.970+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:13.434 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:13.431+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:13.441 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:13.438+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:13.710 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:13.707+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:13.876 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:13.872+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:13.966 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:13.965+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:14.417 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:14.415+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:14.417 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:14.414+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:14.710 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:14.706+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:14.883 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:14.876+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:14.999 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:14.996+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:15.392 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:15.388+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:15.454 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:15.451+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:15.688 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:15.684+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:15.910 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:15.907+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:15.999 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:15.994+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:16.362 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:16.355+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:16.473 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:16.468+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:16.671 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:16.667+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:16.928 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:16.924+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:16.964 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:16.959+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:17.365 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:17.361+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:17.453 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:17.449+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:17.701 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:17.697+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:17.910 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:17.907+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:17.961 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:17.957+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:18.356 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:18.352+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:18.411 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:18.408+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:18.692 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:18.687+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:18.929 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:18.926+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:18.950 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:18.946+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:19.407 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:19.403+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:19.452 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:19.448+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:19.713 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:19.710+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:19.929 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:19.925+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:19.972 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:19.967+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:20.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:20.421+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:20.449 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:20.446+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:20.711 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:20.707+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:20.884 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:20.881+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:20.944 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:20.940+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:21.461 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:21.452+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:21.468 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:21.462+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:21.701 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:21.698+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:21.861 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:21.857+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:21.929 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:21.926+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:22.443 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:22.440+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:22.444 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:22.442+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:22.723 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:22.721+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:22.837 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:22.834+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:22.897 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:22.894+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:23.280 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:36:23.277+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e845 v845) 2019-12-09T21:36:23.417 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:23.413+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:23.486 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:23.482+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:23.685 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:23.682+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:23.851 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:23.847+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:23.858 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:23.854+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:24.444 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:24.437+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:24.446 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:24.443+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:24.678 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:24.674+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:24.831 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:24.828+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:24.874 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:24.872+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:25.415 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:25.410+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:25.426 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:25.422+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:25.639 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:25.637+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:25.825 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:25.822+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:25.850 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:25.847+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:26.432 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:26.428+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:26.442 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:26.438+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:26.634 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:26.630+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:26.836 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:26.831+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:26.865 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:26.861+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:27.407 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:27.403+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:27.415 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:27.411+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:27.627 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:27.624+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:27.883 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:27.880+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:27.890 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:27.886+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:28.290 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:36:28.288+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e845 v845) 2019-12-09T21:36:28.359 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:28.356+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:28.468 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:28.464+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:28.624 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:28.620+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:28.853 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:28.849+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:28.860 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:28.857+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:29.398 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:29.394+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:29.461 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:29.458+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:29.595 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:29.591+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:29.814 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:29.811+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:29.836 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:29.833+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:30.417 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:30.413+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:30.440 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:30.436+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:30.574 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:30.569+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:30.827 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:30.824+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:30.879 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:30.875+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:31.395 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:31.383+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:31.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:31.452+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:31.582 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:31.579+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:31.831 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:31.828+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:31.843 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:31.839+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:32.363 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:32.358+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:32.429 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:32.424+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:32.548 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:32.543+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:36:32.849 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:36:32.845+0000 1694f700 -1 osd.5 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.128782+0000 front 2019-12-09T21:35:08.998992+0000 (oldest deadline 2019-12-09T21:35:50.641497+0000) 2019-12-09T21:36:32.851 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:36:32.848+0000 1694f700 -1 osd.2 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.287993+0000 front 2019-12-09T21:35:05.917341+0000 (oldest deadline 2019-12-09T21:35:50.530122+0000) 2019-12-09T21:36:33.381 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:36:33.377+0000 1694f700 -1 osd.1 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:09.172408+0000 front 2019-12-09T21:35:09.729948+0000 (oldest deadline 2019-12-09T21:35:53.818102+0000) 2019-12-09T21:36:33.386 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:36:33.383+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e845 v845) 2019-12-09T21:36:33.397 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:36:33.393+0000 1694f700 -1 osd.7 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:07.814480+0000 front 2019-12-09T21:35:07.771256+0000 (oldest deadline 2019-12-09T21:35:51.456386+0000) 2019-12-09T21:36:33.508 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:36:33.499+0000 1694f700 -1 osd.4 845 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:35:06.491932+0000 front 2019-12-09T21:35:06.481406+0000 (oldest deadline 2019-12-09T21:35:52.292632+0000) 2019-12-09T21:38:23.664 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:23.651+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:24.369 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:24.364+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:24.623 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:24.619+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:24.637 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:24.631+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:25.394 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:25.387+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:25.624 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:25.618+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:25.673 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:25.670+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:26.415 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:26.405+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:26.429 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:26.424+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:26.649 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:26.646+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:26.667 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:26.664+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:26.990 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:26.987+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:27.412 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:27.408+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:27.439 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:27.435+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:27.652 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:27.646+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:27.656 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:27.653+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:27.732 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:27.729+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:27.992 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:27.989+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:28.389 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:28.385+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:28.416 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:28.412+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:28.642 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:28.638+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:28.680 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:28.674+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:28.763 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:28.759+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:28.992 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:28.987+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:29.437 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:29.433+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:29.470 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:29.466+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:29.641 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:29.638+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:29.648 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:29.645+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:29.761 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:29.757+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:29.956 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:29.952+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:30.426 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:30.422+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:30.454 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:30.449+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:30.622 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:30.618+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:30.631 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:30.628+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:30.765 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:30.761+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:30.953 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:30.943+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:31.414 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:31.410+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:31.436 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:31.432+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:31.615 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:31.611+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:31.617 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:31.613+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:31.790 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:31.786+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:31.990 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:31.986+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:32.409 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:32.405+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:32.463 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:32.459+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:32.590 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:32.586+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:32.652 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:32.649+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:32.799 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:32.795+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:32.960 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:32.957+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:33.433 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:33.429+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:33.517 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:33.513+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:33.651 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:33.635+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:33.670 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:33.667+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:33.789 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:33.785+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:33.928 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:33.925+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:34.468 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:34.464+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:34.507 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:34.503+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:34.636 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:34.632+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:34.663 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:34.654+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:34.785 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:34.781+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:34.906 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:34.902+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:35.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:35.420+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:35.520 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:35.516+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:35.681 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:35.677+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:35.703 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:35.700+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:35.789 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:35.786+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:35.858 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:35.855+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:36.454 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:36.449+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:36.487 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:36.483+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:36.732 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:36.729+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:36.733 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:36.728+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:36.752 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:36.748+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:36.905 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:36.902+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:37.439 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:37.433+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:37.471 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:37.468+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:37.713 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:37.709+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:37.741 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:37.737+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:37.785 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:37.782+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:37.897 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:37.894+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:38.415 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:38.412+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:38.520 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:38.516+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:38.718 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:38.715+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:38.719 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:38.716+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:38.836 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:38.833+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:38.908 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:38.905+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:39.455 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:39.451+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:39.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:39.516+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:39.758 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:39.755+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:39.765 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:39.762+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:39.840 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:39.836+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:39.897 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:39.893+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:40.479 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:40.475+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:40.573 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:40.569+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:40.740 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:40.736+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:40.759 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:40.755+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:40.862 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:40.860+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:40.924 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:40.919+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:41.459 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:41.455+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:41.588 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:41.581+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:41.702 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:41.698+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:41.745 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:41.738+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:41.902 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:41.898+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:41.964 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:41.961+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:42.485 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:42.480+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:42.584 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:42.581+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:42.659 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:42.656+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:42.771 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:42.768+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:42.909 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:42.906+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:42.968 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:42.964+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:43.452 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:43.448+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:43.550 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:43.546+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:43.683 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:43.679+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:43.822 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:43.819+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:43.898 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:43.895+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:43.959 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:43.955+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:44.474 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:44.470+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:44.565 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:44.561+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:44.707 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:44.704+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:44.841 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:44.836+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:44.917 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:44.912+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:44.942 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:44.938+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:45.455 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:45.447+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:45.577 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:45.567+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:45.704 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:45.700+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:45.879 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:45.874+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:45.904 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:45.901+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:45.908 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:45.905+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:46.415 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:46.412+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:46.581 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:46.575+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:46.748 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:46.742+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:46.860 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:46.856+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:46.876 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:46.874+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:46.916 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:46.913+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:47.463 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:47.460+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:47.574 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:47.571+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:47.755 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:47.751+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:47.906 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:47.902+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:47.917 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:47.914+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:47.928 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:47.924+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:48.455 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:48.452+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:48.574 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:48.570+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:48.713 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:48.709+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:48.887 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:48.875+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:48.915 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:48.913+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:48.922 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:48.919+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:49.468 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:49.465+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:49.560 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:49.557+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:49.711 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:49.708+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:49.858 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:49.855+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:49.869 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:49.867+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:49.912 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:49.908+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:50.503 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:50.501+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:50.598 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:50.595+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:50.751 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:50.747+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:50.839 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:50.831+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:50.892 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:50.890+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:50.943 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:50.940+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:51.523 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:51.519+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:51.636 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:51.632+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:51.745 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:51.741+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:51.799 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:51.796+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:51.882 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:51.876+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:51.903 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:51.900+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:52.548 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:52.542+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:52.688 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:52.683+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:52.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:52.716+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:52.795 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:52.791+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:52.870 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:52.868+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:52.947 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:52.945+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:53.525 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:53.522+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:53.701 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:53.697+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:53.701 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:53.697+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:53.798 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:53.793+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:53.864 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:53.862+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:53.925 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:53.923+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:54.519 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:54.514+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:54.712 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:54.707+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:54.730 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:54.726+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:54.846 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:54.835+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:54.866 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:54.865+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:54.890 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:54.887+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:55.490 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:55.488+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:55.697 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:55.693+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:55.698 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:55.696+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:55.806 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:55.803+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:55.871 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:55.869+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:55.899 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:55.893+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:56.532 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:56.524+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:56.694 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:56.689+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:56.722 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:56.718+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:56.801 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:56.798+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:56.845 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:56.840+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:56.885 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:56.882+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:57.569 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:57.566+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:57.732 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:57.728+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:57.754 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:57.747+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:57.789 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:57.785+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:57.831 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:57.829+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:57.896 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:57.886+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:58.598 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:58.591+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:58.723 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:58.719+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:58.790 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:58.786+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:58.791 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:58.788+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:58.823 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:58.821+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:58.913 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:38:58.910+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e855 v855) 2019-12-09T21:38:58.915 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:58.913+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:38:59.548 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:38:59.546+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:38:59.771 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:38:59.767+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:38:59.775 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:38:59.774+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:38:59.810 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:38:59.806+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:38:59.820 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:38:59.814+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:38:59.949 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:38:59.945+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:39:00.529 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:39:00.527+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:39:00.761 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:39:00.758+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:39:00.761 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:39:00.757+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:39:00.792 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:39:00.788+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:39:00.841 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:39:00.834+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:39:00.916 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:39:00.914+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:39:01.544 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:39:01.540+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:39:01.751 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:39:01.747+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:39:01.793 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:39:01.791+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:39:01.814 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:39:01.809+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:39:01.823 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:39:01.819+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:39:01.871 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:39:01.869+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:39:02.545 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:39:02.542+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:39:02.780 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:39:02.777+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:39:02.804 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:39:02.800+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:39:02.809 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:39:02.807+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:39:02.869 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:39:02.864+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:39:02.925 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:39:02.921+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:39:03.586 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:39:03.582+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:39:03.769 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:39:03.765+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:39:03.804 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:39:03.801+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:39:03.857 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:39:03.855+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:39:03.885 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:39:03.881+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:39:03.886 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:39:03.883+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:39:03.933 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:39:03.931+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e855 v855) 2019-12-09T21:39:04.634 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:39:04.631+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:39:04.779 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:39:04.775+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:39:04.832 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:39:04.828+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:39:04.840 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:39:04.837+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:39:04.896 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:39:04.893+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:39:04.924 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:39:04.920+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:39:05.603 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:39:05.600+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:39:05.809 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:39:05.805+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:39:05.873 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:39:05.870+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:39:05.879 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:39:05.876+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:39:05.892 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:39:05.888+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:39:05.903 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:39:05.901+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:39:06.612 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:39:06.604+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:39:06.838 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:39:06.835+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:39:06.842 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:39:06.839+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:39:06.879 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:39:06.877+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:39:06.884 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:39:06.880+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:39:06.922 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:39:06.919+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:39:07.615 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:39:07.612+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:39:07.849 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:39:07.846+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:39:07.870 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:39:07.857+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:39:07.878 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:39:07.876+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:39:07.900 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:39:07.897+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:39:07.930 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:39:07.928+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:39:08.620 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:39:08.618+0000 1694f700 -1 osd.1 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:40.151987+0000 front 2019-12-09T21:37:40.185752+0000 (oldest deadline 2019-12-09T21:38:26.001636+0000) 2019-12-09T21:39:08.830 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:39:08.828+0000 1694f700 -1 osd.2 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.845790+0000 front 2019-12-09T21:37:41.884102+0000 (oldest deadline 2019-12-09T21:38:27.579798+0000) 2019-12-09T21:39:08.863 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:39:08.858+0000 1694f700 -1 osd.4 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.022616+0000 front 2019-12-09T21:37:42.496735+0000 (oldest deadline 2019-12-09T21:38:24.257645+0000) 2019-12-09T21:39:08.885 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:39:08.881+0000 1694f700 -1 osd.7 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:41.212599+0000 front 2019-12-09T21:37:41.043390+0000 (oldest deadline 2019-12-09T21:38:23.816660+0000) 2019-12-09T21:39:08.891 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:39:08.888+0000 1694f700 -1 osd.5 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:38.538592+0000 front 2019-12-09T21:37:38.650553+0000 (oldest deadline 2019-12-09T21:38:23.646205+0000) 2019-12-09T21:39:08.962 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:39:08.960+0000 1694f700 -1 osd.3 855 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:37:42.748699+0000 front 2019-12-09T21:37:42.853797+0000 (oldest deadline 2019-12-09T21:38:26.166513+0000) 2019-12-09T21:39:08.983 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:39:08.981+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e855 v855) 2019-12-09T21:39:34.196 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:33:55.256 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:39:34.199 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:33:55.259 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:39:34.208 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:33:55.268 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:39:34.212 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:33:55.272 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:39:34.225 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:33:55.262 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:39:34.240 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:33:55.276 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:39:34.469 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:33:55.529 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:39:34.486 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:33:55.546 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:39:34.581 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:33:55.618 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:40:56.394 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:40:56.389+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:40:57.225 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:40:57.219+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:40:57.389 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:40:57.383+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:40:57.653 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:40:57.648+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:40:58.197 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:40:58.192+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:40:58.201 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:40:58.197+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:40:58.408 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:40:58.398+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:40:58.464 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:40:58.461+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:40:58.674 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:40:58.671+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:40:59.168 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:40:59.165+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:40:59.192 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:40:59.186+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:40:59.455 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:40:59.449+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:40:59.469 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:40:59.461+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:40:59.656 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:40:59.651+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:00.139 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:00.135+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:00.199 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:00.196+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:00.421 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:00.410+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:00.521 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:00.515+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:00.687 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:00.683+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:00.997 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:00.994+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:01.188 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:01.186+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:01.201 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:01.199+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:01.401 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:01.393+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:01.532 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:01.527+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:01.701 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:01.698+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:01.966 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:01.961+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:02.192 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:02.189+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:02.229 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:02.223+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:02.372 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:02.368+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:02.590 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:02.585+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:02.752 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:02.749+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:02.953 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:02.947+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:03.184 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:03.181+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:03.231 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:03.223+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:03.357 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:03.352+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:03.640 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:03.635+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:03.763 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:03.760+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:03.926 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:03.921+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:04.183 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:04.180+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:04.237 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:04.231+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:04.371 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:04.367+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:04.689 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:04.684+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:04.814 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:04.809+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:04.905 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:04.891+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:05.207 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:05.202+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:05.225 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:05.223+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:05.333 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:05.327+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:05.687 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:05.683+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:05.803 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:05.787+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:05.878 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:05.874+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:06.220 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:06.218+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:06.267 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:06.265+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:06.329 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:06.318+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:06.709 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:06.702+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:06.815 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:06.812+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:06.881 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:06.877+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:07.178 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:07.176+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:07.293 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:07.290+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:07.374 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:07.368+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:07.673 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:07.667+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:07.835 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:07.833+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:07.927 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:07.923+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:08.203 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:08.200+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:08.258 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:08.255+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:08.349 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:08.345+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:08.703 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:08.696+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:08.892 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:08.884+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:08.934 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:08.931+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:09.219 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:09.216+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:09.228 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:09.225+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:09.358 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:09.352+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:09.682 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:09.677+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:09.878 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:09.875+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:09.980 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:09.976+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:10.196 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:10.193+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:10.240 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:10.237+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:10.370 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:10.361+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:10.685 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:10.679+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:10.910 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:10.907+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:10.978 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:10.975+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:11.219 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:11.216+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:11.236 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:11.233+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:11.402 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:11.394+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:11.672 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:11.669+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:11.954 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:11.951+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:11.976 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:11.973+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:12.200 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:12.194+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:12.212 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:12.205+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:12.430 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:12.426+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:12.722 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:12.716+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:12.924 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:12.922+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:12.965 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:12.961+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:13.177 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:13.171+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:13.240 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:13.237+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:13.479 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:13.476+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:13.685 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:13.681+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:13.940 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:13.937+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:13.978 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:13.975+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:14.212 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:14.205+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:14.280 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:14.277+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:14.521 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:14.511+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:14.648 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:14.645+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:14.918 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:14.915+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:14.950 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:14.946+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:15.234 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:15.232+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:15.318 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:15.314+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:15.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:15.501+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:15.606 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:15.603+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:15.899 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:15.897+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:15.995 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:15.988+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:16.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:16.267+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:16.292 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:16.289+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:16.461 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:16.457+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:16.606 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:16.602+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:16.875 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:16.872+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:16.974 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:16.971+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:17.251 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:17.247+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:17.309 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:17.301+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:17.462 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:17.456+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:17.601 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:17.596+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:17.834 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:17.830+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:18.000 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:17.995+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:18.237 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:18.235+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:18.330 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:18.327+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:18.513 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:18.507+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:18.654 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:18.650+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:18.820 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:18.817+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:18.965 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:18.962+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:19.241 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:19.235+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:19.345 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:19.339+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:19.547 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:19.542+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:19.687 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:19.684+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:19.793 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:19.789+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:19.982 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:19.978+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:20.212 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:20.205+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:20.375 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:20.371+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:20.513 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:20.510+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:20.675 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:20.672+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:20.830 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:20.826+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:20.984 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:20.977+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:21.238 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:21.234+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:21.353 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:21.351+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:21.492 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:21.486+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:21.663 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:21.660+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:21.808 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:21.803+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:21.976 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:21.967+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:22.295 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:22.286+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:22.321 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:22.318+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:22.497 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:22.492+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:22.673 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:22.670+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:22.820 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:22.812+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:22.945 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:22.932+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:23.313 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:23.308+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:23.375 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:23.367+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:23.553 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:23.544+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:23.674 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:23.670+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:23.826 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:23.821+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:23.956 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:23.946+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:24.289 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:24.286+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:24.418 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:24.408+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:24.580 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:24.576+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:24.657 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:24.653+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:24.833 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:24.829+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:24.967 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:24.964+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:25.281 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:25.274+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:25.416 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:25.413+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:25.554 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:25.550+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:25.681 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:25.677+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:25.800 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:25.796+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:26.005 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:26.000+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:26.308 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:26.304+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:26.477 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:26.467+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:26.575 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:26.570+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:26.717 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:26.714+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:26.770 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:26.767+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:27.045 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:27.041+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:27.304 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:27.301+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:27.498 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:27.495+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:27.546 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:27.537+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:27.695 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:27.692+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:27.801 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:27.799+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:28.030 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:28.026+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:28.268 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:28.263+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:28.497 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:28.494+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:28.528 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:28.524+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:28.670 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:28.666+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:28.853 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:28.834+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:29.011 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:29.007+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:29.247 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:29.243+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:29.384 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:41:29.382+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e865 v865) 2019-12-09T21:41:29.506 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:29.502+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:29.513 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:29.506+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:29.659 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:29.655+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:29.831 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:29.829+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:30.030 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:30.025+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:30.238 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:30.234+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:30.519 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:30.514+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:30.520 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:30.516+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:30.684 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:30.680+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:30.813 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:30.807+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:31.024 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:31.020+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:31.293 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:31.285+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:31.523 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:31.519+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:31.567 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:31.564+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:31.685 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:31.681+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:31.777 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:31.773+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:32.000 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:31.996+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:32.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:32.268+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:32.563 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:32.559+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:32.627 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:32.603+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:32.667 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:32.659+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:32.757 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:32.752+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:32.969 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:32.962+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:33.239 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:33.231+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:33.543 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:33.539+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:33.592 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:33.588+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:33.683 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:33.676+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:33.797 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:33.791+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:33.975 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:33.968+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:34.236 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:34.228+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:34.399 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:41:34.395+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e865 v865) 2019-12-09T21:41:34.555 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:34.550+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:34.556 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:34.554+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:34.704 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:34.699+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:34.764 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:34.761+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:34.962 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:34.958+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:35.255 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:35.250+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:35.528 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:35.524+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:35.530 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:35.527+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:35.702 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:35.696+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:35.754 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:35.750+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:35.969 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:35.963+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:36.305 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:36.300+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:36.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:36.510+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:36.564 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:36.559+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:36.676 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:36.672+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:36.723 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:36.718+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:36.975 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:36.968+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:37.293 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:37.287+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:37.558 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:37.554+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:37.576 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:37.572+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:37.631 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:37.627+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:37.774 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:37.769+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:37.928 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:37.922+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:38.264 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:38.259+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:38.561 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:38.554+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:38.596 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:38.592+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:38.645 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:38.639+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:41:38.805 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:41:38.800+0000 1694f700 -1 osd.3 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.051846+0000 front 2019-12-09T21:40:11.032333+0000 (oldest deadline 2019-12-09T21:40:56.885108+0000) 2019-12-09T21:41:38.899 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:41:38.894+0000 1694f700 -1 osd.4 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.676878+0000 front 2019-12-09T21:40:14.669475+0000 (oldest deadline 2019-12-09T21:41:00.559853+0000) 2019-12-09T21:41:39.226 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:41:39.221+0000 1694f700 -1 osd.2 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:13.371963+0000 front 2019-12-09T21:40:13.104538+0000 (oldest deadline 2019-12-09T21:40:56.375066+0000) 2019-12-09T21:41:39.469 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:41:39.463+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e865 v865) 2019-12-09T21:41:39.549 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:41:39.545+0000 1694f700 -1 osd.1 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:14.416660+0000 front 2019-12-09T21:40:14.429662+0000 (oldest deadline 2019-12-09T21:40:57.844983+0000) 2019-12-09T21:41:39.590 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:41:39.587+0000 1694f700 -1 osd.7 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:11.504650+0000 front 2019-12-09T21:40:11.436840+0000 (oldest deadline 2019-12-09T21:40:56.069950+0000) 2019-12-09T21:41:39.653 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:41:39.649+0000 1694f700 -1 osd.5 865 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:40:12.491762+0000 front 2019-12-09T21:40:12.432378+0000 (oldest deadline 2019-12-09T21:40:58.254537+0000) 2019-12-09T21:42:59.868 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:37:20.927 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:42:59.883 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:37:20.942 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:42:59.898 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:37:20.956 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:42:59.913 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:37:20.973 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:42:59.932 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:37:20.968 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:42:59.934 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:37:20.971 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:00.118 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:37:21.178 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:00.177 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:37:21.237 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:00.200 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:37:21.237 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:27.439 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:27.437+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:28.000 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:27.996+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:28.388 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:28.380+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:28.401 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:28.397+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:28.806 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:28.804+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:29.021 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:29.019+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:29.384 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:29.380+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:29.402 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:29.398+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:29.836 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:29.832+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:29.975 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:29.972+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:30.365 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:30.362+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:30.393 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:30.389+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:30.696 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:30.693+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:30.802 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:30.798+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:31.028 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:31.025+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:31.353 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:31.349+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:31.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:31.413+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:31.708 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:31.678+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:31.843 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:31.840+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:31.850 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:31.846+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:32.048 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:32.045+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:32.386 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:32.380+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:32.405 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:32.401+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:32.646 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:32.640+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:32.848 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:32.844+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:32.854 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:32.849+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:33.006 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:33.002+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:33.373 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:33.370+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:33.410 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:33.406+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:33.606 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:33.602+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:33.829 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:33.825+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:33.845 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:33.842+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:33.969 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:33.965+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:34.389 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:34.385+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:34.408 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:34.404+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:34.622 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:34.617+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:34.808 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:34.805+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:34.831 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:34.827+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:34.927 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:34.924+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:35.407 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:35.404+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:35.438 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:35.433+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:35.609 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:35.605+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:35.796 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:35.791+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:35.842 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:35.840+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:35.955 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:35.952+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:36.414 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:36.410+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:36.458 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:36.455+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:36.609 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:36.605+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:36.777 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:36.773+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:36.832 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:36.829+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:36.931 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:36.928+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:37.468 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:37.461+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:37.480 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:37.478+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:37.563 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:37.559+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:37.826 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:37.823+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:37.885 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:37.881+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:37.983 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:37.981+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:38.463 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:38.460+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:38.484 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:38.481+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:38.521 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:38.515+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:38.790 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:38.786+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:38.849 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:38.845+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:39.028 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:39.021+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:39.449 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:39.444+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:39.490 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:39.487+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:39.532 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:39.529+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:39.779 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:39.775+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:39.886 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:39.884+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:40.075 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:40.071+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:40.406 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:40.401+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:40.506 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:40.502+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:40.512 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:40.507+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:40.813 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:40.808+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:40.914 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:40.912+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:41.060 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:41.058+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:41.389 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:41.386+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:41.478 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:41.474+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:41.492 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:41.488+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:41.797 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:41.793+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:41.945 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:41.942+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:42.098 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:42.096+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:42.425 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:42.410+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:42.483 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:42.479+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:42.487 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:42.484+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:42.754 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:42.748+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:42.904 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:42.901+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:43.093 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:43.089+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:43.437 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:43.424+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:43.487 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:43.483+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:43.528 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:43.524+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:43.748 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:43.744+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:43.957 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:43.951+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:44.133 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:44.130+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:44.389 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:44.385+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:44.499 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:44.496+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:44.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:44.500+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:44.736 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:44.731+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:44.960 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:44.957+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:45.177 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:45.173+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:45.180 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:38:06.240 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:45.188 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:38:06.248 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:45.203 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:38:06.239 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:45.206 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:38:06.266 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:45.215 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:38:06.252 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:45.216 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:38:06.276 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:45.275 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:38:06.335 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:45.321 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:38:06.376 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:45.339 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:38:06.376 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:43:45.379 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:45.377+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:45.459 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:45.451+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:45.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:45.461+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:45.701 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:45.699+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:45.928 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:45.925+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:46.187 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:46.184+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:46.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:46.334+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:46.436 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:46.431+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:46.447 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:46.443+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:46.697 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:46.691+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:46.968 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:46.963+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:47.182 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:47.179+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:47.373 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:47.371+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:47.420 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:47.416+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:47.470 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:47.466+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:47.754 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:47.745+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:47.950 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:47.946+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:48.221 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:48.216+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:48.405 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:48.395+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:48.413 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:48.409+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:48.460 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:48.455+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:48.713 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:48.709+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:48.949 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:48.944+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:49.252 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:49.247+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:49.420 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:49.416+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:49.448 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:49.442+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:49.455 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:49.452+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:49.714 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:49.710+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:49.959 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:49.955+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:50.272 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:50.268+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:50.416 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:50.412+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:50.432 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:50.428+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:50.453 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:50.450+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:50.752 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:50.747+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:50.958 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:50.953+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:51.294 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:51.291+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:51.396 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:51.390+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:51.408 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:51.404+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:51.427 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:51.424+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:51.764 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:51.760+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:51.957 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:51.953+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:52.336 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:52.328+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:52.357 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:52.353+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:52.392 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:52.388+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:52.466 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:52.463+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:52.756 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:52.752+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:52.966 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:52.960+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:53.321 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:53.316+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:53.349 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:53.345+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:53.378 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:53.374+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:53.423 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:53.418+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:53.743 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:53.739+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:53.959 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:53.956+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:54.343 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:54.338+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:54.412 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:54.393+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:54.412 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:54.390+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:54.425 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:54.416+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:54.702 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:54.698+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:54.925 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:54.920+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:55.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:55.347+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:55.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:55.412+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:55.442 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:55.438+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:55.470 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:55.467+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:55.676 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:55.672+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:55.886 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:55.880+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:56.369 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:56.364+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:56.404 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:56.401+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:56.449 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:56.443+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:56.501 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:56.494+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:56.674 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:56.670+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:56.913 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:56.897+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:57.379 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:57.374+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:57.381 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:57.376+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:57.466 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:57.462+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:57.500 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:57.496+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:57.645 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:57.640+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:57.952 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:57.948+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:58.426 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:58.419+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:58.427 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:58.420+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:58.520 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:58.514+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:58.523 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:58.519+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:58.643 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:58.639+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:58.910 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:58.906+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:43:59.424 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:43:59.418+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:43:59.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:43:59.420+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:43:59.477 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:43:59.474+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:43:59.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:43:59.500+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:43:59.696 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:43:59.692+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:43:59.865 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:43:59.861+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:44:00.071 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:44:00.052+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e873 v873) 2019-12-09T21:44:00.412 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:44:00.407+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:44:00.453 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:44:00.449+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:44:00.457 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:44:00.452+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:44:00.542 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:44:00.538+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:44:00.735 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:44:00.724+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:44:00.826 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:44:00.822+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:44:01.418 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:44:01.414+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:44:01.462 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:44:01.457+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:44:01.489 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:44:01.484+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:44:01.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:44:01.512+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:44:01.719 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:44:01.716+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:44:01.815 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:44:01.811+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:44:02.413 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:44:02.409+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:44:02.497 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:44:02.489+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:44:02.516 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:44:02.512+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:44:02.517 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:44:02.513+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:44:02.756 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:44:02.751+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:44:02.863 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:44:02.859+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:44:03.373 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:44:03.369+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:44:03.486 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:44:03.483+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:44:03.509 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:44:03.505+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:44:03.571 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:44:03.567+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:44:03.728 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:44:03.724+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:44:03.833 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:44:03.828+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:44:04.370 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:44:04.366+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:44:04.460 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:44:04.456+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:44:04.481 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:44:04.477+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:44:04.614 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:44:04.610+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:44:04.687 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:44:04.683+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:44:04.876 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:44:04.871+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:44:05.072 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:44:05.069+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e873 v873) 2019-12-09T21:44:05.396 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:44:05.392+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:44:05.434 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:44:05.431+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:44:05.496 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:44:05.492+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:44:05.585 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:44:05.581+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:44:05.724 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:44:05.720+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:44:05.861 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:44:05.857+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:44:06.359 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:44:06.355+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:44:06.425 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:44:06.419+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:44:06.455 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:44:06.451+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:44:06.549 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:44:06.545+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:44:06.725 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:44:06.722+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:44:06.891 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:44:06.887+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:44:07.372 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:44:07.368+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:44:07.410 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:44:07.408+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:44:07.454 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:44:07.451+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:44:07.542 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:44:07.537+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:44:07.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:44:07.716+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:44:07.924 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:44:07.919+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:44:08.415 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:44:08.411+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:44:08.421 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:44:08.417+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:44:08.450 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:44:08.446+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:44:08.522 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:44:08.518+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:44:08.709 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:44:08.704+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:44:08.926 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:44:08.923+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:44:09.375 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:44:09.372+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:44:09.417 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:44:09.412+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:44:09.418 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:44:09.415+0000 1694f700 -1 osd.2 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.493937+0000 front 2019-12-09T21:42:46.108845+0000 (oldest deadline 2019-12-09T21:43:27.790245+0000) 2019-12-09T21:44:09.524 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:44:09.521+0000 1694f700 -1 osd.7 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:45.378509+0000 front 2019-12-09T21:42:45.311887+0000 (oldest deadline 2019-12-09T21:43:30.551369+0000) 2019-12-09T21:44:09.710 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:44:09.706+0000 1694f700 -1 osd.5 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:44.606421+0000 front 2019-12-09T21:42:44.624789+0000 (oldest deadline 2019-12-09T21:43:28.681114+0000) 2019-12-09T21:44:09.913 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:44:09.910+0000 1694f700 -1 osd.1 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.924236+0000 front 2019-12-09T21:42:46.845287+0000 (oldest deadline 2019-12-09T21:43:31.342682+0000) 2019-12-09T21:44:10.147 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:44:10.146+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e873 v873) 2019-12-09T21:44:10.384 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:44:10.381+0000 1694f700 -1 osd.3 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:46.656408+0000 front 2019-12-09T21:42:46.604069+0000 (oldest deadline 2019-12-09T21:43:27.199748+0000) 2019-12-09T21:44:10.385 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:44:10.382+0000 1694f700 -1 osd.4 873 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:42:42.996877+0000 front 2019-12-09T21:42:42.993322+0000 (oldest deadline 2019-12-09T21:43:27.517523+0000) 2019-12-09T21:45:15.710 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:39:36.770 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:45:15.753 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:39:36.812 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:45:15.782 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:39:36.841 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:45:15.786 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:39:36.846 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:45:15.830 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:39:36.866 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:45:15.836 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:39:36.873 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:45:15.897 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:39:36.957 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:45:15.900 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:39:36.960 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:45:15.978 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:39:37.015 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:46:04.265 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:04.260+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:05.277 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:05.272+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:05.367 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:05.363+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:06.006 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:06.001+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:06.035 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:06.031+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:06.312 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:06.308+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:06.362 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:06.357+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:06.965 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:06.963+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:07.034 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:07.031+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:07.322 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:07.317+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:07.385 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:07.381+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:07.481 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:07.476+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:07.978 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:07.974+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:08.057 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:08.054+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:08.058 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:08.055+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:08.343 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:08.339+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:08.411 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:08.407+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:08.505 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:08.502+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:08.972 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:08.968+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:09.064 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:09.061+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:09.091 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:09.088+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:09.373 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:09.369+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:09.451 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:09.447+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:09.472 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:09.467+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:09.947 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:09.942+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:10.072 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:10.068+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:10.115 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:10.111+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:10.407 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:10.401+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:10.479 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:10.476+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:10.515 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:10.510+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:10.907 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:10.904+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:11.080 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:11.074+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:11.117 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:11.113+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:11.457 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:11.453+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:11.520 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:11.516+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:11.561 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:11.557+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:11.929 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:11.920+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:12.055 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:12.052+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:12.125 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:12.121+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:12.500 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:12.491+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:12.521 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:12.515+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:12.536 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:12.531+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:12.943 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:12.940+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:13.043 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:13.040+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:13.156 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:13.151+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:13.482 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:13.478+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:13.536 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:13.532+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:13.541 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:13.536+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:13.935 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:13.927+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:14.024 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:14.020+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:14.150 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:14.147+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:14.515 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:14.510+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:14.548 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:14.539+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:14.559 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:14.554+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:14.893 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:14.890+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:15.064 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:15.057+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:15.135 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:15.132+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:15.568 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:15.564+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:15.569 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:15.565+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:15.599 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:15.594+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:15.853 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:15.846+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:16.040 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:16.036+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:16.096 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:16.092+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:16.569 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:16.564+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:16.578 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:16.571+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:16.633 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:16.630+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:16.821 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:16.817+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:17.027 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:17.024+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:17.123 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:17.120+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:17.557 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:17.553+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:17.562 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:17.557+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:17.643 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:17.639+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:17.779 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:17.776+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:18.071 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:18.068+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:18.090 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:18.087+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:18.583 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:18.577+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:18.611 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:18.607+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:18.691 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:18.685+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:18.774 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:18.770+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:19.081 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:19.078+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:19.121 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:19.118+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:19.552 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:19.548+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:19.568 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:19.565+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:19.725 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:19.719+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:19.821 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:19.809+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:20.056 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:20.052+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:20.090 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:20.087+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:20.533 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:20.529+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:20.541 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:20.538+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:20.771 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:20.768+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:20.854 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:20.850+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:21.048 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:21.045+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:21.060 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:21.057+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:21.541 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:21.537+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:21.571 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:21.568+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:21.777 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:21.773+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:21.875 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:21.872+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:22.020 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:22.017+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:22.060 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:22.058+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:22.587 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:22.584+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:22.620 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:22.617+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:22.810 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:22.807+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:22.924 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:22.920+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:23.030 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:23.026+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:23.041 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:23.038+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:23.611 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:23.607+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:23.651 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:23.648+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:23.847 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:23.844+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:23.985 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:23.971+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:24.002 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:24.000+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:24.062 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:24.059+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:24.573 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:24.570+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:24.664 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:24.660+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:24.811 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:24.806+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:24.994 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:24.990+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:24.996 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:24.992+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:25.038 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:25.033+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:25.577 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:25.574+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:25.691 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:25.689+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:25.763 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:25.760+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:25.975 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:25.969+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:26.027 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:26.025+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:26.035 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:26.032+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:26.593 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:26.589+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:26.670 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:26.666+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:26.810 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:26.807+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:26.987 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:26.984+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:26.997 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:26.995+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:27.076 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:27.073+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:27.596 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:27.592+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:27.626 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:27.622+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:27.854 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:27.850+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:27.944 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:27.940+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:28.005 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:28.002+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:28.085 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:28.082+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:28.593 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:28.589+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:28.637 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:28.633+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:28.865 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:28.861+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:28.997 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:28.993+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:29.040 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:29.035+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:29.042 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:29.039+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:29.622 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:29.618+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:29.690 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:29.685+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:29.910 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:29.908+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:30.000 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:29.996+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:30.017 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:30.014+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:30.070 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:30.067+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:30.642 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:30.638+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:30.732 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:30.727+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:30.886 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:30.883+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:30.988 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:30.984+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:31.028 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:31.025+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:31.075 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:31.073+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:31.673 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:31.668+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:31.715 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:31.711+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:31.847 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:31.843+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:31.983 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:31.979+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:32.046 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:32.038+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:32.057 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:32.055+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:32.696 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:32.692+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:32.754 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:32.750+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:32.815 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:32.812+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:33.007 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:33.003+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:33.029 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:33.025+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:33.100 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:33.096+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:33.722 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:33.718+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:33.750 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:33.747+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:33.836 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:33.833+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:33.983 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:33.980+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:34.052 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:34.048+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:34.113 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:34.108+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:34.755 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:34.751+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:34.768 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:34.763+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:34.859 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:34.855+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:34.957 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:34.948+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:35.083 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:35.078+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:35.161 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:35.158+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:35.774 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:35.770+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:35.781 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:35.777+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:35.841 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:35.838+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:35.901 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:46:35.900+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e882 v882) 2019-12-09T21:46:35.957 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:35.949+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:36.087 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:36.083+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:36.202 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:36.199+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:36.736 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:36.732+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:36.830 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:36.826+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:36.893 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:36.889+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:36.926 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:36.922+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:37.056 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:37.052+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:37.170 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:37.168+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:37.711 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:37.705+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:37.796 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:37.791+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:37.925 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:37.922+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:37.933 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:37.926+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:38.070 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:38.067+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:38.161 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:38.157+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:38.695 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:38.693+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:38.847 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:38.845+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:38.950 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:38.948+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:38.963 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:38.961+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:39.043 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:39.039+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:39.135 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:39.133+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:39.716 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:39.712+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:39.875 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:39.872+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:39.954 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:39.950+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:40.005 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:40.002+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:40.012 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:40.004+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:40.124 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:40.121+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:40.674 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:40.670+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:40.890 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:40.886+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:40.914 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:46:40.912+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e882 v882) 2019-12-09T21:46:40.940 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:40.937+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:41.004 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:41.002+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:41.051 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:41.046+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:41.137 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:41.132+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:41.722 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:41.719+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:41.898 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:41.894+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:41.974 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:41.971+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:42.052 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:42.048+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:42.053 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:42.049+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:42.119 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:42.117+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:42.726 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:42.720+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:42.902 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:42.899+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:43.014 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:43.010+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:43.086 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:43.082+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:43.096 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:43.093+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:43.155 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:43.150+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:43.700 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:43.696+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:43.928 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:43.925+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:43.986 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:43.976+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:44.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:44.056+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:44.112 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:44.109+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:44.116 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:44.111+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:44.711 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:44.707+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:44.905 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:44.901+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:45.030 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:45.025+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:45.055 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:45.030+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:45.132 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:46:45.128+0000 1694f700 -1 osd.1 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:19.922962+0000 front 2019-12-09T21:45:21.060790+0000 (oldest deadline 2019-12-09T21:46:04.852040+0000) 2019-12-09T21:46:45.149 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:45.146+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:46:45.725 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:46:45.720+0000 1694f700 -1 osd.7 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.004144+0000 front 2019-12-09T21:45:20.002416+0000 (oldest deadline 2019-12-09T21:46:03.967177+0000) 2019-12-09T21:46:45.946 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:46:45.943+0000 1694f700 -1 osd.4 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.360559+0000 front 2019-12-09T21:45:23.323547+0000 (oldest deadline 2019-12-09T21:46:06.629955+0000) 2019-12-09T21:46:45.976 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:46:45.973+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e882 v882) 2019-12-09T21:46:46.053 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:46:46.050+0000 1694f700 -1 osd.2 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:23.243486+0000 front 2019-12-09T21:45:22.029662+0000 (oldest deadline 2019-12-09T21:46:07.910117+0000) 2019-12-09T21:46:46.085 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:46:46.079+0000 1694f700 -1 osd.5 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:20.518754+0000 front 2019-12-09T21:45:20.520085+0000 (oldest deadline 2019-12-09T21:46:05.766703+0000) 2019-12-09T21:46:46.123 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:46:46.120+0000 1694f700 -1 osd.3 882 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:45:21.221109+0000 front 2019-12-09T21:45:21.227867+0000 (oldest deadline 2019-12-09T21:46:05.776262+0000) 2019-12-09T21:47:49.465 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:42:10.525 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:47:49.473 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:42:10.532 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:47:49.480 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:42:10.540 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:47:49.484 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:42:10.544 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:47:49.493 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:42:10.528 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:47:49.513 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:42:10.550 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:47:49.726 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:42:10.786 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:47:49.728 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:42:10.788 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:47:49.732 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:42:10.769 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:48:37.161 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:37.156+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:38.181 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:38.178+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:38.656 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:48:38.653+0000 1694f700 -1 osd.2 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:54.116114+0000 front 2019-12-09T21:47:54.143837+0000 (oldest deadline 2019-12-09T21:48:38.193890+0000) 2019-12-09T21:48:38.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:38.966+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:39.192 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:39.186+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:39.642 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:48:39.639+0000 1694f700 -1 osd.2 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:54.116114+0000 front 2019-12-09T21:47:54.143837+0000 (oldest deadline 2019-12-09T21:48:38.193890+0000) 2019-12-09T21:48:40.005 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:40.000+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:40.154 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:40.151+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:40.162 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:40.158+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:40.666 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:48:40.661+0000 1694f700 -1 osd.2 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:54.116114+0000 front 2019-12-09T21:47:54.143837+0000 (oldest deadline 2019-12-09T21:48:38.193890+0000) 2019-12-09T21:48:40.964 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:40.960+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:41.174 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:41.172+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:41.176 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:41.173+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:41.602 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:41.598+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:41.669 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:48:41.666+0000 1694f700 -1 osd.2 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:54.116114+0000 front 2019-12-09T21:47:54.143837+0000 (oldest deadline 2019-12-09T21:48:38.193890+0000) 2019-12-09T21:48:41.828 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:41.824+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:41.979 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:41.975+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:42.146 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:42.143+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:42.182 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:42.179+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:42.564 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:42.558+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:42.632 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:48:42.625+0000 1694f700 -1 osd.2 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:54.116114+0000 front 2019-12-09T21:47:54.143837+0000 (oldest deadline 2019-12-09T21:48:38.193890+0000) 2019-12-09T21:48:42.829 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:42.825+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:42.957 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:42.953+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:43.145 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:43.141+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:43.174 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:43.170+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:43.571 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:43.568+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:43.584 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:48:43.582+0000 1694f700 -1 osd.2 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:54.116114+0000 front 2019-12-09T21:47:54.143837+0000 (oldest deadline 2019-12-09T21:48:38.193890+0000) 2019-12-09T21:48:43.811 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:43.807+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:43.955 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:43.951+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:44.185 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:44.183+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:44.192 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:44.187+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:44.545 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:44.542+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:44.626 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:48:44.623+0000 1694f700 -1 osd.2 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:54.116114+0000 front 2019-12-09T21:47:54.143837+0000 (oldest deadline 2019-12-09T21:48:38.193890+0000) 2019-12-09T21:48:44.768 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:44.764+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:44.956 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:44.952+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:45.223 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:45.219+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:45.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:45.227+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:45.516 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:45.511+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:45.587 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:48:45.584+0000 1694f700 -1 osd.2 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:54.116114+0000 front 2019-12-09T21:47:54.143837+0000 (oldest deadline 2019-12-09T21:48:38.193890+0000) 2019-12-09T21:48:45.821 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:45.817+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:46.009 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:46.005+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:46.242 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:46.238+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:46.272 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:46.268+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:46.528 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:46.524+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:46.638 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:48:46.635+0000 1694f700 -1 osd.2 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:54.116114+0000 front 2019-12-09T21:47:54.143837+0000 (oldest deadline 2019-12-09T21:48:38.193890+0000) 2019-12-09T21:48:46.805 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:46.801+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:47.005 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:47.001+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:47.230 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:47.226+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:47.291 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:47.287+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:47.546 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:47.543+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:47.665 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:48:47.649+0000 1694f700 -1 osd.2 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:54.116114+0000 front 2019-12-09T21:47:54.143837+0000 (oldest deadline 2019-12-09T21:48:38.193890+0000) 2019-12-09T21:48:47.804 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:47.800+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:47.973 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:47.969+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:48.214 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:48.210+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:48.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:48.255+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:48.562 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:48.558+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:48.839 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:48.835+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:49.001 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:48.998+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:49.222 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:49.219+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:49.306 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:49.303+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:49.534 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:49.531+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:49.878 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:49.873+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:49.971 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:49.967+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:50.187 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:50.184+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:50.291 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:50.287+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:50.584 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:50.581+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:50.850 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:50.846+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:51.006 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:51.001+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:51.216 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:51.212+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:51.329 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:51.325+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:51.556 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:51.554+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:51.838 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:51.835+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:52.012 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:52.007+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:52.216 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:52.212+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:52.315 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:52.310+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:52.599 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:52.597+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:52.865 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:52.861+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:52.979 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:52.975+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:53.236 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:53.232+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:53.271 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:53.267+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:53.603 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:53.599+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:53.836 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:53.832+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:54.015 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:54.010+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:54.227 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:54.223+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:54.240 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:54.237+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:54.573 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:54.568+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:54.863 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:54.860+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:55.052 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:55.048+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:55.231 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:55.225+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:55.266 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:55.260+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:55.574 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:55.561+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:55.907 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:55.903+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:56.062 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:56.058+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:56.218 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:56.215+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:56.291 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:56.277+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:56.566 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:56.563+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:56.950 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:56.946+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:57.055 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:57.051+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:57.229 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:57.225+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:57.320 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:57.310+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:57.553 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:57.540+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:57.948 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:57.944+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:58.054 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:58.049+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:58.252 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:58.247+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:58.357 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:58.353+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:58.502 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:58.499+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:58.954 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:58.950+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:48:59.104 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:48:59.101+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:48:59.269 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:48:59.261+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:48:59.340 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:48:59.335+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:48:59.515 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:48:59.511+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:48:59.975 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:48:59.971+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:00.118 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:00.115+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:00.273 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:00.270+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:00.383 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:00.379+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:00.554 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:00.551+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:00.960 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:00.956+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:01.137 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:01.133+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:01.254 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:01.252+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:01.439 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:01.431+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:01.575 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:01.573+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:02.003 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:02.000+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:02.113 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:02.109+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:02.308 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:02.301+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:02.397 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:02.393+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:02.532 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:02.530+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:03.049 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:03.046+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:03.094 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:03.089+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:03.259 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:03.256+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:03.368 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:03.363+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:03.509 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:03.504+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:04.081 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:04.077+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:04.118 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:04.111+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:04.236 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:04.234+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:04.374 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:04.371+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:04.499 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:04.495+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:05.112 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:05.109+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:05.139 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:05.135+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:05.257 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:05.253+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:05.359 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:05.355+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:05.546 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:05.542+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:06.148 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:06.144+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:06.150 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:06.145+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:06.282 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:06.278+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:06.381 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:06.378+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:06.501 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:06.497+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:07.108 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:07.104+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:07.183 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:07.179+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:07.257 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:07.253+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:07.373 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:07.369+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:07.526 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:07.521+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:08.136 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:08.131+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:08.223 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:08.219+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:08.247 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:08.244+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:08.383 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:08.378+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:08.481 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:08.476+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:09.175 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:09.170+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:09.188 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:09.184+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:09.266 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:09.261+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:09.402 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:09.398+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:09.525 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:09.519+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:10.176 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:10.172+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:10.215 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:10.210+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:10.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:10.260+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:10.390 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:10.387+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:10.521 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:10.518+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:11.135 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:11.131+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:11.226 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:11.223+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:11.247 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:11.243+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:11.431 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:11.427+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:11.445 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:49:11.443+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e891 v891) 2019-12-09T21:49:11.489 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:11.485+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:12.145 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:12.139+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:12.216 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:12.211+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:12.228 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:12.225+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:12.411 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:12.404+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:12.502 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:12.498+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:13.177 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:13.172+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:13.241 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:13.237+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:13.265 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:13.261+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:13.373 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:13.368+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:13.518 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:13.514+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:14.202 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:14.199+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:14.205 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:14.202+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:14.290 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:14.286+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:14.336 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:14.326+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:14.504 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:14.499+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:15.193 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:15.188+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:15.233 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:15.229+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:15.323 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:15.319+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:15.352 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:15.348+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:15.477 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:15.465+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:16.160 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:16.157+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:16.227 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:16.224+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:16.311 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:16.302+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:16.367 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:16.361+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:16.461 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:49:16.456+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e891 v891) 2019-12-09T21:49:16.499 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:16.494+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:17.207 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:17.203+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:17.275 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:17.272+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:17.333 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:17.329+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:17.351 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:17.348+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:17.468 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:17.463+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:18.163 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:18.158+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:18.268 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:18.264+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:18.384 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:18.369+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:18.384 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:18.373+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:18.483 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:18.479+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:19.158 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:19.153+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:19.318 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:19.314+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:19.356 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:19.352+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:19.379 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:19.375+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:19.521 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:19.516+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:20.162 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:20.158+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:20.315 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:20.312+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:20.379 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:20.369+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:20.402 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:20.398+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:20.476 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:20.471+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:21.145 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:49:21.141+0000 1694f700 -1 osd.3 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.337877+0000 front 2019-12-09T21:47:54.961424+0000 (oldest deadline 2019-12-09T21:48:40.042572+0000) 2019-12-09T21:49:21.283 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:49:21.279+0000 1694f700 -1 osd.4 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.232624+0000 front 2019-12-09T21:47:55.422348+0000 (oldest deadline 2019-12-09T21:48:41.021226+0000) 2019-12-09T21:49:21.424 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:49:21.419+0000 1694f700 -1 osd.5 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:51.363746+0000 front 2019-12-09T21:47:50.746642+0000 (oldest deadline 2019-12-09T21:48:36.324132+0000) 2019-12-09T21:49:21.426 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:49:21.419+0000 1694f700 -1 osd.7 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:52.970882+0000 front 2019-12-09T21:47:52.831173+0000 (oldest deadline 2019-12-09T21:48:38.656245+0000) 2019-12-09T21:49:21.475 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:49:21.471+0000 1694f700 -1 osd.1 891 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:47:55.580363+0000 front 2019-12-09T21:47:55.843939+0000 (oldest deadline 2019-12-09T21:48:40.713695+0000) 2019-12-09T21:49:21.524 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:49:21.512+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e891 v891) 2019-12-09T21:50:08.453 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:50:08.287+0000 3378a700 -1 osd.3 895 build_incremental_map_msg missing incremental map 895 2019-12-09T21:50:08.546 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:50:08.312+0000 3378a700 -1 osd.3 895 build_incremental_map_msg missing incremental map 895 2019-12-09T21:50:08.553 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:50:08.350+0000 32788700 -1 osd.3 895 build_incremental_map_msg missing incremental map 895 2019-12-09T21:50:08.571 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:50:08.376+0000 37f93700 -1 osd.3 895 build_incremental_map_msg missing incremental map 895 2019-12-09T21:50:08.655 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:50:08.404+0000 36f91700 -1 osd.3 895 build_incremental_map_msg missing incremental map 895 2019-12-09T21:50:08.817 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:50:08.613+0000 35f8f700 -1 osd.3 895 build_incremental_map_msg missing incremental map 895 2019-12-09T21:50:11.553 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:11.303+0000 38794700 -1 osd.0 897 build_incremental_map_msg missing incremental map 897 2019-12-09T21:50:11.635 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:11.342+0000 38f95700 -1 osd.0 897 build_incremental_map_msg missing incremental map 897 2019-12-09T21:50:11.741 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:11.629+0000 3378a700 -1 osd.0 897 build_incremental_map_msg missing incremental map 897 2019-12-09T21:50:12.991 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:12.946+0000 31786700 -1 osd.0 898 build_incremental_map_msg missing incremental map 898 2019-12-09T21:50:13.072 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:13.063+0000 3578e700 -1 osd.0 898 build_incremental_map_msg missing incremental map 898 2019-12-09T21:50:13.149 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:13.095+0000 32788700 -1 osd.0 898 build_incremental_map_msg missing incremental map 898 2019-12-09T21:50:13.525 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:13.327+0000 32f89700 -1 osd.0 898 build_incremental_map_msg missing incremental map 898 2019-12-09T21:50:13.529 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:13.340+0000 3378a700 -1 osd.0 898 build_incremental_map_msg missing incremental map 898 2019-12-09T21:50:13.571 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:13.381+0000 32788700 -1 osd.0 898 build_incremental_map_msg missing incremental map 898 2019-12-09T21:50:14.320 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:14.313+0000 33f8b700 -1 osd.0 898 build_incremental_map_msg missing incremental map 897 2019-12-09T21:50:14.323 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:14.313+0000 33f8b700 -1 osd.0 898 build_incremental_map_msg missing incremental map 898 2019-12-09T21:50:15.266 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:15.219+0000 38f95700 -1 osd.0 899 build_incremental_map_msg missing incremental map 897 2019-12-09T21:50:15.340 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T21:50:15.219+0000 38f95700 -1 osd.0 899 build_incremental_map_msg missing incremental map 898 2019-12-09T21:51:13.980 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:13.976+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:14.230 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:14.224+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:14.358 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:14.354+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:15.032 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:15.028+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:15.116 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:15.111+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:15.189 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:15.181+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:15.397 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:15.394+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:15.718 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:15.714+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:16.007 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:16.003+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:16.148 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:16.136+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:16.198 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:16.194+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:16.430 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:16.425+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:16.729 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:16.723+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:17.031 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:17.027+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:17.166 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:17.161+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:17.226 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:17.221+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:17.433 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:17.429+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:17.724 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:17.717+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:18.064 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:18.059+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:18.149 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:18.145+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:18.267 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:18.257+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:18.416 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:18.413+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:18.699 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:18.696+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:19.026 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:19.021+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:19.187 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:19.182+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:19.249 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:19.245+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:19.406 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:19.402+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:19.671 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:19.667+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:20.007 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:20.003+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:20.237 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:20.233+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:20.277 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:20.273+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:20.432 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:20.427+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:20.628 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:20.624+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:21.019 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:21.012+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:21.255 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:21.251+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:21.268 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:21.265+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:21.412 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:21.405+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:21.670 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:21.666+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:21.980 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:45:43.039 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:21.982 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:45:43.042 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:21.983 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:45:43.043 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:22.008 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:45:43.067 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:22.054 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:22.050+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:22.061 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:45:43.098 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:22.066 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:45:43.103 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:22.161 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:45:43.221 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:22.233 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:22.229+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:22.233 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:45:43.292 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:22.276 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:22.272+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:22.319 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:45:43.356 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:22.361 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:22.359+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:22.635 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:22.631+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:23.084 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:23.081+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:23.278 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:23.274+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:23.315 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:23.311+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:23.362 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:23.358+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:23.638 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:23.631+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:24.132 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:24.128+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:24.255 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:24.251+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:24.319 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:24.315+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:24.341 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:24.338+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:24.627 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:24.624+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:25.104 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:25.100+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:25.213 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:25.207+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:25.288 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:25.284+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:25.391 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:25.386+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:25.673 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:25.670+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:26.061 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:26.055+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:26.170 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:26.166+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:26.325 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:26.321+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:26.421 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:26.416+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:26.675 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:26.670+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:27.087 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:27.082+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:27.206 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:27.201+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:27.351 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:27.347+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:27.381 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:27.375+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:27.711 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:27.704+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:28.117 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:28.112+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:28.210 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:28.206+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:28.374 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:28.370+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:28.386 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:28.379+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:28.681 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:28.676+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:29.119 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:29.114+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:29.229 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:29.225+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:29.405 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:29.401+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:29.421 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:29.417+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:29.720 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:29.715+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:30.125 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:30.120+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:30.210 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:30.204+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:30.417 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:30.415+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:30.430 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:30.422+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:30.679 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:30.673+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:31.175 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:31.172+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:31.240 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:31.236+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:31.463 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:31.459+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:31.476 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:31.471+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:31.676 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:31.670+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:32.150 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:32.146+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:32.219 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:32.215+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:32.435 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:32.431+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:32.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:32.514+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:32.632 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:32.626+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:33.114 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:33.111+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:33.208 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:33.203+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:33.474 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:33.470+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:33.477 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:33.473+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:33.613 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:33.609+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:34.107 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:34.101+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:34.164 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:34.159+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:34.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:34.452+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:34.492 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:34.482+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:34.645 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:34.639+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:35.063 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:35.059+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:35.200 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:35.195+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:35.461 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:35.456+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:35.505 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:35.502+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:35.653 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:35.649+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:36.113 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:36.110+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:36.225 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:36.203+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:36.458 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:36.453+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:36.530 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:36.525+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:36.696 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:36.693+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:37.075 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:37.073+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:37.218 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:37.215+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:37.465 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:37.461+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:37.500 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:37.497+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:37.658 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:37.654+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:38.076 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:38.072+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:38.240 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:38.237+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:38.468 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:38.465+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:38.490 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:38.486+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:38.624 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:38.615+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:39.110 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:39.108+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:39.225 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:39.221+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:39.458 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:39.454+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:39.500 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:39.495+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:39.598 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:39.593+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:40.084 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:40.081+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:40.201 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:40.198+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:40.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:40.492+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:40.513 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:40.510+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:40.606 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:40.603+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:41.130 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:41.127+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:41.173 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:41.170+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:41.476 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:41.472+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:41.566 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:41.563+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:41.568 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:41.565+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:42.089 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:42.086+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:42.159 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:42.156+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:42.532 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:42.521+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:42.554 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:42.548+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:42.605 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:42.600+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:43.126 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:43.122+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:43.152 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:43.149+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:43.526 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:43.521+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:43.569 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:43.565+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:43.595 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:43.590+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:44.106 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:44.104+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:44.159 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:44.156+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:44.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:44.510+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:44.598 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:44.593+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:44.605 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:44.600+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:45.069 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:45.065+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:45.133 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:45.127+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:45.552 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:45.547+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:45.581 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:45.578+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:45.631 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:45.627+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:46.073 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:46.068+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:46.160 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:46.157+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:46.520 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:46.517+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:46.599 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:46.595+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:46.646 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:46.642+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:47.003 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:51:47.000+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e900 v900) 2019-12-09T21:51:47.112 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:47.110+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:47.188 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:47.186+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:47.558 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:47.554+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:47.572 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:47.568+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:47.641 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:47.637+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:48.108 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:48.105+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:48.233 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:48.230+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:48.565 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:48.561+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:48.572 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:48.566+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:48.596 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:48.592+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:49.075 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:49.072+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:49.240 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:49.237+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:49.557 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:49.549+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:49.563 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:49.560+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:49.595 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:49.593+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:49.894 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:51:49.889+0000 1694f700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.046590+0000 front 2019-12-09T21:50:31.926364+0000 (oldest deadline 2019-12-09T21:51:49.301035+0000) 2019-12-09T21:51:50.119 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:50.117+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:50.255 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:50.244+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:50.557 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:50.551+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:50.573 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:50.568+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:50.594 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:50.592+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:50.895 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:51:50.891+0000 1694f700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.046590+0000 front 2019-12-09T21:50:31.926364+0000 (oldest deadline 2019-12-09T21:51:49.301035+0000) 2019-12-09T21:51:51.086 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:51.082+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:51.244 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:51.242+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:51.543 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:51.539+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:51.582 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:51.580+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:51.587 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:51.583+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:51.943 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:51:51.940+0000 1694f700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.046590+0000 front 2019-12-09T21:50:31.926364+0000 (oldest deadline 2019-12-09T21:51:49.301035+0000) 2019-12-09T21:51:52.016 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:51:52.012+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e900 v900) 2019-12-09T21:51:52.057 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:52.054+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:52.276 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:52.273+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:52.532 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:52.528+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:52.541 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:52.537+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:52.588 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:52.584+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:52.941 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:51:52.937+0000 1694f700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.046590+0000 front 2019-12-09T21:50:31.926364+0000 (oldest deadline 2019-12-09T21:51:49.301035+0000) 2019-12-09T21:51:53.010 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:53.008+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:53.243 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:53.237+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:53.527 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:53.523+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:53.570 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:53.567+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:53.611 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:53.607+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:53.943 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:51:53.938+0000 1694f700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.046590+0000 front 2019-12-09T21:50:31.926364+0000 (oldest deadline 2019-12-09T21:51:49.301035+0000) 2019-12-09T21:51:54.049 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:54.046+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:54.256 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:54.253+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:54.547 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:54.544+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:54.571 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:54.566+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:54.588 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:54.584+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:54.991 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:51:54.987+0000 1694f700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.046590+0000 front 2019-12-09T21:50:31.926364+0000 (oldest deadline 2019-12-09T21:51:49.301035+0000) 2019-12-09T21:51:55.069 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:55.065+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:55.246 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:55.243+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:55.513 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:55.509+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:55.561 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:55.557+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:55.563 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:55.559+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:55.962 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:51:55.959+0000 1694f700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.046590+0000 front 2019-12-09T21:50:31.926364+0000 (oldest deadline 2019-12-09T21:51:49.301035+0000) 2019-12-09T21:51:56.106 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:56.103+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:56.272 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:51:56.269+0000 1694f700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:28.196045+0000 front 2019-12-09T21:50:28.092223+0000 (oldest deadline 2019-12-09T21:51:13.937547+0000) 2019-12-09T21:51:56.559 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:51:56.555+0000 1694f700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:30.695873+0000 front 2019-12-09T21:50:30.657752+0000 (oldest deadline 2019-12-09T21:51:14.043100+0000) 2019-12-09T21:51:56.562 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:51:56.558+0000 1694f700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:31.900786+0000 front 2019-12-09T21:50:32.057271+0000 (oldest deadline 2019-12-09T21:51:14.175477+0000) 2019-12-09T21:51:56.589 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:51:56.587+0000 1694f700 -1 osd.3 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:29.663231+0000 front 2019-12-09T21:50:29.662152+0000 (oldest deadline 2019-12-09T21:51:14.833210+0000) 2019-12-09T21:51:56.936 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:51:56.931+0000 1694f700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.046590+0000 front 2019-12-09T21:50:31.926364+0000 (oldest deadline 2019-12-09T21:51:49.301035+0000) 2019-12-09T21:51:57.068 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:51:57.062+0000 1694f700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:50:32.365590+0000 front 2019-12-09T21:50:32.372567+0000 (oldest deadline 2019-12-09T21:51:14.887806+0000) 2019-12-09T21:51:57.092 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:51:57.088+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e900 v900) 2019-12-09T21:51:59.447 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:46:20.506 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:59.450 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:46:20.510 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:59.464 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:46:20.498 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:59.464 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:46:20.501 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:59.468 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:46:20.527 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:59.473 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:46:20.530 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:59.518 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:46:20.554 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:59.544 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:46:20.603 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:51:59.583 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:46:20.642 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:53:46.526 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:46.523+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:46.816 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:46.812+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:47.007 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:47.001+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:47.095 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:47.091+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:47.384 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:47.378+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:47.576 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:47.573+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:47.861 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:47.855+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:47.977 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:47.973+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:48.112 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:48.108+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:48.327 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:53:48.324+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:53:48.364 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:48.360+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:48.597 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:48.593+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:48.819 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:48.816+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:48.951 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:48.947+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:49.118 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:49.115+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:49.364 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:49.359+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:49.380 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:53:49.376+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:53:49.629 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:49.627+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:49.870 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:49.866+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:49.910 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:49.906+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:50.153 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:50.145+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:50.349 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:50.346+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:50.376 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:53:50.373+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:53:50.669 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:50.666+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:50.921 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:50.917+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:50.963 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:50.959+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:51.175 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:51.170+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:51.342 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:51.338+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:51.429 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:53:51.425+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:53:51.642 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:51.640+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:51.914 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:51.911+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:52.013 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:52.009+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:52.152 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:52.148+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:52.305 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:52.301+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:52.402 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:53:52.398+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:53:52.627 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:52.625+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:52.882 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:52.879+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:53.027 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:53.024+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:53.140 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:53.136+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:53.349 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:53.346+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:53.382 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:53:53.380+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:53:53.653 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:53.649+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:53.891 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:53.887+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:54.049 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:54.045+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:54.173 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:54.166+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:54.311 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:54.308+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:54.348 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:53:54.345+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:53:54.689 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:54.686+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:54.903 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:54.900+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:55.021 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:55.017+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:55.184 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:55.179+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:55.324 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:55.318+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:55.391 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:53:55.387+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:53:55.705 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:55.702+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:55.936 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:55.934+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:56.002 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:55.998+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:56.213 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:56.209+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:56.314 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:56.309+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:56.346 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:53:56.343+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:53:56.674 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:56.671+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:56.929 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:56.926+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:57.034 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:57.031+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:57.232 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:57.228+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:57.290 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:57.286+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:57.374 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:53:57.370+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:53:57.726 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:57.722+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:57.957 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:57.952+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:58.041 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:58.038+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:58.193 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:58.189+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:58.336 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:58.330+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:58.385 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:53:58.380+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:53:58.722 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:58.718+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:58.992 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:58.988+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:53:59.020 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:53:59.014+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:53:59.234 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:53:59.229+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:53:59.342 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:53:59.337+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:53:59.414 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:53:59.411+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:53:59.736 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:53:59.733+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:53:59.952 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:53:59.949+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:00.042 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:00.039+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:00.236 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:00.232+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:00.348 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:00.344+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:00.419 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:00.415+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:00.718 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:00.715+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:00.960 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:00.956+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:01.054 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:01.050+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:01.268 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:01.265+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:01.362 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:01.357+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:01.375 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:01.372+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:01.675 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:01.672+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:01.921 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:01.917+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:02.040 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:02.036+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:02.324 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:02.320+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:02.343 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:02.339+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:02.368 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:02.364+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:02.658 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:02.655+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:02.887 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:02.884+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:03.069 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:03.065+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:03.328 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:03.325+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:03.362 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:03.358+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:03.394 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:03.388+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:03.631 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:03.628+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:03.878 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:03.873+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:04.109 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:04.105+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:04.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:04.349+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:04.373 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:04.369+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:04.381 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:04.377+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:04.655 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:04.653+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:04.929 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:04.925+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:05.115 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:05.112+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:05.369 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:05.366+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:05.401 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:05.398+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:05.435 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:05.430+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:05.658 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:05.652+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:05.901 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:05.897+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:06.116 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:06.113+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:06.346 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:06.335+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:06.413 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:06.408+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:06.413 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:06.410+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:06.663 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:06.661+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:06.949 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:06.945+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:07.081 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:07.076+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:07.301 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:07.298+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:07.382 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:07.379+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:07.410 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:07.406+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:07.682 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:07.679+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:08.003 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:07.998+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:08.042 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:08.037+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:08.330 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:08.327+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:08.419 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:08.415+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:08.439 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:08.435+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:08.645 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:08.642+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:09.035 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:09.033+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:09.081 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:09.078+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:09.286 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:09.282+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:09.381 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:09.376+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:09.481 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:09.477+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:09.644 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:09.641+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:10.013 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:10.011+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:10.054 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:10.050+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:10.282 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:10.279+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:10.431 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:10.428+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:10.525 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:10.521+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:10.682 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:10.678+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:10.999 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:10.994+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:11.043 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:11.039+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:11.287 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:11.283+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:11.409 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:11.406+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:11.540 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:11.536+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:11.696 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:11.692+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:11.992 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:11.987+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:12.060 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:12.055+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:12.246 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:12.242+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:12.402 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:12.398+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:12.503 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:12.499+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:12.706 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:12.702+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:12.962 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:12.959+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:13.074 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:13.070+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:13.299 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:13.295+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:13.415 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:13.411+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:13.488 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:13.484+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:13.704 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:13.700+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:13.961 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:13.958+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:14.085 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:14.082+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:14.272 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:14.269+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:14.430 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:14.427+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:14.462 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:14.457+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:14.670 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:14.667+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:14.934 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:14.931+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:15.053 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:15.049+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:15.314 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:15.310+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:15.430 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:15.426+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:15.435 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:15.431+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:15.679 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:15.672+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:15.952 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:15.949+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:16.095 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:16.090+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:16.344 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:16.340+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:16.406 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:16.402+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:16.487 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:16.483+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:16.710 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:16.705+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:16.989 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:16.985+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:17.061 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:17.057+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:17.371 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:17.367+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:17.433 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:17.430+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:17.464 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:17.460+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:17.727 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:17.724+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:17.971 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:17.968+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:18.103 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:18.099+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:18.392 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:18.390+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:18.470 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:18.466+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:18.477 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:18.473+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:18.721 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:18.718+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:18.964 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:18.961+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:19.097 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:19.094+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:19.406 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:19.402+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:19.441 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:19.437+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:19.444 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:19.439+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:19.723 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:19.720+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:19.995 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:19.992+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:20.068 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:20.065+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:20.398 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:20.394+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:20.439 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:20.436+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:20.444 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:20.441+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:20.730 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:20.726+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:20.968 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:20.965+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:21.075 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:21.072+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:21.373 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:21.369+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:21.404 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:21.402+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:21.434 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:21.430+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:21.707 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:21.704+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:22.007 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:22.004+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:22.039 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:22.035+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:22.377 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:22.371+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:22.423 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:22.416+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:22.435 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:22.431+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:22.537 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:54:22.534+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e908 v908) 2019-12-09T21:54:22.689 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:22.686+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:23.051 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:23.043+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:23.056 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:23.052+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:23.376 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:23.371+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:23.428 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:23.424+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:23.429 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:23.425+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:23.659 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:23.655+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:24.010 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:24.007+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:24.034 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:24.030+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:24.379 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:24.375+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:24.454 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:24.451+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:24.469 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:24.465+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:24.614 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:24.611+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:25.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:25.063+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:25.086 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:25.082+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:25.361 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:25.355+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:25.409 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:25.405+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:25.483 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:25.479+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:25.593 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:25.588+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:26.063 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:26.056+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:26.131 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:26.127+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:26.365 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:26.362+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:26.408 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:26.403+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:26.541 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:26.536+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:26.636 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:26.633+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:27.109 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:27.104+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:27.137 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:27.134+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:27.360 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:27.356+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:27.389 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:27.384+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:27.536 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:27.532+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:27.551 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:54:27.548+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e908 v908) 2019-12-09T21:54:27.628 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:27.623+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:28.102 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:28.098+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:28.150 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:28.145+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:28.341 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:28.337+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:28.425 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:28.419+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:28.559 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:28.553+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:28.615 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:28.610+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:29.133 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:29.129+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:29.175 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:29.170+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:29.385 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:29.381+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:29.481 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:29.470+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:29.579 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:29.575+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:29.662 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:29.658+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:30.095 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:30.092+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:30.195 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:30.190+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:30.417 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:30.414+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:30.506 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:30.501+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:30.562 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:30.558+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:30.690 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:30.679+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:31.147 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:31.144+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:31.151 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:31.147+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:31.436 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:31.432+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:31.504 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:31.500+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:31.544 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:31.539+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:31.733 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:31.727+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:54:32.176 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:54:32.173+0000 1694f700 -1 osd.7 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:00.985196+0000 front 2019-12-09T21:53:00.937422+0000 (oldest deadline 2019-12-09T21:53:46.072067+0000) 2019-12-09T21:54:32.182 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:54:32.177+0000 1694f700 -1 osd.1 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:02.405523+0000 front 2019-12-09T21:53:01.845962+0000 (oldest deadline 2019-12-09T21:53:45.916620+0000) 2019-12-09T21:54:32.403 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:54:32.400+0000 1694f700 -1 osd.4 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.633419+0000 front 2019-12-09T21:53:05.719469+0000 (oldest deadline 2019-12-09T21:53:46.271402+0000) 2019-12-09T21:54:32.513 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:54:32.510+0000 1694f700 -1 osd.5 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.076185+0000 front 2019-12-09T21:53:05.361422+0000 (oldest deadline 2019-12-09T21:53:46.711111+0000) 2019-12-09T21:54:32.548 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:54:32.545+0000 1694f700 -1 osd.2 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:03.440738+0000 front 2019-12-09T21:53:03.473275+0000 (oldest deadline 2019-12-09T21:53:47.468639+0000) 2019-12-09T21:54:32.597 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:54:32.591+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e908 v908) 2019-12-09T21:54:32.805 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:54:32.785+0000 1694f700 -1 osd.3 908 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:53:05.919773+0000 front 2019-12-09T21:53:05.564870+0000 (oldest deadline 2019-12-09T21:53:45.602150+0000) 2019-12-09T21:55:52.938 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:50:13.998 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:55:52.957 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:50:14.014 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:55:52.957 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:50:14.015 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:55:52.959 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:50:14.018 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:55:52.967 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:50:14.004 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:55:52.976 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:50:14.012 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:55:53.240 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:50:14.299 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:55:53.244 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:50:14.303 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:55:53.346 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:50:14.383 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:56:23.617 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:23.612+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:24.361 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:24.357+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:24.454 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:24.451+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:24.572 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:24.569+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:24.892 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:24.888+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:25.107 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:25.104+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:25.388 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:25.384+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:25.485 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:25.480+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:25.550 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:25.547+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:25.877 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:25.874+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:26.122 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:26.120+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:26.429 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:26.426+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:26.477 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:26.473+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:26.586 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:26.582+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:26.920 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:26.916+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:27.109 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:27.106+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:27.387 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:27.384+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:27.482 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:27.478+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:27.591 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:27.587+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:27.924 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:27.917+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:28.133 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:28.130+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:28.398 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:28.394+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:28.486 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:28.482+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:28.599 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:28.596+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:28.971 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:28.968+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:29.107 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:29.103+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:29.404 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:29.401+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:29.457 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:29.454+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:29.621 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:29.617+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:30.011 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:30.006+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:30.138 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:30.135+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:30.448 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:30.445+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:30.478 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:30.474+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:30.637 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:30.632+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:31.050 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:31.047+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:31.180 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:31.174+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:31.458 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:31.454+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:31.519 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:31.477+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:31.625 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:31.622+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:32.053 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:32.050+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:32.226 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:32.222+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:32.427 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:32.424+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:32.441 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:32.437+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:32.645 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:32.641+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:33.039 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:33.034+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:33.208 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:33.203+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:33.395 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:33.389+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:33.403 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:33.400+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:33.693 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:33.689+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:34.073 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:34.070+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:34.212 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:34.207+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:34.364 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:34.360+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:34.450 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:34.446+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:34.716 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:34.712+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:35.037 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:35.031+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:35.169 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:35.162+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:35.407 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:35.404+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:35.502 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:35.498+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:35.706 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:35.699+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:36.019 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:36.010+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:36.150 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:36.146+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:36.367 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:36.364+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:36.518 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:36.513+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:36.724 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:36.719+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:37.059 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:37.056+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:37.157 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:37.153+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:37.404 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:37.400+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:37.529 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:37.522+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:37.744 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:37.741+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:38.059 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:38.054+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:38.149 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:38.145+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:38.417 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:38.411+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:38.578 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:38.575+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:38.729 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:38.726+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:39.047 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:39.039+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:39.202 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:39.197+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:39.391 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:39.388+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:39.606 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:39.602+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:39.774 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:39.770+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:40.077 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:40.073+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:40.256 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:40.251+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:40.448 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:40.441+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:40.637 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:40.633+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:40.819 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:40.815+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:41.115 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:41.112+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:41.253 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:41.249+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:41.438 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:41.434+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:41.601 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:41.596+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:41.777 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:41.773+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:42.129 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:42.126+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:42.207 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:42.203+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:42.455 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:42.452+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:42.578 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:42.575+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:42.752 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:42.747+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:43.107 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:43.103+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:43.153 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:43.149+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:43.164 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:43.160+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:43.503 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:43.499+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:43.605 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:43.601+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:43.749 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:43.744+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:44.086 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:44.082+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:44.186 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:44.180+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:44.205 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:44.200+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:44.472 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:44.468+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:44.593 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:44.589+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:44.771 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:44.766+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:45.044 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:45.040+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:45.212 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:45.208+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:45.234 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:45.231+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:45.469 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:45.465+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:45.613 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:45.608+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:45.820 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:45.816+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:46.019 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:46.015+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:46.189 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:46.184+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:46.223 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:46.218+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:46.490 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:46.487+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:46.643 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:46.639+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:46.773 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:46.768+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:47.018 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:47.014+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:47.197 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:47.193+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:47.233 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:47.229+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:47.516 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:47.513+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:47.663 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:47.658+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:47.747 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:47.743+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:48.062 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:48.059+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:48.189 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:48.184+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:48.233 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:48.228+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:48.515 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:48.511+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:48.693 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:48.688+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:48.787 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:48.783+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:49.067 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:49.063+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:49.155 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:49.150+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:49.267 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:49.263+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:49.480 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:49.473+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:49.662 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:49.659+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:49.826 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:49.820+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:50.117 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:50.113+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:50.165 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:50.159+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:50.238 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:50.234+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:50.496 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:50.488+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:50.669 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:50.648+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:50.876 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:50.871+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:51.114 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:51.109+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:51.212 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:51.208+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:51.220 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:51.217+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:51.465 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:51.461+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:51.631 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:51.628+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:51.872 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:51.868+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:52.094 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:52.089+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:52.173 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:52.167+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:52.211 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:52.206+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:52.422 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:52.417+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:52.638 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:52.634+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:52.837 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:52.833+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:53.055 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:53.052+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:53.210 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:53.206+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:53.254 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:53.251+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:53.427 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:53.422+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:53.666 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:53.662+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:53.807 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:53.798+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:54.109 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:54.105+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:54.256 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:54.252+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:54.261 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:54.257+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:54.464 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:54.461+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:54.717 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:54.712+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:54.846 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:54.842+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:55.080 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:55.077+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:55.220 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:55.217+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:55.311 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:55.307+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:55.463 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:55.458+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:55.682 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:55.679+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:55.816 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:55.812+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:56.104 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:56.100+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:56.241 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:56.238+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:56.302 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:56.298+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:56.461 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:56.457+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:56.646 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:56.641+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:56.796 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:56.793+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:57.109 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:57.098+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:57.221 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:57.217+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:57.278 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:57.273+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:57.482 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:57.479+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:57.609 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:57.605+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:57.776 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:57.773+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:57.950 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:56:57.948+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e920 v920) 2019-12-09T21:56:58.116 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:58.112+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:58.229 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:58.227+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:58.305 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:58.302+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:58.461 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:58.457+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:58.652 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:58.648+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:58.799 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:58.796+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:56:59.091 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:56:59.087+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:56:59.278 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:56:59.275+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:56:59.295 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:56:59.292+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:56:59.487 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:56:59.481+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:56:59.612 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:56:59.608+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:56:59.773 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:56:59.769+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:57:00.045 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:57:00.041+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:57:00.301 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:57:00.298+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:57:00.340 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:57:00.337+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:57:00.481 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:57:00.476+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:57:00.571 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:57:00.568+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:57:00.795 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:57:00.791+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:57:01.022 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:57:01.018+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:57:01.313 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:57:01.310+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:57:01.313 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:57:01.309+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:57:01.451 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:57:01.447+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:57:01.534 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:57:01.530+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:57:01.806 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:57:01.801+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:57:02.047 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:57:02.043+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:57:02.334 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:57:02.330+0000 1694f700 -1 osd.3 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:40.029373+0000 front 2019-12-09T21:55:39.859853+0000 (oldest deadline 2019-12-09T21:56:43.149534+0000) 2019-12-09T21:57:02.358 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:57:02.353+0000 1694f700 -1 osd.2 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.217053+0000 front 2019-12-09T21:55:39.280507+0000 (oldest deadline 2019-12-09T21:56:24.501048+0000) 2019-12-09T21:57:02.427 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:57:02.424+0000 1694f700 -1 osd.5 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:39.842176+0000 front 2019-12-09T21:55:39.823451+0000 (oldest deadline 2019-12-09T21:56:24.230040+0000) 2019-12-09T21:57:02.560 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:57:02.556+0000 1694f700 -1 osd.7 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.901164+0000 front 2019-12-09T21:55:38.912595+0000 (oldest deadline 2019-12-09T21:56:23.549939+0000) 2019-12-09T21:57:02.826 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:57:02.822+0000 1694f700 -1 osd.1 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.396464+0000 front 2019-12-09T21:55:38.150923+0000 (oldest deadline 2019-12-09T21:56:23.346986+0000) 2019-12-09T21:57:03.007 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:57:03.006+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e920 v920) 2019-12-09T21:57:03.032 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:57:03.027+0000 1694f700 -1 osd.4 920 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:55:38.639365+0000 front 2019-12-09T21:55:38.675119+0000 (oldest deadline 2019-12-09T21:56:23.893863+0000) 2019-12-09T21:57:51.781 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:57:51.760+0000 35f8f700 -1 osd.2 924 build_incremental_map_msg missing incremental map 924 2019-12-09T21:57:51.813 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:57:51.775+0000 36790700 -1 osd.2 924 build_incremental_map_msg missing incremental map 924 2019-12-09T21:57:51.827 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:57:51.776+0000 35f8f700 -1 osd.2 924 build_incremental_map_msg missing incremental map 924 2019-12-09T21:57:51.892 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:57:51.847+0000 31786700 -1 osd.2 924 build_incremental_map_msg missing incremental map 924 2019-12-09T21:57:52.125 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:57:51.948+0000 35f8f700 -1 osd.2 924 build_incremental_map_msg missing incremental map 924 2019-12-09T21:57:52.127 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:57:52.120+0000 35f8f700 -1 osd.3 924 build_incremental_map_msg missing incremental map 924 2019-12-09T21:57:52.128 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:57:52.122+0000 35f8f700 -1 osd.3 924 build_incremental_map_msg missing incremental map 924 2019-12-09T21:57:52.282 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:57:52.093+0000 34f8d700 -1 osd.2 924 build_incremental_map_msg missing incremental map 924 2019-12-09T21:57:52.891 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:57:52.594+0000 32788700 -1 osd.3 924 build_incremental_map_msg missing incremental map 924 2019-12-09T21:58:57.038 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:58:57.034+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:58:57.937 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:58:57.931+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:58:58.067 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:58:58.062+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:58:58.314 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:58:58.309+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:58:58.460 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:58:58.457+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:58:58.921 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:58:58.915+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:58:59.081 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:58:59.077+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:58:59.297 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:58:59.291+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:58:59.463 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:58:59.459+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:58:59.753 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:58:59.745+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:58:59.886 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:58:59.878+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:00.072 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:00.066+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:00.291 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:00.283+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:00.501 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:00.494+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:00.784 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:00.776+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:00.879 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:00.870+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:01.060 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:01.056+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:01.315 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:01.294+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:01.524 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:01.518+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:01.545 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:01.533+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:01.775 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:01.771+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:01.897 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:01.892+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:02.089 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:02.086+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:02.267 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:02.263+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:02.493 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:02.488+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:02.551 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:02.547+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:02.775 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:02.771+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:02.850 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:02.847+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:03.109 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:03.105+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:03.291 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:03.289+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:03.481 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:03.474+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:03.528 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:03.524+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:03.748 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:03.743+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:03.876 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:03.870+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:04.095 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:04.090+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:04.249 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:04.245+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:04.453 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:04.449+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:04.521 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:04.514+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:04.715 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:04.710+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:04.872 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:04.869+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:05.080 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:05.077+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:05.292 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:05.287+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:05.441 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:05.438+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:05.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:05.499+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:05.695 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:05.692+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:05.877 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:05.873+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:06.112 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:06.108+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:06.308 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:06.304+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:06.453 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:06.450+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:06.546 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:06.542+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:06.711 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:06.707+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:06.871 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:06.860+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:07.127 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:07.123+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:07.332 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:07.328+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:07.484 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:07.481+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:07.500 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:07.497+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:07.674 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:07.670+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:07.891 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:07.888+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:08.095 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:08.084+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:08.349 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:08.344+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:08.471 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:08.468+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:08.489 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:08.486+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:08.682 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:08.677+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:08.889 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:08.885+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:09.144 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:09.138+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:09.385 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:09.382+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:09.453 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:09.449+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:09.456 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:09.454+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:09.723 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:09.719+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:09.878 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:09.874+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:10.125 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:10.120+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:10.350 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:10.346+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:10.418 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:10.414+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:10.508 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:10.504+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:10.694 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:10.691+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:10.915 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:10.911+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:11.163 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:11.160+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:11.355 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:11.351+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:11.382 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:11.378+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:11.503 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:11.500+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:11.728 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:11.724+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:11.927 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:11.924+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:12.171 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:12.167+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:12.343 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:12.340+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:12.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:12.422+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:12.529 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:12.525+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:12.683 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:12.679+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:12.939 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:12.936+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:13.140 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:13.131+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:13.369 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:13.364+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:13.407 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:13.402+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:13.533 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:13.529+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:13.699 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:13.697+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:13.920 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:13.915+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:14.166 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:14.158+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:14.372 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:14.368+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:14.425 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:14.421+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:14.578 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:14.575+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:14.694 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:14.690+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:14.935 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:14.932+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:15.149 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:15.146+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:15.383 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:15.380+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:15.473 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:15.470+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:15.570 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:15.566+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:15.740 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:15.733+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:15.923 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:15.921+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:16.190 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:16.186+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:16.380 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:16.376+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:16.470 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:16.467+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:16.595 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:16.591+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:16.699 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:16.697+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:16.887 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:16.883+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:17.150 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:17.146+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:17.349 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:17.345+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:17.470 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:17.467+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:17.652 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:17.646+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:17.750 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:17.747+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:17.937 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:17.933+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:18.121 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:18.117+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:18.312 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:18.309+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:18.491 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:18.488+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:18.669 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:18.665+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:18.765 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:18.761+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:18.984 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:18.977+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:19.148 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:19.143+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:19.277 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:19.274+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:19.515 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:19.512+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:19.671 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:19.667+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:19.743 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:19.738+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:19.987 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:19.982+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:20.137 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:20.133+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:20.238 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:20.233+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:20.544 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:20.542+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:20.698 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:20.694+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:20.787 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:20.783+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:21.029 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:21.024+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:21.149 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:21.146+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:21.216 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:21.213+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:21.573 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:21.570+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:21.663 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:21.659+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:21.819 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:21.816+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:22.077 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:22.074+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:22.135 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:22.131+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:22.237 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:22.235+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:22.553 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:22.550+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:22.656 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:22.651+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:22.801 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:22.798+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:23.080 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:23.077+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:23.167 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:23.163+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:23.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:23.268+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:23.559 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:23.553+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:23.707 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:23.702+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:23.791 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:23.787+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:24.085 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:24.081+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:24.181 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:24.177+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:24.299 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:24.295+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:24.600 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:24.597+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:24.699 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:24.695+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:24.782 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:24.771+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:25.108 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:25.104+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:25.214 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:25.211+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:25.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:25.267+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:25.572 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:25.569+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:25.688 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:25.684+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:25.783 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:25.779+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:26.120 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:26.116+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:26.171 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:26.167+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:26.284 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:26.281+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:26.584 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:26.581+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:26.656 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:26.652+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:26.827 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:26.824+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:27.111 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:27.106+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:27.230 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:27.223+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:27.266 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:27.263+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:27.621 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:27.616+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:27.639 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:27.630+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:27.879 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:27.875+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:28.146 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:28.127+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:28.224 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:28.220+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:28.273 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:28.270+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:28.399 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:59:28.396+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e927 v927) 2019-12-09T21:59:28.597 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:28.595+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:28.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:28.615+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:28.867 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:28.863+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:29.149 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:29.140+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:29.256 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:29.251+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:29.294 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:29.290+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:29.560 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:29.558+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:29.658 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:29.656+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:29.889 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:29.883+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:30.181 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:30.177+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:30.237 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:30.233+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:30.327 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:30.318+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:30.570 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:30.564+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:30.685 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:30.682+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:30.920 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:30.916+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:31.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:31.228+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:31.256 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:31.252+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:31.337 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:31.333+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:31.541 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:31.537+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:31.691 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:31.688+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:31.952 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:31.948+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:32.216 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:32.214+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:32.251 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:32.248+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:32.303 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:32.299+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:32.538 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:32.534+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:32.738 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:32.735+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:32.954 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:32.949+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:33.263 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:33.258+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:33.277 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:33.273+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:33.309 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:33.301+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:33.417 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:59:33.414+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e927 v927) 2019-12-09T21:59:33.577 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:33.574+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:33.722 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:33.719+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:34.007 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:34.003+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:34.256 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:34.253+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:34.265 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:34.259+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:34.301 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:34.293+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:34.544 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:34.539+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:34.714 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:34.711+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:35.041 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:35.036+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:35.216 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:35.213+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:35.302 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:35.297+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:35.309 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:35.303+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:35.577 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:35.573+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:35.698 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:35.695+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:36.057 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:36.054+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:36.239 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:36.234+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:36.265 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:36.262+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:36.301 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:36.294+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:36.631 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:36.627+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:36.678 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:36.675+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:37.114 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:37.110+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:37.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:37.260+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:37.266 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:37.262+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:37.271 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:37.267+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:37.648 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:37.641+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:37.726 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:37.722+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:38.090 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:38.085+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:38.234 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:38.230+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:38.243 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:38.239+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:38.249 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:38.246+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:38.432 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:59:38.429+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e927 v927) 2019-12-09T21:59:38.625 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:38.620+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:38.742 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:38.727+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:39.138 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:39.134+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:39.211 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:39.208+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:39.266 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:39.263+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:39.295 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:39.290+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:39.578 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:39.575+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:39.743 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:39.739+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:40.152 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:40.149+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:40.182 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:40.179+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:40.266 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:40.262+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:40.318 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:40.315+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:40.559 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:40.556+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:40.784 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:40.780+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:41.180 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:41.177+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:41.200 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:41.196+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:41.286 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:41.282+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:41.310 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:41.306+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:41.517 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:41.512+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:41.744 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:41.740+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:42.176 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:42.173+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:42.223 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:42.218+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:42.292 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:42.289+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:42.297 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:42.293+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:42.517 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:42.514+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:42.777 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T21:59:42.773+0000 1694f700 -1 osd.1 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.275656+0000 front 2019-12-09T21:58:15.363014+0000 (oldest deadline 2019-12-09T21:59:01.038085+0000) 2019-12-09T21:59:43.166 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T21:59:43.154+0000 1694f700 -1 osd.3 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.311497+0000 front 2019-12-09T21:58:14.312257+0000 (oldest deadline 2019-12-09T21:58:57.557329+0000) 2019-12-09T21:59:43.254 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T21:59:43.250+0000 1694f700 -1 osd.2 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:15.395415+0000 front 2019-12-09T21:58:15.344198+0000 (oldest deadline 2019-12-09T21:58:58.229151+0000) 2019-12-09T21:59:43.277 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T21:59:43.268+0000 1694f700 -1 osd.4 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:14.852978+0000 front 2019-12-09T21:58:14.847056+0000 (oldest deadline 2019-12-09T21:58:58.898424+0000) 2019-12-09T21:59:43.281 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T21:59:43.273+0000 1694f700 -1 osd.5 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.928534+0000 front 2019-12-09T21:58:12.939264+0000 (oldest deadline 2019-12-09T21:58:56.403666+0000) 2019-12-09T21:59:43.508 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T21:59:43.504+0000 1694f700 -1 osd.7 927 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T21:58:12.503816+0000 front 2019-12-09T21:58:12.489975+0000 (oldest deadline 2019-12-09T21:58:58.348493+0000) 2019-12-09T21:59:43.589 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T21:59:43.584+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e927 v927) 2019-12-09T21:59:43.780 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:54:04.839 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:59:43.796 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:54:04.855 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:59:43.823 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:54:04.882 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:59:43.828 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:54:04.887 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T21:59:43.852 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:54:04.889 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:59:43.855 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:54:04.892 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:59:44.098 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:54:05.135 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T21:59:44.194 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:54:05.253 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T21:59:44.236 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:54:05.294 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:03.838 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:54:24.897 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:03.850 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:54:24.909 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:03.857 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:54:24.917 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:03.863 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:54:24.922 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:03.864 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:54:24.901 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:03.879 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:54:24.915 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:03.916 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:54:24.975 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:03.940 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:54:24.976 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:03.983 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:54:25.019 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:21.473 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:00:21.467+0000 21852700 -1 reset not still connected to 0x100e4650 2019-12-09T22:00:21.510 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:00:21.467+0000 21852700 -1 reset not still connected to 0x1cd8f7a0 2019-12-09T22:00:24.022 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:54:45.081 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:24.080 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:54:45.140 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:24.099 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:54:45.158 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:24.099 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:54:45.133 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:24.119 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:54:45.178 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:24.127 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:54:45.186 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:24.161 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:54:45.198 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:24.166 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:54:45.226 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:00:24.228 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:54:45.264 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:01:30.323 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:30.318+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:30.803 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:30.799+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:31.315 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:31.311+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:31.751 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:31.749+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:31.828 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:31.824+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:32.025 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:32.020+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:32.194 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:32.191+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:32.330 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:32.327+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:32.779 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:32.774+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:32.784 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:32.780+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:33.063 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:33.059+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:33.226 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:33.223+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:33.234 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:33.230+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:33.353 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:33.347+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:33.776 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:33.772+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:33.798 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:33.795+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:34.022 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:34.016+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:34.198 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:34.192+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:34.276 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:34.271+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:34.376 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:34.371+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:34.770 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:34.767+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:34.852 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:34.845+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:34.983 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:34.981+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:35.215 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:35.212+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:35.240 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:35.237+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:35.369 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:35.365+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:35.769 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:35.765+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:35.828 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:35.824+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:35.992 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:35.988+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:36.191 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:36.186+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:36.205 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:36.201+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:36.422 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:36.412+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:36.753 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:36.750+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:36.823 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:36.813+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:36.976 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:36.972+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:37.220 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:37.217+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:37.246 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:37.242+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:37.377 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:37.373+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:37.708 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:37.704+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:37.838 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:37.833+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:38.019 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:38.016+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:38.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:38.226+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:38.270 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:38.266+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:38.422 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:38.419+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:38.703 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:38.699+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:38.843 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:38.839+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:38.983 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:38.981+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:39.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:39.226+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:39.315 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:39.311+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:39.395 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:39.390+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:39.707 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:39.704+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:39.830 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:39.826+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:40.009 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:40.005+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:40.202 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:40.198+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:40.316 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:40.312+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:40.367 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:40.363+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:40.669 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:40.665+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:40.863 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:40.859+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:41.002 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:40.998+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:41.225 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:41.217+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:41.309 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:41.300+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:41.399 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:41.396+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:41.714 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:41.709+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:41.868 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:41.864+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:41.981 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:41.977+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:42.252 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:42.248+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:42.343 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:42.338+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:42.364 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:42.361+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:42.692 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:42.688+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:42.871 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:42.867+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:42.984 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:42.981+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:43.275 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:43.273+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:43.376 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:43.373+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:43.412 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:43.408+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:43.693 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:43.681+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:43.857 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:43.853+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:43.941 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:43.937+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:44.302 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:44.299+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:44.363 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:44.360+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:44.421 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:44.414+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:44.693 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:44.689+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:44.877 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:44.873+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:44.916 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:44.913+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:45.302 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:45.299+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:45.333 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:45.329+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:45.385 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:45.382+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:45.733 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:45.730+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:45.841 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:45.838+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:45.969 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:45.967+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:46.260 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:46.257+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:46.306 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:46.302+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:46.345 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:46.342+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:46.719 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:46.715+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:46.810 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:46.807+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:47.005 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:47.001+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:47.278 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:47.271+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:47.299 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:47.295+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:47.397 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:47.393+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:47.764 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:47.761+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:47.834 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:47.831+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:47.960 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:47.957+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:48.281 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:48.276+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:48.286 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:48.280+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:48.392 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:48.385+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:48.752 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:48.743+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:48.805 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:48.801+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:49.007 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:49.004+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:49.236 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:49.232+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:49.241 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:49.238+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:49.443 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:49.440+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:49.737 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:49.732+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:49.783 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:49.779+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:50.024 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:50.021+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:50.220 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:50.217+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:50.241 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:50.237+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:50.488 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:50.484+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:50.765 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:50.762+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:50.808 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:50.804+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:51.006 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:51.003+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:51.251 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:51.247+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:51.276 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:51.272+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:51.539 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:51.535+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:51.779 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:51.775+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:51.818 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:51.814+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:52.011 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:52.007+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:52.237 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:52.234+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:52.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:52.259+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:52.505 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:52.499+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:52.817 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:52.814+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:52.841 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:52.837+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:52.977 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:52.973+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:53.225 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:53.221+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:53.250 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:53.246+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:53.534 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:53.530+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:53.867 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:53.862+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:53.870 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:53.865+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:53.973 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:53.968+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:54.209 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:54.204+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:54.216 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:54.212+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:54.496 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:54.492+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:54.825 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:54.817+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:54.875 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:54.872+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:54.949 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:54.945+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:55.181 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:55.177+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:55.208 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:55.204+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:55.538 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:55.533+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:55.834 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:55.830+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:55.876 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:55.872+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:56.003 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:55.998+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:56.144 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:56.139+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:56.203 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:56.198+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:56.582 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:56.578+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:56.813 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:56.810+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:56.917 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:56.913+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:56.984 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:56.979+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:57.134 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:57.127+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:57.219 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:57.216+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:57.575 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:57.570+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:57.847 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:57.841+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:57.965 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:57.959+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:58.031 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:58.026+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:58.158 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:58.152+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:58.261 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:58.258+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:58.612 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:58.607+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:58.885 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:58.880+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:58.924 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:58.918+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:01:59.032 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:01:59.025+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:01:59.180 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:01:59.174+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:01:59.234 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:01:59.230+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:01:59.658 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:01:59.654+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:01:59.871 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:01:59.867+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:01:59.899 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:01:59.895+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:00.080 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:00.076+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:00.223 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:00.220+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:00.281 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:00.277+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:00.686 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:00.682+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:00.829 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:00.824+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:00.873 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:00.869+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:01.086 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:01.082+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:01.223 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:01.218+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:01.306 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:01.302+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:01.647 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:01.644+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:01.857 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:01.853+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:01.867 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:01.862+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:02.056 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:02.050+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:02.270 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:02.262+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:02.325 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:02.321+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:02.696 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:02.693+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:02.841 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:02.838+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:02.869 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:02.864+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:03.096 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:03.091+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:03.270 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:03.266+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:03.373 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:03.367+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:03.732 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:03.726+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:03.873 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:03.869+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:03.875 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:03.872+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:04.074 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:04.069+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:04.309 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:04.302+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:04.314 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:02:04.311+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e934 v934) 2019-12-09T22:02:04.379 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:04.375+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:04.737 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:04.732+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:04.861 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:04.856+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:04.911 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:04.906+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:05.105 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:05.099+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:05.334 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:05.331+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:05.339 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:05.334+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:05.767 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:05.763+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:05.886 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:05.883+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:05.934 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:05.928+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:06.128 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:06.122+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:06.341 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:06.338+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:06.351 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:06.347+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:06.770 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:06.766+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:06.876 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:06.867+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:06.954 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:06.950+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:07.112 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:07.107+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:07.341 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:07.336+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:07.396 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:07.393+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:07.809 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:07.806+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:07.929 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:07.919+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:07.935 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:07.931+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:08.090 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:08.085+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:08.301 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:08.297+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:08.407 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:08.402+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:08.838 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:08.834+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:08.942 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:08.939+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:08.945 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:08.941+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:09.071 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:09.067+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:09.304 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:09.300+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:09.326 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:02:09.323+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e934 v934) 2019-12-09T22:02:09.416 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:09.413+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:09.813 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:09.809+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:09.907 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:09.902+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:09.976 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:09.972+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:10.073 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:10.068+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:10.301 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:10.295+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:10.468 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:10.465+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:10.772 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:10.768+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:10.885 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:10.881+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:11.005 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:11.001+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:11.113 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:11.108+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:11.282 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:11.278+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:11.493 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:11.486+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:11.730 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:11.726+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:11.873 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:11.869+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:12.034 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:12.030+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:12.090 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:12.086+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:12.296 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:12.291+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:12.520 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:12.516+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:12.783 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:12.780+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:12.888 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:12.884+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:13.078 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:13.074+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:13.082 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:13.078+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:13.272 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:13.268+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:13.531 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:02:13.527+0000 1694f700 -1 osd.4 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.996553+0000 front 2019-12-09T22:00:46.981354+0000 (oldest deadline 2019-12-09T22:01:32.239453+0000) 2019-12-09T22:02:13.747 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:02:13.743+0000 1694f700 -1 osd.7 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:44.622436+0000 front 2019-12-09T22:00:44.231061+0000 (oldest deadline 2019-12-09T22:01:30.108903+0000) 2019-12-09T22:02:13.891 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:02:13.887+0000 1694f700 -1 osd.5 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.366951+0000 front 2019-12-09T22:00:47.340657+0000 (oldest deadline 2019-12-09T22:01:30.572284+0000) 2019-12-09T22:02:14.047 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:02:14.044+0000 1694f700 -1 osd.1 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:47.379585+0000 front 2019-12-09T22:00:47.353177+0000 (oldest deadline 2019-12-09T22:01:32.018222+0000) 2019-12-09T22:02:14.133 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:02:14.130+0000 1694f700 -1 osd.2 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:46.126438+0000 front 2019-12-09T22:00:46.233727+0000 (oldest deadline 2019-12-09T22:01:30.802060+0000) 2019-12-09T22:02:14.288 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:02:14.285+0000 1694f700 -1 osd.3 934 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:00:41.489437+0000 front 2019-12-09T22:00:41.480227+0000 (oldest deadline 2019-12-09T22:01:32.064347+0000) 2019-12-09T22:02:14.396 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:02:14.394+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e934 v934) 2019-12-09T22:04:03.434 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:03.431+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:03.688 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:03.684+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:04.427 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:04.421+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:04.668 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:04.665+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:04.739 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:04.734+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:05.395 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:05.391+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:05.690 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:05.686+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:05.765 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:05.760+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:05.942 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:05.937+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:06.397 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:06.393+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:06.703 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:06.699+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:06.730 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:06.726+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:06.745 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:06.736+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:06.968 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:06.964+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:07.255 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:07.251+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:07.362 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:07.358+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:07.657 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:07.653+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:07.711 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:07.708+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:07.787 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:07.783+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:08.013 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:08.009+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:08.218 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:08.214+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:08.407 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:08.403+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:08.674 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:08.668+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:08.728 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:08.722+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:08.743 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:08.739+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:09.024 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:09.019+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:09.213 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:09.209+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:09.396 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:09.392+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:09.707 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:09.697+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:09.711 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:09.707+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:09.749 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:09.743+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:09.989 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:09.984+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:10.261 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:10.257+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:10.359 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:58:31.418 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:04:10.369 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:58:31.428 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:04:10.382 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:58:31.434 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:04:10.387 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:58:31.444 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:04:10.391 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:58:31.428 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:04:10.404 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:58:31.440 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:04:10.405 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:10.401+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:10.605 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:10:58:31.664 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:04:10.666 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:10:58:31.725 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:04:10.684 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:10.681+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:10.686 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:10:58:31.722 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:04:10.751 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:10.748+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:10.763 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:10.758+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:10.990 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:10.986+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:11.285 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:11.282+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:11.423 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:11.418+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:11.709 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:11.706+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:11.749 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:11.741+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:11.803 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:11.798+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:11.988 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:11.984+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:12.318 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:12.315+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:12.395 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:12.391+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:12.717 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:12.713+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:12.770 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:12.766+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:12.794 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:12.790+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:13.011 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:13.008+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:13.286 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:13.282+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:13.415 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:13.411+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:13.727 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:13.722+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:13.733 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:13.730+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:13.830 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:13.825+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:14.063 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:14.058+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:14.266 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:14.261+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:14.392 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:14.386+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:14.749 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:14.743+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:14.754 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:14.751+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:14.845 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:14.841+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:15.109 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:15.104+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:15.316 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:15.312+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:15.397 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:15.393+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:15.741 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:15.736+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:15.799 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:15.795+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:15.872 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:15.862+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:16.147 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:16.143+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:16.326 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:16.316+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:16.379 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:16.366+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:16.779 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:16.775+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:16.832 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:16.829+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:16.866 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:16.862+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:17.193 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:17.188+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:17.333 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:17.326+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:17.377 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:17.368+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:17.787 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:17.783+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:17.806 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:17.802+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:17.918 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:17.912+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:18.153 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:18.148+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:18.356 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:18.353+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:18.358 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:18.354+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:18.769 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:18.764+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:18.836 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:18.832+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:18.905 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:18.901+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:19.161 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:19.156+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:19.365 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:19.351+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:19.401 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:19.397+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:19.740 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:19.736+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:19.808 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:19.803+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:19.934 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:19.927+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:20.167 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:20.162+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:20.315 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:20.311+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:20.438 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:20.435+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:20.766 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:20.761+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:20.844 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:20.839+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:20.926 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:20.922+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:21.189 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:21.183+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:21.293 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:21.289+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:21.431 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:21.425+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:21.723 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:21.719+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:21.881 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:21.878+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:21.887 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:21.884+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:22.156 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:22.152+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:22.306 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:22.301+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:22.471 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:22.467+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:22.764 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:22.760+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:22.850 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:22.845+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:22.898 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:22.895+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:23.180 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:23.173+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:23.359 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:23.355+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:23.444 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:23.440+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:23.813 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:23.810+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:23.816 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:23.813+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:23.925 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:23.919+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:24.141 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:24.136+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:24.405 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:24.402+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:24.465 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:24.461+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:24.769 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:24.765+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:24.856 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:24.850+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:24.890 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:24.887+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:25.186 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:25.182+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:25.388 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:25.384+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:25.439 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:25.436+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:25.791 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:25.787+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:25.845 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:25.842+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:25.869 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:25.866+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:26.224 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:26.220+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:26.402 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:26.399+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:26.467 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:26.462+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:26.808 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:26.804+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:26.836 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:26.833+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:26.847 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:26.845+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:27.219 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:27.214+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:27.375 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:27.370+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:27.432 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:27.426+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:27.768 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:27.764+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:27.814 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:27.810+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:27.834 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:27.830+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:28.191 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:28.187+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:28.353 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:28.349+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:28.474 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:28.471+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:28.776 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:28.772+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:28.791 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:28.788+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:28.882 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:28.880+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:29.193 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:29.189+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:29.349 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:29.345+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:29.442 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:29.437+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:29.739 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:29.736+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:29.757 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:29.750+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:29.898 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:29.895+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:30.236 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:30.232+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:30.396 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:30.392+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:30.453 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:30.448+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:30.712 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:30.709+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:30.794 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:30.789+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:30.868 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:30.864+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:31.263 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:31.257+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:31.364 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:31.361+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:31.477 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:31.474+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:31.702 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:31.697+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:31.757 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:31.753+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:31.856 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:31.852+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:32.307 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:32.303+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:32.393 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:32.389+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:32.492 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:32.488+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:32.722 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:32.717+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:32.797 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:32.794+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:32.895 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:32.892+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:33.343 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:33.340+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:33.378 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:33.374+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:33.471 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:33.467+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:33.694 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:33.690+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:33.852 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:33.848+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:33.912 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:33.908+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:34.306 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:34.302+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:34.371 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:34.367+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:34.452 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:34.448+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:34.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:34.702+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:34.823 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:34.820+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:34.853 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:04:34.845+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e942 v942) 2019-12-09T22:04:34.878 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:34.874+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:35.274 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:35.268+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:35.381 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:35.378+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:35.484 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:35.481+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:35.722 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:35.718+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:35.870 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:35.866+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:35.893 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:35.888+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:36.237 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:36.232+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:36.434 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:36.431+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:36.460 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:36.455+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:36.734 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:36.728+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:36.825 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:36.822+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:36.924 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:36.919+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:37.201 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:37.197+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:37.472 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:37.468+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:37.513 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:37.509+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:37.766 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:37.761+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:37.873 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:37.869+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:37.913 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:37.909+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:38.186 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:38.182+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:38.484 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:38.480+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:38.495 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:38.485+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:38.780 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:38.777+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:38.899 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:38.895+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:38.925 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:38.922+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:39.196 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:39.192+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:39.497 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:39.493+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:39.500 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:39.496+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:39.829 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:39.822+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:39.859 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:04:39.856+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e942 v942) 2019-12-09T22:04:39.900 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:39.895+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:39.984 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:39.969+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:40.206 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:40.203+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:40.491 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:40.485+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:40.504 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:40.499+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:40.803 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:40.800+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:40.889 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:40.884+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:40.996 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:40.993+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:41.169 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:41.165+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:41.515 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:41.510+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:41.523 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:41.519+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:41.784 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:41.781+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:41.863 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:41.858+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:41.970 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:41.967+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:42.137 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:42.133+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:42.549 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:42.538+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:42.564 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:42.560+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:42.747 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:42.742+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:42.845 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:42.842+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:42.936 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:42.932+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:43.152 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:43.146+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:43.571 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:43.562+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:43.598 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:43.593+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:43.781 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:43.774+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:43.897 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:43.894+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:43.900 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:43.896+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:44.122 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:44.119+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:04:44.536 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:04:44.532+0000 1694f700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.931832+0000 front 2019-12-09T22:03:21.081474+0000 (oldest deadline 2019-12-09T22:04:06.211242+0000) 2019-12-09T22:04:44.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:04:44.572+0000 1694f700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:19.678217+0000 front 2019-12-09T22:03:19.802300+0000 (oldest deadline 2019-12-09T22:04:03.152192+0000) 2019-12-09T22:04:44.797 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:04:44.790+0000 1694f700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:21.192692+0000 front 2019-12-09T22:03:21.483994+0000 (oldest deadline 2019-12-09T22:04:02.795802+0000) 2019-12-09T22:04:44.895 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:04:44.892+0000 1694f700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.743253+0000 front 2019-12-09T22:03:20.471261+0000 (oldest deadline 2019-12-09T22:04:03.961127+0000) 2019-12-09T22:04:44.901 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:04:44.897+0000 1694f700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.922683+0000 front 2019-12-09T22:03:20.926441+0000 (oldest deadline 2019-12-09T22:04:06.106403+0000) 2019-12-09T22:04:44.981 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:04:44.972+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e942 v942) 2019-12-09T22:04:45.110 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:04:45.106+0000 1694f700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:03:20.213141+0000 front 2019-12-09T22:03:20.211822+0000 (oldest deadline 2019-12-09T22:04:05.489070+0000) 2019-12-09T22:05:31.739 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:05:31.679+0000 31786700 -1 osd.4 947 build_incremental_map_msg missing incremental map 947 2019-12-09T22:05:31.822 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:05:31.748+0000 34f8d700 -1 osd.4 947 build_incremental_map_msg missing incremental map 947 2019-12-09T22:05:32.105 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:05:32.022+0000 3378a700 -1 osd.4 947 build_incremental_map_msg missing incremental map 947 2019-12-09T22:05:32.156 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:05:32.036+0000 33f8b700 -1 osd.4 947 build_incremental_map_msg missing incremental map 947 2019-12-09T22:05:32.223 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:05:32.107+0000 3478c700 -1 osd.4 947 build_incremental_map_msg missing incremental map 947 2019-12-09T22:05:34.785 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:05:34.772+0000 124b0700 -1 osd.0 949 build_incremental_map_msg missing incremental map 949 2019-12-09T22:05:34.802 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:05:34.797+0000 3578e700 -1 osd.0 949 build_incremental_map_msg missing incremental map 949 2019-12-09T22:05:34.814 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:05:34.806+0000 31786700 -1 osd.0 949 build_incremental_map_msg missing incremental map 949 2019-12-09T22:05:34.945 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:05:34.863+0000 32f89700 -1 osd.0 949 build_incremental_map_msg missing incremental map 949 2019-12-09T22:05:35.255 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:05:35.047+0000 3578e700 -1 osd.0 949 build_incremental_map_msg missing incremental map 949 2019-12-09T22:05:35.297 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:05:35.150+0000 38f95700 -1 osd.0 949 build_incremental_map_msg missing incremental map 949 2019-12-09T22:05:35.308 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:05:35.178+0000 31f87700 -1 osd.0 949 build_incremental_map_msg missing incremental map 949 2019-12-09T22:05:38.277 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:05:38.119+0000 38f95700 -1 osd.0 950 build_incremental_map_msg missing incremental map 949 2019-12-09T22:05:38.277 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:05:38.121+0000 38f95700 -1 osd.0 950 build_incremental_map_msg missing incremental map 949 2019-12-09T22:06:35.290 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:35.286+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:35.764 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:35.761+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:36.340 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:36.336+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:36.488 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:36.483+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:36.583 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:36.578+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:36.809 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:36.806+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:37.299 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:37.295+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:37.365 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:37.362+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:37.476 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:37.471+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:37.638 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:37.630+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:37.685 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:37.681+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:37.849 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:37.846+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:38.285 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:38.282+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:38.324 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:38.321+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:38.521 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:38.518+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:38.616 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:38.613+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:38.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:38.701+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:38.838 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:38.835+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:39.252 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:39.249+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:39.355 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:39.351+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:39.557 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:39.554+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:39.632 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:39.629+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:39.734 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:39.732+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:39.794 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:39.792+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:40.224 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:40.212+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:40.319 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:40.315+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:40.611 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:40.607+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:40.636 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:40.632+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:40.734 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:40.731+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:40.765 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:40.760+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:41.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:41.221+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:41.315 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:41.310+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:41.589 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:41.585+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:41.676 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:41.672+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:41.712 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:41.708+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:41.724 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:41.721+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:42.269 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:42.262+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:42.278 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:42.275+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:42.577 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:42.573+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:42.669 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:42.664+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:42.672 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:42.667+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:42.744 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:42.740+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:43.240 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:43.237+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:43.251 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:43.247+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:43.585 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:43.581+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:43.694 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:43.688+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:43.701 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:43.693+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:43.716 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:43.712+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:44.273 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:44.269+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:44.276 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:44.272+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:44.576 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:44.572+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:44.677 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:44.673+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:44.679 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:44.676+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:44.697 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:44.693+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:45.229 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:45.225+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:45.265 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:45.260+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:45.587 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:45.584+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:45.643 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:45.639+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:45.655 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:45.650+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:45.699 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:45.696+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:46.251 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:46.246+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:46.292 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:46.288+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:46.637 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:46.630+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:46.637 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:46.632+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:46.680 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:46.677+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:46.699 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:46.695+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:47.218 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:47.215+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:47.274 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:47.268+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:47.623 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:47.618+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:47.648 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:47.636+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:47.704 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:47.701+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:47.719 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:47.717+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:48.225 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:48.222+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:48.265 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:48.262+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:48.647 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:48.644+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:48.669 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:48.664+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:48.685 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:48.682+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:48.712 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:48.709+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:49.223 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:49.219+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:49.224 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:49.220+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:49.667 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:49.662+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:49.696 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:49.693+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:49.720 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:49.716+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:49.728 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:49.724+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:50.246 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:50.242+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:50.259 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:50.256+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:50.688 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:50.683+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:50.697 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:50.694+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:50.698 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:50.693+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:50.718 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:50.715+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:51.242 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:51.237+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:51.283 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:51.279+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:51.683 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:51.680+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:51.683 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:51.679+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:51.705 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:51.700+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:51.723 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:51.719+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:52.256 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:52.252+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:52.268 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:52.264+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:52.669 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:52.665+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:52.673 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:52.667+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:52.699 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:52.695+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:52.751 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:52.748+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:53.236 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:53.226+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:53.243 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:53.240+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:53.661 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:53.656+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:53.685 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:53.683+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:53.717 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:53.714+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:53.744 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:53.740+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:54.229 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:54.226+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:54.232 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:54.228+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:54.641 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:54.637+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:54.685 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:54.680+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:54.697 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:54.690+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:54.704 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:54.701+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:55.197 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:55.194+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:55.271 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:55.268+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:55.645 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:55.638+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:55.668 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:55.660+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:55.675 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:55.666+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:55.710 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:55.699+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:56.229 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:56.225+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:56.310 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:56.306+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:56.640 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:56.636+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:56.649 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:56.646+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:56.661 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:56.658+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:56.756 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:56.752+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:57.225 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:57.222+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:57.352 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:57.349+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:57.671 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:57.668+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:57.672 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:57.669+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:57.685 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:57.682+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:57.788 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:57.785+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:58.197 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:58.193+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:58.319 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:58.314+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:58.629 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:58.625+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:58.640 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:58.636+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:58.669 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:58.665+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:58.776 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:58.771+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:06:59.168 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:06:59.161+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:06:59.285 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:06:59.280+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:06:59.593 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:06:59.591+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:06:59.601 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:06:59.598+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:06:59.636 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:06:59.633+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:06:59.746 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:06:59.742+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:00.134 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:00.128+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:00.253 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:00.249+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:00.600 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:00.597+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:00.630 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:00.626+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:00.679 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:00.675+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:00.730 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:00.726+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:01.095 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:01.090+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:01.243 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:01.239+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:01.567 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:01.563+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:01.664 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:01.661+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:01.716 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:01.714+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:01.773 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:01.770+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:02.137 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:02.129+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:02.257 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:02.253+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:02.559 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:02.550+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:02.658 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:02.655+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:02.753 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:02.750+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:02.763 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:02.759+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:03.097 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:03.093+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:03.307 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:03.303+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:03.594 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:03.591+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:03.634 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:03.631+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:03.720 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:03.717+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:03.755 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:03.751+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:04.062 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:04.058+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:04.296 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:04.291+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:04.592 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:04.588+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:04.642 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:04.638+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:04.729 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:04.727+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:04.751 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:04.748+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:05.028 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:05.023+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:05.342 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:05.339+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:05.630 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:05.627+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:05.641 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:05.638+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:05.739 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:05.735+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:05.779 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:05.773+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:06.052 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:06.049+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:06.337 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:06.329+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:06.602 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:06.599+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:06.630 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:06.628+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:06.737 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:06.733+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:06.738 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:06.735+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:07.042 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:07.039+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:07.287 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:07.283+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:07.601 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:07.597+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:07.617 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:07.614+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:07.729 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:07.725+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:07.734 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:07.729+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:08.021 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:08.017+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:08.262 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:08.258+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:08.613 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:08.609+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:08.637 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:08.632+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:08.705 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:08.702+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:08.746 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:08.741+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:09.023 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:09.007+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:09.219 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:09.214+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:09.607 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:09.603+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:09.653 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:09.648+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:09.753 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:09.748+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:09.770 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:09.766+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:10.000 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:09.996+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:10.246 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:10.237+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:10.518 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:07:10.516+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e951 v951) 2019-12-09T22:07:10.633 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:10.629+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:10.651 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:10.646+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:10.742 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:10.736+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:10.771 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:10.765+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:11.057 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:11.053+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:11.236 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:11.232+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:11.591 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:11.585+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:11.689 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:11.685+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:11.732 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:11.729+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:11.790 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:11.786+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:12.079 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:12.076+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:12.274 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:12.270+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:12.570 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:12.564+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:12.698 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:12.694+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:12.735 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:12.731+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:12.829 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:12.824+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:13.133 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:13.128+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:13.306 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:13.302+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:13.557 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:13.553+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:13.697 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:13.694+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:13.789 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:13.782+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:13.823 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:13.816+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:14.128 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:14.124+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:14.310 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:14.302+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:14.539 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:14.534+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:14.722 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:14.718+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:14.823 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:14.819+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:14.825 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:14.822+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:15.165 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:15.160+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:15.336 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:15.331+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:15.528 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:07:15.525+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e951 v951) 2019-12-09T22:07:15.528 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:15.524+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:15.772 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:15.768+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:15.786 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:15.781+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:15.854 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:15.850+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:16.181 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:16.176+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:16.319 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:16.315+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:16.502 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:16.497+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:16.749 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:16.745+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:16.786 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:16.781+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:16.866 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:16.862+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:17.215 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:17.211+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:17.311 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:17.307+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:17.486 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:17.480+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:17.752 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:17.748+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:17.801 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:17.790+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:17.898 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:17.895+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:18.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:18.206+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:18.286 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:18.282+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:18.502 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:18.496+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:18.751 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:18.746+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:18.835 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:18.831+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:18.940 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:18.934+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:19.187 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:19.182+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:19.271 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:19.268+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:19.460 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:19.455+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:19.795 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:07:19.790+0000 1694f700 -1 osd.1 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:52.388640+0000 front 2019-12-09T22:05:52.720032+0000 (oldest deadline 2019-12-09T22:06:37.664216+0000) 2019-12-09T22:07:19.859 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:07:19.855+0000 1694f700 -1 osd.4 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.790198+0000 front 2019-12-09T22:05:50.793429+0000 (oldest deadline 2019-12-09T22:06:36.318629+0000) 2019-12-09T22:07:19.966 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:07:19.961+0000 1694f700 -1 osd.3 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.291757+0000 front 2019-12-09T22:05:50.075473+0000 (oldest deadline 2019-12-09T22:06:35.344338+0000) 2019-12-09T22:07:20.157 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:07:20.153+0000 1694f700 -1 osd.5 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:50.794580+0000 front 2019-12-09T22:05:50.796225+0000 (oldest deadline 2019-12-09T22:06:35.257366+0000) 2019-12-09T22:07:20.286 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:07:20.280+0000 1694f700 -1 osd.7 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:54.220281+0000 front 2019-12-09T22:05:53.890251+0000 (oldest deadline 2019-12-09T22:06:36.762074+0000) 2019-12-09T22:07:20.480 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:07:20.475+0000 1694f700 -1 osd.2 951 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:05:53.246888+0000 front 2019-12-09T22:05:53.207252+0000 (oldest deadline 2019-12-09T22:06:36.044997+0000) 2019-12-09T22:07:20.586 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:07:20.581+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e951 v951) 2019-12-09T22:08:05.869 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:02:26.928 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:05.897 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:02:26.956 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:05.926 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:02:26.962 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:05.930 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:02:26.967 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:05.933 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:02:26.993 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:05.936 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:02:26.996 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:06.143 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:02:27.180 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:06.145 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:02:27.204 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:06.227 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:02:27.279 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:12.060 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:02:33.119 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:12.069 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:02:33.128 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:12.074 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:02:33.134 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:12.081 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:02:33.116 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:12.081 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:02:33.139 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:12.085 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:02:33.121 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:12.104 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:02:33.163 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:12.125 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:02:33.182 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:08:12.156 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:02:33.191 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:09:10.665 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:10.661+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:11.678 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:11.675+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:12.376 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:12.371+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:12.688 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:12.683+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:13.373 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:13.368+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:13.728 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:13.725+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:14.196 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:14.192+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:14.413 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:14.410+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:14.693 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:14.689+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:14.768 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:14.764+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:14.783 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:14.780+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:14.812 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:14.808+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:15.211 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:15.206+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:15.440 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:15.436+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:15.724 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:15.717+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:15.776 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:15.768+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:15.807 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:15.804+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:15.824 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:15.820+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:16.177 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:16.170+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:16.489 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:16.487+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:16.733 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:16.729+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:16.767 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:16.764+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:16.812 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:16.808+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:16.821 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:16.817+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:17.216 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:17.212+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:17.526 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:17.522+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:17.745 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:17.741+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:17.782 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:17.778+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:17.790 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:17.786+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:17.835 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:17.832+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:18.186 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:18.182+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:18.485 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:18.480+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:18.791 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:18.785+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:18.820 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:18.813+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:18.830 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:18.826+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:18.863 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:18.859+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:19.178 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:19.174+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:19.443 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:19.439+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:19.744 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:19.740+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:19.808 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:19.802+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:19.822 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:19.819+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:19.868 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:19.864+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:20.222 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:20.218+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:20.415 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:20.409+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:20.705 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:20.700+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:20.824 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:20.820+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:20.826 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:20.822+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:20.877 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:20.873+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:21.249 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:21.245+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:21.435 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:21.431+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:21.708 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:21.703+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:21.807 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:21.802+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:21.826 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:21.822+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:21.918 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:21.910+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:22.229 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:22.225+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:22.430 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:22.425+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:22.764 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:22.755+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:22.782 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:22.776+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:22.811 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:22.799+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:22.885 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:22.880+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:23.217 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:23.213+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:23.469 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:23.464+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:23.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:23.717+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:23.787 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:23.781+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:23.843 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:23.839+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:23.938 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:23.934+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:24.275 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:24.270+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:24.434 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:24.429+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:24.687 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:24.677+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:24.742 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:24.738+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:24.802 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:24.799+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:24.986 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:24.981+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:25.278 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:25.274+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:25.413 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:25.408+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:25.712 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:25.710+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:25.771 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:25.766+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:25.829 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:25.823+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:26.041 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:26.036+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:26.299 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:26.296+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:26.425 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:09:26.421+0000 1694f700 -1 osd.2 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.135243+0000 front 2019-12-09T22:08:29.320736+0000 (oldest deadline 2019-12-09T22:09:12.021211+0000) 2019-12-09T22:09:26.726 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:26.721+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:26.755 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:26.750+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:26.788 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:26.780+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:27.080 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:27.074+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:27.353 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:27.349+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:27.728 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:27.724+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:27.744 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:27.740+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:27.809 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:27.805+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:28.054 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:28.049+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:28.391 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:28.386+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:28.688 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:28.684+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:28.736 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:28.729+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:28.859 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:28.830+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:29.052 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:29.048+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:29.347 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:29.343+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:29.734 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:29.731+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:29.742 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:29.736+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:29.886 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:29.882+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:30.018 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:30.014+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:30.379 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:30.375+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:30.687 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:30.684+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:30.742 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:30.738+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:30.862 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:30.857+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:30.988 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:30.984+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:31.337 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:31.334+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:31.661 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:31.650+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:31.793 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:31.789+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:31.868 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:31.864+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:31.983 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:31.977+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:32.308 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:32.302+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:32.667 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:32.661+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:32.833 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:32.829+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:32.867 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:32.862+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:33.028 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:33.021+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:33.279 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:33.275+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:33.704 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:33.700+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:33.855 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:33.851+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:33.870 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:33.866+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:34.069 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:34.064+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:34.242 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:34.238+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:34.706 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:34.702+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:34.892 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:34.888+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:34.895 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:34.891+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:35.041 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:35.037+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:35.281 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:35.278+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:35.740 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:35.734+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:35.859 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:35.855+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:35.897 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:35.893+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:36.034 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:36.028+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:36.285 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:36.281+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:36.759 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:36.752+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:36.840 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:36.836+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:36.898 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:36.894+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:37.077 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:37.074+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:37.274 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:37.271+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:37.728 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:37.721+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:37.826 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:37.822+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:37.861 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:37.853+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:38.053 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:38.048+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:38.311 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:38.307+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:38.776 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:38.771+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:38.789 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:38.784+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:38.853 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:38.849+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:39.025 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:39.018+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:39.311 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:39.307+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:39.736 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:39.730+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:39.817 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:39.811+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:39.842 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:39.836+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:40.055 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:40.051+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:40.312 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:40.308+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:40.706 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:40.701+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:40.792 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:40.788+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:40.797 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:40.793+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:41.028 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:41.024+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:41.328 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:41.324+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:41.735 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:41.728+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:41.786 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:41.783+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:41.810 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:41.806+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:42.024 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:42.020+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:42.287 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:42.285+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:42.766 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:42.763+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:42.809 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:42.802+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:42.860 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:42.856+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:42.999 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:42.993+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:43.267 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:43.264+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:43.772 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:43.769+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:43.829 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:43.824+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:43.884 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:43.880+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:43.956 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:43.952+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:44.267 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:44.262+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:44.751 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:44.746+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:44.860 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:44.853+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:44.882 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:44.877+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:44.931 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:44.927+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:45.241 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:45.238+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:45.759 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:45.752+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:45.835 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:45.831+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:45.840 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:45.835+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:45.948 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:45.946+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:46.118 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:09:46.115+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e958 v958) 2019-12-09T22:09:46.257 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:46.252+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:46.800 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:46.795+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:46.802 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:46.798+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:46.856 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:46.851+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:46.971 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:46.968+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:47.251 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:47.248+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:47.759 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:47.755+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:47.823 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:47.809+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:47.824 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:47.813+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:47.995 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:47.991+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:48.219 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:48.215+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:48.788 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:48.785+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:48.790 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:48.786+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:48.832 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:48.828+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:49.020 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:49.014+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:49.177 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:49.173+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:49.827 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:49.821+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:49.836 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:49.833+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:49.876 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:49.872+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:49.977 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:49.974+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:50.149 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:50.145+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:50.786 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:50.782+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:50.820 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:50.816+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:50.885 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:50.881+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:50.981 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:50.977+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:51.133 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:09:51.131+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e958 v958) 2019-12-09T22:09:51.187 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:51.179+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:51.786 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:51.781+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:51.789 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:51.786+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:51.942 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:51.935+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:51.942 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:51.937+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:52.216 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:52.212+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:52.765 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:52.761+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:52.836 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:52.832+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:52.980 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:52.976+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:52.994 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:52.990+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:53.262 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:53.257+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:53.745 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:53.740+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:53.856 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:53.852+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:53.983 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:53.979+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:54.020 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:54.016+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:54.309 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:54.305+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:54.792 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:54.788+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:54.880 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:54.874+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:54.993 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:54.990+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:55.022 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:55.018+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:55.346 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:09:55.343+0000 1694f700 -1 osd.7 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:27.634889+0000 front 2019-12-09T22:08:27.623660+0000 (oldest deadline 2019-12-09T22:09:13.496192+0000) 2019-12-09T22:09:55.773 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:09:55.764+0000 1694f700 -1 osd.1 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.864249+0000 front 2019-12-09T22:08:28.865650+0000 (oldest deadline 2019-12-09T22:09:14.730470+0000) 2019-12-09T22:09:55.910 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:09:55.906+0000 1694f700 -1 osd.5 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:28.778669+0000 front 2019-12-09T22:08:28.771204+0000 (oldest deadline 2019-12-09T22:09:14.054554+0000) 2019-12-09T22:09:56.014 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:09:56.010+0000 1694f700 -1 osd.3 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:29.345363+0000 front 2019-12-09T22:08:29.768183+0000 (oldest deadline 2019-12-09T22:09:14.002111+0000) 2019-12-09T22:09:56.023 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:09:56.020+0000 1694f700 -1 osd.4 958 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:08:25.951785+0000 front 2019-12-09T22:08:25.967710+0000 (oldest deadline 2019-12-09T22:09:10.087516+0000) 2019-12-09T22:09:56.220 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:09:56.213+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e958 v958) 2019-12-09T22:10:35.351 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:10:35.335+0000 31786700 -1 osd.2 962 build_incremental_map_msg missing incremental map 962 2019-12-09T22:10:35.422 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:10:35.414+0000 30f85700 -1 osd.4 962 build_incremental_map_msg missing incremental map 962 2019-12-09T22:10:35.482 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:10:35.344+0000 31786700 -1 osd.2 962 build_incremental_map_msg missing incremental map 962 2019-12-09T22:10:35.604 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:10:35.401+0000 36f91700 -1 osd.2 962 build_incremental_map_msg missing incremental map 962 2019-12-09T22:10:35.719 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:10:35.520+0000 35f8f700 -1 osd.2 962 build_incremental_map_msg missing incremental map 962 2019-12-09T22:10:35.806 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:10:35.590+0000 34f8d700 -1 osd.2 962 build_incremental_map_msg missing incremental map 962 2019-12-09T22:10:35.820 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:10:35.560+0000 3378a700 -1 osd.4 962 build_incremental_map_msg missing incremental map 962 2019-12-09T22:10:35.857 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:10:35.584+0000 3378a700 -1 osd.4 962 build_incremental_map_msg missing incremental map 962 2019-12-09T22:10:35.955 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:10:35.827+0000 3478c700 -1 osd.4 962 build_incremental_map_msg missing incremental map 962 2019-12-09T22:11:38.991 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:38.986+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:39.316 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:39.312+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:39.891 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:39.887+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:39.986 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:39.983+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:40.285 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:40.280+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:40.396 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:40.393+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:40.726 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:40.723+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:40.890 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:40.884+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:40.954 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:40.949+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:40.960 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:40.955+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:41.276 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:41.267+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:41.444 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:41.439+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:41.723 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:41.718+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:41.874 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:41.871+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:41.960 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:41.955+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:42.008 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:42.004+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:42.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:42.226+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:42.483 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:42.477+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:42.680 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:42.676+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:42.835 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:42.832+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:42.955 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:42.950+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:43.013 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:43.008+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:43.210 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:43.207+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:43.531 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:43.528+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:43.697 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:43.693+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:43.817 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:43.812+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:43.996 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:43.992+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:44.007 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:44.002+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:44.222 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:44.217+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:44.494 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:44.490+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:44.744 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:44.740+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:44.780 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:44.777+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:44.976 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:44.972+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:45.002 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:44.996+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:45.181 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:45.175+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:45.454 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:45.448+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:45.769 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:45.765+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:45.797 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:45.793+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:46.010 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:46.005+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:46.018 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:46.013+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:46.142 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:46.138+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:46.487 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:46.477+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:46.766 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:46.762+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:46.789 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:46.786+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:46.976 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:46.972+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:47.002 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:46.998+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:47.190 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:47.186+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:47.530 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:47.526+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:47.771 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:47.767+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:47.801 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:47.798+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:48.003 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:47.999+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:48.015 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:48.010+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:48.181 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:48.176+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:48.520 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:48.514+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:48.766 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:48.762+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:48.813 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:48.803+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:49.004 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:49.000+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:49.013 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:49.009+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:49.141 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:49.137+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:49.515 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:49.510+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:49.729 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:49.725+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:49.850 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:49.846+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:49.977 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:49.973+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:50.035 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:50.031+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:50.123 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:50.119+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:50.516 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:50.513+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:50.711 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:50.707+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:50.852 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:50.848+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:50.948 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:50.942+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:51.043 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:51.039+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:51.094 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:51.091+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:51.545 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:51.537+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:51.681 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:51.675+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:51.822 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:51.819+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:51.966 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:51.962+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:52.019 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:52.015+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:52.123 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:52.120+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:52.564 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:52.560+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:52.750 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:52.744+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:52.795 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:52.791+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:53.013 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:53.011+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:53.065 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:53.061+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:53.114 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:53.111+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:53.529 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:53.525+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:53.704 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:53.699+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:53.815 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:53.809+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:54.028 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:54.026+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:54.037 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:54.033+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:54.086 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:54.084+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:54.578 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:54.573+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:54.684 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:54.680+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:54.787 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:54.783+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:55.014 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:55.010+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:55.065 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:55.062+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:55.122 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:55.119+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:55.554 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:55.549+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:55.709 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:55.704+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:55.774 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:55.770+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:55.999 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:55.996+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:56.085 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:56.081+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:56.123 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:56.120+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:56.602 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:56.593+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:56.690 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:56.684+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:56.784 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:56.782+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:57.039 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:57.035+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:57.094 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:57.091+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:57.154 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:57.150+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:57.644 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:57.641+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:57.649 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:57.644+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:57.749 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:57.743+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:58.035 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:58.030+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:58.057 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:58.053+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:58.137 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:58.134+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:58.613 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:58.610+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:58.634 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:58.630+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:58.779 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:58.775+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:11:59.034 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:11:59.030+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:11:59.049 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:11:59.042+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:11:59.179 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:11:59.175+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:11:59.590 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:11:59.586+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:11:59.665 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:11:59.661+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:11:59.820 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:11:59.817+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:00.066 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:00.062+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:00.096 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:00.091+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:00.133 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:00.131+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:00.599 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:00.592+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:00.706 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:00.703+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:00.868 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:00.864+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:01.057 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:01.052+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:01.098 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:01.094+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:01.151 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:01.142+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:01.594 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:01.590+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:01.716 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:01.712+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:01.844 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:01.839+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:02.053 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:02.048+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:02.091 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:02.087+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:02.133 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:02.129+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:02.586 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:02.582+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:02.695 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:02.692+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:02.830 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:02.820+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:03.040 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:03.033+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:03.138 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:03.135+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:03.155 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:03.151+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:03.539 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:03.536+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:03.652 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:03.648+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:03.858 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:03.854+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:04.028 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:04.021+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:04.115 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:04.111+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:04.149 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:04.144+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:04.566 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:04.563+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:04.687 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:04.682+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:04.868 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:04.864+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:04.981 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:04.977+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:05.116 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:05.113+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:05.136 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:05.134+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:05.541 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:05.537+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:05.684 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:05.679+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:05.881 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:05.877+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:05.963 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:05.959+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:06.107 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:06.103+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:06.109 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:06.106+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:06.515 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:06.511+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:06.663 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:06.659+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:06.887 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:06.883+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:06.988 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:06.984+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:07.130 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:07.126+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:07.144 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:07.141+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:07.552 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:07.548+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:07.702 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:07.699+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:07.842 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:07.839+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:07.976 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:07.972+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:08.129 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:08.126+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:08.136 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:08.129+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:08.594 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:08.589+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:08.676 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:08.672+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:08.811 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:08.807+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:08.955 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:08.950+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:09.131 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:09.127+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:09.138 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:09.133+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:09.646 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:09.643+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:09.706 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:09.703+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:09.845 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:09.839+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:09.957 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:09.952+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:10.169 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:10.164+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:10.183 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:10.171+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:10.653 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:10.642+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:10.704 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:10.695+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:10.801 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:10.797+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:10.949 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:10.946+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:11.130 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:11.126+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:11.192 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:11.188+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:11.613 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:11.607+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:11.634 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:12:11.624+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e965 v965) 2019-12-09T22:12:11.699 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:11.695+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:11.793 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:11.789+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:11.984 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:11.981+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:12.128 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:12.123+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:12.237 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:12.233+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:12.575 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:12.571+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:12.749 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:12.745+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:12.820 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:12.812+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:13.003 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:12.999+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:13.177 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:13.175+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:13.200 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:13.197+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:13.628 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:13.624+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:13.753 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:13.749+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:13.817 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:13.813+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:14.038 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:14.035+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:14.179 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:14.174+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:14.232 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:14.228+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:14.652 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:14.647+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:14.782 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:14.780+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:14.867 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:14.864+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:15.067 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:15.063+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:15.172 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:15.168+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:15.273 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:15.270+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:15.668 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:15.664+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:15.777 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:15.773+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:15.861 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:15.858+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:16.084 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:16.080+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:16.184 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:16.181+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:16.261 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:16.252+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:16.636 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:12:16.634+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e965 v965) 2019-12-09T22:12:16.690 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:16.680+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:16.786 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:16.783+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:16.825 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:16.821+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:17.047 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:17.044+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:17.164 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:17.162+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:17.258 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:17.255+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:17.674 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:17.670+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:17.773 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:17.769+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:17.851 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:17.848+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:18.036 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:18.031+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:18.214 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:18.211+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:18.238 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:18.234+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:18.725 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:18.722+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:18.758 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:18.754+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:18.824 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:18.820+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:19.024 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:19.020+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:19.196 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:19.194+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:19.266 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:19.254+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:19.726 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:19.722+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:19.760 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:19.757+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:19.815 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:19.811+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:19.990 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:19.986+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:20.160 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:20.156+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:20.309 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:20.305+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:20.705 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:20.701+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:20.783 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:20.779+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:20.786 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:20.782+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:20.970 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:12:20.966+0000 1694f700 -1 osd.7 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:53.454593+0000 front 2019-12-09T22:10:58.975109+0000 (oldest deadline 2019-12-09T22:11:38.723432+0000) 2019-12-09T22:12:21.128 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:12:21.125+0000 1694f700 -1 osd.1 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:55.296934+0000 front 2019-12-09T22:10:55.145151+0000 (oldest deadline 2019-12-09T22:11:40.213905+0000) 2019-12-09T22:12:21.319 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:12:21.316+0000 1694f700 -1 osd.3 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.408748+0000 front 2019-12-09T22:10:57.245801+0000 (oldest deadline 2019-12-09T22:11:38.927356+0000) 2019-12-09T22:12:21.721 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:12:21.718+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e965 v965) 2019-12-09T22:12:21.728 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:12:21.724+0000 1694f700 -1 osd.4 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:56.800821+0000 front 2019-12-09T22:10:56.799107+0000 (oldest deadline 2019-12-09T22:11:39.579563+0000) 2019-12-09T22:12:21.739 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:12:21.736+0000 1694f700 -1 osd.5 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:57.798257+0000 front 2019-12-09T22:10:57.893151+0000 (oldest deadline 2019-12-09T22:11:40.661155+0000) 2019-12-09T22:12:21.802 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:12:21.796+0000 1694f700 -1 osd.2 965 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:10:58.817708+0000 front 2019-12-09T22:10:58.818557+0000 (oldest deadline 2019-12-09T22:11:40.366518+0000) 2019-12-09T22:12:24.165 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:06:45.199 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:12:24.165 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:06:45.208 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:12:24.165 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:06:45.219 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:12:24.166 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:06:45.203 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:12:24.174 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:06:45.233 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:12:24.176 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:06:45.236 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:12:24.408 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:06:45.444 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:12:24.527 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:06:45.586 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:12:24.626 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:06:45.682 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:14:12.826 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:12.822+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:13.045 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:13.041+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:13.225 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:13.219+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:13.845 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:13.839+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:14.067 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:14.063+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:14.099 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:14.095+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:14.258 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:14.256+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:14.688 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:14.685+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:14.838 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:14.834+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:15.103 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:15.100+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:15.112 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:15.108+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:15.285 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:15.282+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:15.662 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:15.658+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:15.815 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:15.811+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:16.069 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:16.065+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:16.074 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:16.071+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:16.294 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:16.288+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:16.317 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:16.315+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:16.637 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:16.633+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:16.792 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:16.785+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:17.098 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:17.090+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:17.101 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:17.090+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:17.269 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:17.266+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:17.292 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:17.284+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:17.604 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:17.600+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:17.805 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:17.802+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:18.088 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:18.084+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:18.114 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:18.110+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:18.252 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:18.249+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:18.274 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:18.270+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:18.584 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:18.581+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:18.796 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:18.791+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:19.082 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:19.077+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:19.173 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:19.157+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:19.263 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:19.260+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:19.304 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:19.301+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:19.557 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:19.550+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:19.832 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:19.828+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:20.066 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:20.063+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:20.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:20.204+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:20.253 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:20.250+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:20.300 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:20.298+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:20.558 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:20.554+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:20.822 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:20.818+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:21.055 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:21.052+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:21.227 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:21.223+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:21.230 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:21.227+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:21.255 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:21.251+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:21.600 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:21.597+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:21.785 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:21.782+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:22.032 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:22.028+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:22.215 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:22.212+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:22.226 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:22.222+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:22.240 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:22.235+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:22.575 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:22.571+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:22.821 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:22.817+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:23.023 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:23.019+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:23.180 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:23.177+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:23.185 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:23.179+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:23.252 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:23.249+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:23.573 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:23.569+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:23.872 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:23.868+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:24.069 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:24.065+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:24.188 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:24.185+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:24.197 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:24.193+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:24.271 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:24.267+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:24.535 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:24.531+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:24.869 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:24.866+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:25.099 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:25.095+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:25.197 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:25.195+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:25.226 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:25.223+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:25.239 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:25.236+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:25.502 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:25.500+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:25.834 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:25.824+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:26.151 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:26.147+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:26.207 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:26.203+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:26.229 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:26.220+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:26.272 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:26.269+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:26.561 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:26.553+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:26.814 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:26.810+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:27.161 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:27.158+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:27.169 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:27.166+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:27.204 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:27.201+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:27.304 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:27.299+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:27.516 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:27.512+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:27.811 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:27.806+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:28.145 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:28.133+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:28.189 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:28.182+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:28.217 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:28.210+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:28.308 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:28.302+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:28.556 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:28.552+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:28.813 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:28.809+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:29.108 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:29.103+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:29.173 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:29.169+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:29.183 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:29.181+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:29.258 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:29.255+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:29.517 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:29.513+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:29.853 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:29.850+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:30.082 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:30.078+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:30.196 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:30.190+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:30.213 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:30.210+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:30.246 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:30.242+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:30.545 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:30.542+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:30.875 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:30.870+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:31.081 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:31.076+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:31.176 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:31.171+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:31.216 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:31.212+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:31.259 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:31.252+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:31.514 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:31.510+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:31.853 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:31.849+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:32.099 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:32.094+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:32.227 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:32.223+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:32.246 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:32.239+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:32.299 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:32.296+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:32.548 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:32.542+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:32.904 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:32.900+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:33.141 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:33.138+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:33.205 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:33.202+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:33.213 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:33.205+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:33.326 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:33.324+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:33.598 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:33.594+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:33.910 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:33.904+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:34.164 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:34.162+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:34.216 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:34.212+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:34.217 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:34.213+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:34.294 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:34.290+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:34.591 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:34.587+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:34.956 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:34.953+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:35.120 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:35.117+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:35.210 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:35.206+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:35.228 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:35.223+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:35.297 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:35.294+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:35.628 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:35.624+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:35.959 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:35.955+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:36.098 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:36.093+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:36.216 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:36.212+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:36.266 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:36.261+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:36.285 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:36.283+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:36.674 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:36.671+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:37.010 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:37.005+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:37.132 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:37.128+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:37.179 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:37.175+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:37.263 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:37.260+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:37.298 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:37.292+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:37.656 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:37.648+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:37.964 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:37.960+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:38.120 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:38.115+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:38.158 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:38.153+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:38.259 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:38.246+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:38.309 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:38.304+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:38.670 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:38.665+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:38.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:38.920+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:39.173 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:39.168+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:39.198 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:39.194+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:39.221 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:39.213+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:39.310 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:39.307+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:39.709 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:39.700+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:39.940 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:39.936+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:40.186 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:40.183+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:40.199 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:40.194+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:40.230 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:40.219+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:40.315 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:40.311+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:40.701 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:40.695+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:40.941 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:40.936+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:41.158 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:41.154+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:41.164 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:41.161+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:41.184 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:41.180+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:41.303 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:41.299+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:41.701 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:41.695+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:41.899 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:41.895+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:42.166 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:42.162+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:42.195 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:42.191+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:42.222 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:42.219+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:42.308 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:42.304+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:42.727 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:42.722+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:42.906 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:42.902+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:43.162 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:43.158+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:43.205 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:43.201+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:43.250 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:43.245+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:43.346 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:43.342+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:43.712 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:43.707+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:43.935 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:43.932+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:44.144 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:44.140+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:44.195 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:44.190+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:44.303 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:44.298+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:44.396 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:44.393+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:44.721 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:44.716+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:44.910 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:44.906+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:45.182 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:45.177+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:45.195 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:45.189+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:45.267 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:45.262+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:45.403 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:45.400+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:45.709 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:45.705+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:45.901 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:45.895+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:46.216 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:46.212+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:46.243 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:46.240+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:46.308 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:46.305+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:46.356 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:46.353+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:46.668 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:46.664+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:46.881 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:46.878+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:47.195 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:14:47.184+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e972 v972) 2019-12-09T22:14:47.220 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:47.216+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:47.252 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:47.248+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:47.284 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:47.280+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:47.357 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:47.353+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:47.715 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:47.710+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:47.884 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:47.881+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:48.220 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:48.216+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:48.262 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:48.253+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:48.283 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:48.278+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:48.364 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:48.361+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:48.761 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:48.757+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:48.889 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:48.882+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:49.230 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:49.225+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:49.288 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:49.284+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:49.333 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:49.330+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:49.389 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:49.386+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:49.794 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:49.789+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:49.844 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:49.840+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:50.266 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:50.263+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:50.342 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:50.336+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:50.365 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:50.360+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:50.376 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:50.366+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:50.837 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:50.831+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:50.844 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:50.839+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:51.265 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:51.261+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:51.317 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:51.312+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:51.387 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:51.382+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:51.412 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:51.408+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:51.837 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:51.833+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:51.878 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:51.874+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:52.196 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:14:52.193+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e972 v972) 2019-12-09T22:14:52.240 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:52.237+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:52.299 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:52.295+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:52.418 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:52.413+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:52.451 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:52.448+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:52.810 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:52.805+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:52.846 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:52.844+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:53.271 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:53.269+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:53.319 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:53.315+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:53.393 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:53.389+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:53.419 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:53.416+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:53.771 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:53.766+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:53.901 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:53.897+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:54.308 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:54.304+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:54.377 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:54.367+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:54.396 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:54.389+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:54.396 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:54.389+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:54.787 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:54.783+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:54.881 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:54.877+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:55.302 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:55.291+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:55.377 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:55.373+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:55.388 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:55.386+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:55.404 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:55.400+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:55.817 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:55.814+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:55.861 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:55.858+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:56.276 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:56.272+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:56.400 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:56.397+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:56.407 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:56.402+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:56.440 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:56.436+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:14:56.867 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:14:56.862+0000 1694f700 -1 osd.1 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.601467+0000 front 2019-12-09T22:13:28.602982+0000 (oldest deadline 2019-12-09T22:14:14.339482+0000) 2019-12-09T22:14:56.893 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:14:56.889+0000 1694f700 -1 osd.7 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.725959+0000 front 2019-12-09T22:13:30.534108+0000 (oldest deadline 2019-12-09T22:14:12.818724+0000) 2019-12-09T22:14:57.273 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:14:57.268+0000 1694f700 -1 osd.4 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:26.177564+0000 front 2019-12-09T22:13:26.231088+0000 (oldest deadline 2019-12-09T22:14:12.057191+0000) 2019-12-09T22:14:57.281 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:14:57.276+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e972 v972) 2019-12-09T22:14:57.375 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:14:57.356+0000 1694f700 -1 osd.2 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:30.038292+0000 front 2019-12-09T22:13:30.217059+0000 (oldest deadline 2019-12-09T22:14:15.886634+0000) 2019-12-09T22:14:57.399 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:14:57.394+0000 1694f700 -1 osd.3 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:27.594284+0000 front 2019-12-09T22:13:28.351191+0000 (oldest deadline 2019-12-09T22:14:12.891575+0000) 2019-12-09T22:14:57.405 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:14:57.402+0000 1694f700 -1 osd.5 972 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:13:28.374942+0000 front 2019-12-09T22:13:27.917057+0000 (oldest deadline 2019-12-09T22:14:13.750485+0000) 2019-12-09T22:15:33.752 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:15:33.721+0000 21852700 -1 reset not still connected to 0x1037ed10 2019-12-09T22:15:33.798 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:15:33.721+0000 21852700 -1 reset not still connected to 0x15870e40 2019-12-09T22:15:37.387 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:15:37.356+0000 32788700 -1 osd.3 976 build_incremental_map_msg missing incremental map 976 2019-12-09T22:15:37.513 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:15:37.426+0000 36790700 -1 osd.3 976 build_incremental_map_msg missing incremental map 976 2019-12-09T22:15:37.764 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:15:37.536+0000 36f91700 -1 osd.3 976 build_incremental_map_msg missing incremental map 976 2019-12-09T22:15:37.783 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:15:37.537+0000 36f91700 -1 osd.3 976 build_incremental_map_msg missing incremental map 976 2019-12-09T22:15:47.851 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:10:08.909 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:15:47.865 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:10:08.924 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:15:47.950 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:10:09.009 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:15:47.951 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:10:09.011 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:15:47.974 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:10:09.010 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:15:47.976 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:10:09.013 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:15:48.156 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:10:09.215 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:15:48.183 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:10:09.240 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:15:48.232 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:10:09.268 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:27.955 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:10:49.014 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:27.997 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:10:49.049 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:28.022 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:10:49.074 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:28.022 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:10:49.076 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:28.027 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:10:49.087 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:28.055 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:10:49.115 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:28.067 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:10:49.104 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:28.076 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:10:49.113 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:28.129 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:10:49.166 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:38.132 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:10:59.191 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:38.137 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:10:59.196 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:38.149 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:10:59.208 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:38.153 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:10:59.212 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:38.162 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:10:59.199 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:38.166 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:10:59.225 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:38.178 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:10:59.214 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:38.189 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:10:59.248 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:38.265 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:10:59.301 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:16:42.213 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:42.209+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:43.126 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:43.122+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:43.193 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:43.189+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:44.176 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:44.174+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:44.230 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:44.227+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:44.996 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:44.986+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:45.189 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:45.184+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:45.189 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:45.184+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:45.926 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:45.922+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:46.038 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:46.030+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:46.210 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:46.197+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:46.217 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:46.210+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:46.665 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:46.661+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:46.891 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:46.887+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:46.940 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:46.935+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:47.054 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:47.049+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:47.180 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:47.173+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:47.222 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:47.215+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:47.666 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:47.663+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:47.862 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:47.859+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:47.900 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:47.896+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:48.107 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:48.096+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:48.145 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:48.138+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:48.179 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:48.175+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:48.624 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:48.620+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:48.883 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:48.879+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:48.940 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:48.933+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:49.109 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:49.102+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:49.158 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:49.153+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:49.197 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:49.192+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:49.586 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:49.582+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:49.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:49.921+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:49.974 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:49.963+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:50.084 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:50.080+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:50.146 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:50.142+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:50.229 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:50.223+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:50.571 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:50.566+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:50.928 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:50.924+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:50.981 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:50.975+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:51.059 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:51.054+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:51.147 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:51.144+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:51.192 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:51.188+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:51.544 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:51.541+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:51.887 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:51.884+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:52.021 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:52.016+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:52.031 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:52.026+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:52.120 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:52.113+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:52.215 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:52.211+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:52.537 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:52.529+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:52.844 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:52.840+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:53.005 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:52.999+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:53.048 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:53.042+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:53.135 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:53.131+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:53.196 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:53.191+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:53.542 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:53.538+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:53.841 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:53.836+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:54.038 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:54.032+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:54.059 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:54.055+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:54.127 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:54.119+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:54.153 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:54.149+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:54.506 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:54.502+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:54.850 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:54.846+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:55.014 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:55.010+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:55.113 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:55.108+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:55.161 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:55.155+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:55.172 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:55.166+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:55.504 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:55.500+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:55.816 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:55.812+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:56.035 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:56.032+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:56.116 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:56.112+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:56.170 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:56.165+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:56.197 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:56.189+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:56.537 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:56.532+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:56.862 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:56.858+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:57.029 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:57.022+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:57.138 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:57.134+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:57.177 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:57.173+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:57.209 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:57.203+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:57.500 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:57.497+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:57.897 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:57.893+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:58.013 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:58.006+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:58.134 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:58.128+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:58.189 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:58.184+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:58.241 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:58.231+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:58.529 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:58.511+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:58.949 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:58.942+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:16:59.021 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:16:59.013+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:16:59.181 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:16:59.166+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:16:59.191 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:16:59.185+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:16:59.241 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:16:59.236+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:16:59.501 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:16:59.497+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:16:59.960 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:16:59.951+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:00.071 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:00.063+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:00.203 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:00.199+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:00.215 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:00.211+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:00.277 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:00.269+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:00.465 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:00.461+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:00.931 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:00.923+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:01.078 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:01.072+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:01.210 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:01.204+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:01.257 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:01.252+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:01.291 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:01.287+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:01.451 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:01.447+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:01.893 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:01.889+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:02.120 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:02.115+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:02.216 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:02.209+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:02.230 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:02.223+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:02.334 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:02.326+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:02.489 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:02.484+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:02.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:02.919+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:03.163 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:03.159+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:03.212 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:03.208+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:03.233 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:03.228+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:03.333 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:03.325+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:03.537 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:03.532+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:03.968 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:03.960+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:04.149 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:04.140+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:04.202 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:04.197+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:04.285 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:04.282+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:04.383 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:04.378+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:04.565 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:04.561+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:04.929 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:04.925+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:05.189 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:05.185+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:05.229 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:05.224+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:05.293 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:05.287+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:05.369 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:05.361+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:05.570 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:05.566+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:05.940 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:05.936+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:06.181 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:06.175+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:06.226 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:06.221+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:06.327 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:06.323+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:06.393 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:06.388+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:06.618 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:06.615+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:06.941 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:06.937+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:07.201 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:07.193+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:07.268 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:07.258+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:07.344 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:07.340+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:07.441 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:07.433+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:07.642 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:07.638+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:07.956 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:07.953+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:08.185 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:08.179+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:08.288 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:08.285+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:08.349 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:08.343+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:08.416 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:08.404+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:08.645 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:08.640+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:09.017 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:09.013+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:09.182 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:09.174+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:09.277 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:09.274+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:09.325 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:09.318+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:09.434 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:09.429+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:09.661 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:09.654+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:10.059 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:10.056+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:10.201 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:10.181+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:10.243 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:10.238+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:10.337 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:10.330+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:10.433 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:10.426+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:10.621 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:10.617+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:11.043 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:11.038+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:11.191 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:11.185+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:11.292 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:11.288+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:11.310 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:11.305+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:11.413 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:11.406+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:11.648 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:11.643+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:12.105 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:12.100+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:12.160 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:12.156+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:12.255 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:12.251+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:12.281 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:12.275+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:12.445 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:12.442+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:12.705 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:12.695+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:13.068 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:17:13.066+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e979 v979) 2019-12-09T22:17:13.122 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:13.117+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:13.187 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:13.184+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:13.242 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:13.239+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:13.314 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:13.309+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:13.476 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:13.471+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:13.728 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:13.724+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:14.085 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:14.080+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:14.179 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:14.176+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:14.205 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:14.202+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:14.326 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:14.323+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:14.510 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:14.506+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:14.690 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:14.686+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:15.069 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:15.066+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:15.160 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:15.157+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:15.203 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:15.199+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:15.310 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:15.298+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:15.479 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:15.475+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:15.643 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:15.639+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:16.069 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:16.065+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:16.184 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:16.178+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:16.196 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:16.193+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:16.318 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:16.313+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:16.463 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:16.459+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:16.681 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:16.677+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:17.082 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:17.079+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:17.194 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:17.191+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:17.225 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:17.221+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:17.361 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:17.356+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:17.422 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:17.420+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:17.641 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:17.638+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:18.077 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:17:18.075+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e979 v979) 2019-12-09T22:17:18.084 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:18.080+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:18.199 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:18.196+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:18.213 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:18.210+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:18.404 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:18.400+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:18.457 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:18.453+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:18.648 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:18.645+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:19.102 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:19.091+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:19.221 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:19.216+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:19.231 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:19.227+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:19.388 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:19.385+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:19.412 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:19.408+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:19.680 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:19.673+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:20.087 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:20.080+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:20.255 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:20.253+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:20.270 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:20.267+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:20.360 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:20.355+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:20.442 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:20.438+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:20.717 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:20.714+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:21.138 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:21.133+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:21.267 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:21.264+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:21.283 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:21.280+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:21.389 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:21.385+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:21.455 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:21.450+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:21.685 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:21.682+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:22.139 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:22.134+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:22.259 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:17:22.255+0000 1694f700 -1 osd.2 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.144050+0000 front 2019-12-09T22:16:01.037237+0000 (oldest deadline 2019-12-09T22:16:44.964679+0000) 2019-12-09T22:17:22.335 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:17:22.332+0000 1694f700 -1 osd.1 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:15:58.002252+0000 front 2019-12-09T22:15:57.993642+0000 (oldest deadline 2019-12-09T22:16:42.052565+0000) 2019-12-09T22:17:22.400 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:17:22.396+0000 1694f700 -1 osd.5 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.084516+0000 front 2019-12-09T22:16:00.027909+0000 (oldest deadline 2019-12-09T22:16:45.866275+0000) 2019-12-09T22:17:22.430 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:17:22.427+0000 1694f700 -1 osd.3 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:00.548020+0000 front 2019-12-09T22:16:00.584504+0000 (oldest deadline 2019-12-09T22:16:42.213445+0000) 2019-12-09T22:17:22.699 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:17:22.695+0000 1694f700 -1 osd.4 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.361967+0000 front 2019-12-09T22:16:01.390381+0000 (oldest deadline 2019-12-09T22:16:46.641940+0000) 2019-12-09T22:17:23.109 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:17:23.106+0000 1694f700 -1 osd.7 979 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:16:01.796173+0000 front 2019-12-09T22:16:01.854570+0000 (oldest deadline 2019-12-09T22:16:46.472214+0000) 2019-12-09T22:17:23.150 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:17:23.146+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e979 v979) 2019-12-09T22:18:13.227 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:18:13.165+0000 35f8f700 -1 osd.0 985 build_incremental_map_msg missing incremental map 985 2019-12-09T22:18:13.380 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:18:13.176+0000 35f8f700 -1 osd.0 985 build_incremental_map_msg missing incremental map 985 2019-12-09T22:18:13.474 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:18:13.200+0000 31786700 -1 osd.0 985 build_incremental_map_msg missing incremental map 985 2019-12-09T22:18:13.532 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:18:13.387+0000 35f8f700 -1 osd.0 985 build_incremental_map_msg missing incremental map 985 2019-12-09T22:18:13.920 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:18:13.832+0000 36f91700 -1 osd.0 985 build_incremental_map_msg missing incremental map 985 2019-12-09T22:18:13.982 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:18:13.907+0000 32788700 -1 osd.0 985 build_incremental_map_msg missing incremental map 985 2019-12-09T22:18:14.733 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:18:14.726+0000 33f8b700 -1 osd.0 985 build_incremental_map_msg missing incremental map 985 2019-12-09T22:18:17.431 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:18:17.378+0000 34f8d700 -1 osd.0 986 build_incremental_map_msg missing incremental map 985 2019-12-09T22:19:14.148 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:14.144+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:14.531 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:14.527+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:15.150 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:15.147+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:15.487 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:15.483+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:15.760 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:15.754+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:16.099 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:16.094+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:16.112 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:16.108+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:16.522 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:16.518+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:16.732 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:16.726+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:17.117 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:17.112+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:17.122 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:17.119+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:17.566 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:17.563+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:17.737 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:17.733+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:18.063 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:18.059+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:18.141 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:18.133+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:18.161 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:18.157+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:18.530 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:18.528+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:18.749 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:18.745+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:18.968 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:18.965+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:19.073 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:19.069+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:19.142 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:19.135+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:19.168 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:19.165+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:19.536 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:19.532+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:19.736 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:19.728+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:20.010 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:20.005+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:20.044 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:20.040+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:20.147 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:20.144+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:20.151 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:20.147+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:20.499 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:20.494+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:20.752 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:20.748+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:21.009 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:21.006+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:21.052 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:21.048+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:21.131 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:21.124+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:21.175 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:21.169+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:21.513 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:21.507+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:21.744 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:21.738+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:22.009 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:21.999+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:22.046 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:22.042+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:22.140 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:22.136+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:22.172 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:22.168+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:22.516 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:22.511+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:22.701 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:22.695+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:23.033 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:23.027+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:23.041 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:23.038+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:23.158 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:23.153+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:23.161 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:23.159+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:23.522 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:23.518+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:23.682 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:23.677+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:24.021 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:24.006+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:24.078 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:24.073+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:24.130 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:24.127+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:24.197 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:24.190+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:24.557 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:24.551+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:24.665 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:24.652+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:24.979 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:24.974+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:25.093 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:25.088+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:25.152 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:25.147+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:25.196 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:25.193+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:25.568 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:25.563+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:25.627 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:25.621+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:26.034 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:26.027+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:26.049 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:26.045+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:26.105 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:26.102+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:26.175 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:26.172+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:26.529 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:26.523+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:26.649 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:26.646+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:27.053 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:27.049+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:27.068 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:27.065+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:27.075 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:27.071+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:27.197 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:27.194+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:27.527 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:27.524+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:27.699 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:27.695+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:28.070 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:28.067+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:28.075 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:28.071+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:28.104 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:28.101+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:28.172 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:28.169+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:28.506 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:28.502+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:28.737 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:28.733+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:29.040 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:29.037+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:29.065 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:29.061+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:29.161 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:29.146+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:29.226 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:29.221+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:29.500 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:29.496+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:29.770 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:29.766+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:30.085 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:30.072+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:30.091 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:30.087+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:30.134 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:30.130+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:30.221 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:30.218+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:30.470 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:30.467+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:30.777 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:30.773+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:31.090 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:31.086+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:31.096 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:31.092+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:31.098 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:31.094+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:31.190 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:31.185+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:31.456 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:31.450+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:31.796 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:31.794+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:32.064 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:32.060+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:32.100 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:32.097+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:32.123 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:32.120+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:32.239 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:32.234+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:32.447 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:32.442+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:32.820 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:32.816+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:33.079 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:33.075+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:33.086 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:33.082+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:33.147 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:33.142+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:33.284 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:33.280+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:33.485 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:33.482+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:33.785 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:33.780+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:34.043 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:34.039+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:34.118 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:34.114+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:34.144 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:34.139+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:34.278 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:34.275+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:34.501 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:34.498+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:34.791 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:34.787+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:35.062 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:35.059+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:35.073 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:35.069+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:35.135 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:35.131+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:35.292 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:35.289+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:35.531 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:35.528+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:35.807 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:35.799+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:36.053 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:36.050+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:36.074 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:36.071+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:36.137 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:36.133+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:36.334 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:36.331+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:36.585 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:36.579+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:36.785 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:36.780+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:37.093 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:37.089+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:37.094 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:37.089+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:37.153 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:37.147+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:37.355 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:37.352+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:37.621 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:37.617+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:37.761 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:37.756+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:38.066 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:38.062+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:38.101 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:38.094+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:38.181 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:38.178+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:38.405 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:38.400+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:38.601 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:38.598+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:38.811 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:38.808+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:39.103 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:39.099+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:39.148 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:39.144+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:39.190 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:39.186+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:39.387 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:19:39.380+0000 1694f700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.984527+0000 front 2019-12-09T22:18:32.996933+0000 (oldest deadline 2019-12-09T22:19:13.997530+0000) 2019-12-09T22:19:39.575 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:39.572+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:39.865 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:39.857+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:40.123 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:40.118+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:40.149 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:40.145+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:40.157 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:40.153+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:40.624 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:40.621+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:40.832 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:40.828+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:41.152 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:41.148+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:41.161 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:41.158+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:41.194 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:41.190+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:41.590 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:41.587+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:41.871 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:41.867+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:42.109 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:42.105+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:42.140 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:42.132+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:42.166 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:42.163+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:42.584 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:42.578+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:42.892 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:42.887+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:43.085 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:43.082+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:43.178 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:43.174+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:43.215 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:43.211+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:43.622 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:43.619+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:43.910 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:43.905+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:44.060 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:44.051+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:44.174 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:44.171+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:44.190 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:44.187+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:44.627 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:44.624+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:44.917 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:44.912+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:45.057 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:45.053+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:45.129 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:45.125+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:45.155 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:45.151+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:45.585 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:45.581+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:45.917 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:45.913+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:46.066 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:46.062+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:46.119 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:46.115+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:46.124 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:46.121+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:46.622 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:46.618+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:46.888 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:46.885+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:47.084 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:47.082+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:47.107 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:47.105+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:47.168 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:47.164+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:47.641 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:47.636+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:47.916 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:47.912+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:48.115 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:48.111+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:48.137 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:48.133+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:48.151 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:48.147+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:48.602 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:19:48.601+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e987 v987) 2019-12-09T22:19:48.631 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:48.627+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:48.965 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:48.962+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:49.148 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:49.145+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:49.149 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:49.146+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:49.150 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:49.146+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:49.677 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:49.673+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:49.965 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:49.962+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:50.152 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:50.148+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:50.169 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:50.166+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:50.182 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:50.178+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:50.682 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:50.679+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:50.996 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:50.992+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:51.153 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:51.150+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:51.173 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:51.169+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:51.200 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:51.196+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:51.659 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:51.653+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:52.001 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:51.985+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:52.172 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:52.167+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:52.199 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:52.193+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:52.216 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:52.213+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:52.675 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:52.672+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:52.991 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:52.987+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:53.154 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:53.151+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:53.163 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:53.160+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:53.173 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:53.170+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:53.617 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:19:53.615+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e987 v987) 2019-12-09T22:19:53.681 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:53.678+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:54.015 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:54.008+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:54.128 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:54.125+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:54.206 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:54.203+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:54.211 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:54.207+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:54.663 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:54.660+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:55.033 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:55.025+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:55.175 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:55.171+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:55.203 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:55.200+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:55.235 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:55.232+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:55.629 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:55.625+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:56.025 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:56.022+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:56.161 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:56.157+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:56.184 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:56.180+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:56.197 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:56.193+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:56.598 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:56.593+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:57.017 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:57.013+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:57.148 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:57.144+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:57.176 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:57.171+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:57.178 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:57.174+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:57.646 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:57.642+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:57.998 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:19:57.993+0000 1694f700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.263369+0000 front 2019-12-09T22:18:30.281284+0000 (oldest deadline 2019-12-09T22:19:15.540168+0000) 2019-12-09T22:19:58.140 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:19:58.135+0000 1694f700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.842737+0000 front 2019-12-09T22:18:32.822856+0000 (oldest deadline 2019-12-09T22:19:18.104843+0000) 2019-12-09T22:19:58.152 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:19:58.148+0000 1694f700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:29.573081+0000 front 2019-12-09T22:18:29.579342+0000 (oldest deadline 2019-12-09T22:19:15.446957+0000) 2019-12-09T22:19:58.190 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:19:58.187+0000 1694f700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:32.811693+0000 front 2019-12-09T22:18:32.495471+0000 (oldest deadline 2019-12-09T22:19:17.744503+0000) 2019-12-09T22:19:58.612 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:19:58.606+0000 1694f700 -1 osd.3 987 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:18:30.673069+0000 front 2019-12-09T22:18:30.636360+0000 (oldest deadline 2019-12-09T22:19:14.451078+0000) 2019-12-09T22:19:58.691 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:19:58.687+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 45sec e987 v987) 2019-12-09T22:20:43.314 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:20:43.265+0000 34f8d700 -1 osd.7 991 build_incremental_map_msg missing incremental map 991 2019-12-09T22:20:43.352 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:20:43.266+0000 34f8d700 -1 osd.7 991 build_incremental_map_msg missing incremental map 991 2019-12-09T22:20:43.357 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:20:43.324+0000 31d82700 -1 osd.5 991 build_incremental_map_msg missing incremental map 991 2019-12-09T22:20:43.363 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:20:43.336+0000 31d82700 -1 osd.5 991 build_incremental_map_msg missing incremental map 991 2019-12-09T22:20:43.399 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:20:43.280+0000 34f8d700 -1 osd.7 991 build_incremental_map_msg missing incremental map 991 2019-12-09T22:20:43.486 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:20:43.321+0000 34f8d700 -1 osd.7 991 build_incremental_map_msg missing incremental map 991 2019-12-09T22:20:43.573 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:20:43.424+0000 3858f700 -1 osd.5 991 build_incremental_map_msg missing incremental map 991 2019-12-09T22:20:43.723 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:20:43.575+0000 31581700 -1 osd.5 991 build_incremental_map_msg missing incremental map 991 2019-12-09T22:20:43.762 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:20:43.647+0000 35d8a700 -1 osd.5 991 build_incremental_map_msg missing incremental map 991 2019-12-09T22:20:43.843 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:20:43.588+0000 36790700 -1 osd.7 991 build_incremental_map_msg missing incremental map 991 2019-12-09T22:20:45.611 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:15:06.670 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:20:45.617 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:15:06.677 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:20:45.644 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:15:06.680 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:20:45.644 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:15:06.703 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:20:45.650 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:15:06.686 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:20:45.650 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:15:06.708 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:20:45.969 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:15:07.023 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:20:45.969 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:15:07.024 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:20:45.970 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:15:07.007 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:21:49.178 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:21:49.175+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:21:50.079 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:21:50.072+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:21:50.085 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:21:50.082+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:21:50.206 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:21:50.203+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:21:51.051 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:21:51.047+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:21:51.073 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:21:51.069+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:21:51.255 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:21:51.251+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:21:52.092 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:21:52.090+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:21:52.097 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:21:52.094+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:21:52.131 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:21:52.127+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:21:52.263 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:21:52.259+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:21:52.606 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:21:52.601+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:21:53.052 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:21:53.048+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:21:53.094 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:21:53.088+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:21:53.170 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:21:53.156+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:21:53.249 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:21:53.243+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:21:53.648 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:21:53.645+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:21:54.044 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:21:54.040+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:21:54.082 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:21:54.078+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:21:54.203 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:21:54.201+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:21:54.288 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:21:54.285+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:21:54.673 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:21:54.667+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:21:55.024 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:21:55.019+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:21:55.057 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:21:55.053+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:21:55.172 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:21:55.168+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:21:55.188 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:21:55.183+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:21:55.272 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:21:55.267+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:21:55.652 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:21:55.648+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:21:56.060 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:21:56.056+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:21:56.100 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:21:56.096+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:21:56.215 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:21:56.212+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:21:56.229 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:21:56.213+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:21:56.258 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:21:56.255+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:21:56.667 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:21:56.663+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:21:57.043 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:21:57.039+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:21:57.070 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:21:57.066+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:21:57.236 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:21:57.233+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:21:57.242 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:21:57.239+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:21:57.273 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:21:57.265+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:21:57.692 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:21:57.687+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:21:58.045 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:21:58.041+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:21:58.087 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:21:58.083+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:21:58.250 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:21:58.245+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:21:58.271 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:21:58.267+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:21:58.301 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:21:58.288+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:21:58.746 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:21:58.742+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:21:59.012 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:21:59.007+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:21:59.081 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:21:59.074+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:21:59.294 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:21:59.286+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:21:59.299 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:21:59.296+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:21:59.320 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:21:59.317+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:21:59.751 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:21:59.747+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:00.034 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:00.030+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:00.127 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:00.123+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:00.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:00.261+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:00.303 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:00.300+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:00.373 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:00.369+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:00.738 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:00.734+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:01.011 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:01.007+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:01.131 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:01.127+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:01.263 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:01.259+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:01.299 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:01.293+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:01.353 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:01.350+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:01.788 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:01.784+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:02.007 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:01.997+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:02.149 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:02.144+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:02.247 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:02.244+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:02.320 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:02.316+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:02.323 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:02.320+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:02.769 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:02.764+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:03.000 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:02.996+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:03.140 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:03.136+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:03.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:03.222+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:03.292 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:03.287+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:03.316 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:03.311+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:03.777 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:03.773+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:04.013 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:04.008+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:04.169 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:04.165+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:04.195 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:04.192+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:04.278 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:04.274+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:04.312 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:04.307+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:04.807 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:04.804+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:05.026 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:05.023+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:05.189 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:05.186+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:05.218 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:05.214+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:05.295 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:05.291+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:05.326 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:05.322+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:05.806 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:05.802+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:06.017 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:06.014+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:06.154 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:06.150+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:06.219 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:06.214+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:06.284 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:06.279+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:06.326 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:06.321+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:06.787 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:06.784+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:06.974 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:06.971+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:07.194 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:07.191+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:07.197 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:07.190+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:07.258 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:07.252+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:07.336 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:07.332+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:07.787 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:07.782+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:08.010 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:08.005+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:08.240 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:08.237+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:08.249 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:08.242+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:08.284 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:08.280+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:08.300 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:08.293+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:08.828 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:08.818+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:08.969 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:08.965+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:09.247 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:09.243+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:09.254 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:09.250+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:09.268 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:09.264+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:09.326 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:09.322+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:09.842 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:09.839+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:09.973 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:09.970+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:10.237 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:10.233+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:10.259 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:10.255+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:10.263 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:10.257+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:10.382 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:10.368+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:10.811 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:10.808+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:11.001 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:10.997+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:11.197 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:11.193+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:11.222 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:11.220+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:11.307 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:11.303+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:11.395 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:11.387+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:11.825 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:11.821+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:12.005 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:12.000+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:12.224 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:12.220+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:12.244 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:12.241+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:12.321 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:12.317+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:12.393 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:12.389+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:12.837 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:12.834+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:13.040 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:13.036+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:13.224 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:13.221+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:13.240 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:13.234+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:13.308 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:13.302+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:13.430 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:13.426+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:13.802 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:13.798+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:14.041 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:14.037+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:14.227 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:14.224+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:14.241 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:14.238+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:14.294 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:14.289+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:14.438 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:14.434+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:14.818 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:14.813+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:15.008 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:15.004+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:15.242 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:15.238+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:15.292 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:15.287+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:15.323 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:15.318+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:15.448 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:15.444+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:15.824 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:15.821+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:15.982 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:15.979+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:16.246 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:16.243+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:16.300 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:16.293+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:16.331 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:16.327+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:16.440 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:16.436+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:16.852 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:16.848+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:16.969 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:16.962+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:17.221 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:17.218+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:17.282 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:17.278+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:17.318 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:17.313+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:17.459 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:17.455+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:17.834 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:17.831+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:17.972 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:17.966+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:18.268 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:18.265+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:18.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:18.270+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:18.300 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:18.296+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:18.464 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:18.459+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:18.861 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:18.857+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:18.948 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:18.944+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:19.280 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:19.275+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:19.282 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:19.278+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:19.337 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:19.333+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:19.494 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:19.488+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:19.871 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:19.868+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:19.997 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:19.994+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:20.322 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:20.317+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:20.329 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:20.326+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:20.357 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:20.351+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:20.518 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:20.515+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:20.862 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:20.858+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:21.040 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:21.036+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:21.313 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:21.308+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:21.336 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:21.331+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:21.349 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:21.345+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:21.495 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:21.489+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:21.867 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:21.863+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:22.092 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:22.089+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:22.326 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:22.321+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:22.351 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:22.347+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:22.383 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:22.379+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:22.539 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:22.535+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:22.853 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:22.850+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:23.059 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:23.055+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:23.320 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:23.313+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:23.349 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:23.345+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:23.419 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:23.415+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:23.499 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:23.496+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:23.905 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:23.902+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:24.030 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:24.024+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:24.201 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:22:24.198+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e996 v996) 2019-12-09T22:22:24.330 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:24.326+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:24.367 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:24.362+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:24.381 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:24.377+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:24.490 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:24.486+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:24.925 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:24.922+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:24.981 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:24.977+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:25.329 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:25.325+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:25.370 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:25.356+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:25.401 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:25.398+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:25.449 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:25.445+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:25.902 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:25.897+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:26.035 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:26.030+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:26.339 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:26.331+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:26.340 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:26.337+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:26.373 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:26.368+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:26.445 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:26.441+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:26.917 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:26.913+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:27.023 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:27.019+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:27.341 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:27.337+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:27.389 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:27.377+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:27.409 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:27.400+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:27.459 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:27.455+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:27.969 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:27.965+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:28.048 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:28.043+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:28.323 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:28.319+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:28.554 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:28.355+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:28.554 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:28.381+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:28.555 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:28.482+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:28.983 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:28.977+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:29.006 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:29.002+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:29.220 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:22:29.217+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e996 v996) 2019-12-09T22:22:29.279 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:29.276+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:29.366 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:29.364+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:29.400 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:29.397+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:29.518 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:29.513+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:29.997 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:29.993+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:30.007 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:30.004+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:30.298 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:30.295+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:30.359 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:30.356+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:30.430 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:30.427+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:30.569 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:30.564+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:30.962 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:30.959+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:30.995 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:30.991+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:31.322 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:31.318+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:31.403 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:31.398+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:31.430 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:31.427+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:31.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:31.615+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:31.967 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:31.962+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:31.970 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:31.967+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:32.338 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:32.335+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:32.389 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:32.386+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:32.452 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:32.447+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:32.617 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:32.612+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:32.927 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:32.922+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:32.940 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:32.936+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:33.362 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:33.358+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:33.398 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:33.395+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:22:33.504 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:22:33.500+0000 1694f700 -1 osd.2 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.565953+0000 front 2019-12-09T22:21:08.558324+0000 (oldest deadline 2019-12-09T22:21:54.325049+0000) 2019-12-09T22:22:33.574 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:22:33.570+0000 1694f700 -1 osd.1 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:07.336103+0000 front 2019-12-09T22:21:07.335280+0000 (oldest deadline 2019-12-09T22:21:48.994325+0000) 2019-12-09T22:22:33.917 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:22:33.911+0000 1694f700 -1 osd.5 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.854818+0000 front 2019-12-09T22:21:03.848181+0000 (oldest deadline 2019-12-09T22:21:49.318757+0000) 2019-12-09T22:22:33.927 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:22:33.924+0000 1694f700 -1 osd.4 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.293778+0000 front 2019-12-09T22:21:08.434354+0000 (oldest deadline 2019-12-09T22:21:52.324586+0000) 2019-12-09T22:22:34.291 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:22:34.284+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e996 v996) 2019-12-09T22:22:34.341 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:22:34.337+0000 1694f700 -1 osd.7 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:03.886650+0000 front 2019-12-09T22:21:03.888640+0000 (oldest deadline 2019-12-09T22:21:49.348581+0000) 2019-12-09T22:22:34.424 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:22:34.421+0000 1694f700 -1 osd.3 996 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:21:08.273997+0000 front 2019-12-09T22:21:08.423397+0000 (oldest deadline 2019-12-09T22:21:51.585395+0000) 2019-12-09T22:23:19.675 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:17:40.733 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:23:19.683 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:17:40.742 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:23:19.734 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:17:40.771 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:23:19.740 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:17:40.777 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:23:19.749 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:17:40.808 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:23:19.762 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:17:40.822 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:23:19.908 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:17:40.945 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:23:19.979 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:17:41.038 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:23:20.054 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:23:20.008+0000 35f8f700 -1 osd.0 1002 build_incremental_map_msg missing incremental map 1002 2019-12-09T22:23:20.063 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:17:41.122 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:23:21.612 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:23:21.604+0000 32f89700 -1 osd.0 1002 build_incremental_map_msg missing incremental map 1002 2019-12-09T22:23:25.150 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:23:25.042+0000 38f95700 -1 osd.0 1003 build_incremental_map_msg missing incremental map 1002 2019-12-09T22:24:22.393 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:22.389+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:22.430 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:22.426+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:23.417 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:23.410+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:23.482 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:23.476+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:23.772 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:23.767+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:24.424 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:24.415+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:24.434 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:24.431+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:24.725 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:24.721+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:25.304 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:25.299+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:25.412 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:25.407+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:25.419 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:25.415+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:25.753 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:25.749+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:26.283 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:26.278+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:26.430 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:26.427+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:26.452 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:26.450+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:26.530 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:26.522+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:26.774 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:26.768+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:27.259 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:27.256+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:27.423 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:27.420+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:27.446 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:27.442+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:27.455 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:27.452+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:27.514 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:27.510+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:27.785 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:27.779+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:28.281 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:28.277+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:28.437 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:28.433+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:28.444 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:28.440+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:28.507 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:28.501+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:28.530 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:28.525+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:28.766 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:28.762+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:29.293 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:29.288+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:29.431 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:29.426+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:29.442 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:29.439+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:29.529 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:29.525+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:29.532 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:29.529+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:29.739 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:29.736+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:30.346 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:30.341+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:30.416 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:30.411+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:30.428 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:30.424+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:30.543 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:30.536+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:30.559 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:30.556+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:30.756 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:30.751+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:31.300 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:31.296+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:31.415 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:31.410+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:31.473 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:31.469+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:31.536 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:31.529+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:31.537 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:31.534+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:31.754 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:31.747+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:32.297 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:32.290+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:32.434 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:32.430+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:32.464 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:32.460+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:32.561 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:32.552+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:32.581 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:32.575+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:32.772 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:32.766+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:33.268 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:33.264+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:33.422 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:33.418+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:33.503 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:33.499+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:33.565 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:33.560+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:33.573 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:33.570+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:33.776 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:33.772+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:34.280 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:34.276+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:34.404 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:34.398+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:34.461 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:34.458+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:34.559 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:34.554+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:34.616 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:34.611+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:34.773 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:34.765+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:35.238 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:35.235+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:35.365 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:35.361+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:35.480 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:35.476+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:35.551 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:35.547+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:35.633 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:35.627+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:35.793 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:35.789+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:36.230 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:36.226+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:36.377 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:36.366+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:36.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:36.500+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:36.587 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:36.584+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:36.638 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:36.633+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:36.829 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:36.825+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:37.196 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:37.188+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:37.329 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:37.322+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:37.478 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:37.474+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:37.585 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:37.571+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:37.678 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:37.674+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:37.883 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:37.880+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:38.199 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:38.195+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:38.299 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:38.294+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:38.487 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:38.483+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:38.561 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:38.554+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:38.682 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:38.678+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:38.848 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:38.844+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:39.163 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:39.159+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:39.273 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:39.263+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:39.514 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:39.511+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:39.523 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:39.520+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:39.656 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:39.653+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:39.872 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:39.869+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:40.190 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:40.186+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:40.369 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:40.242+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:40.478 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:40.474+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:40.528 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:40.517+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:40.710 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:40.705+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:40.905 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:40.902+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:41.177 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:41.172+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:41.273 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:41.269+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:41.436 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:41.431+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:41.482 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:41.478+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:41.704 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:41.701+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:41.946 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:41.943+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:42.149 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:42.145+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:42.262 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:42.260+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:42.390 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:42.387+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:42.532 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:42.527+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:42.676 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:42.672+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:42.990 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:42.987+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:43.113 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:43.109+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:43.252 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:43.248+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:43.389 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:43.385+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:43.540 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:43.536+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:43.684 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:43.681+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:43.979 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:43.975+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:44.112 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:44.107+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:44.295 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:44.292+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:44.345 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:44.340+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:44.567 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:44.561+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:44.638 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:44.634+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:44.968 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:44.964+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:45.102 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:45.099+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:45.308 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:45.304+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:45.373 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:45.369+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:45.582 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:45.578+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:45.630 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:45.626+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:45.965 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:45.942+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:46.153 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:46.150+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:46.346 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:46.341+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:46.418 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:46.414+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:46.621 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:46.615+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:46.645 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:46.642+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:46.969 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:46.964+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:47.128 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:47.123+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:47.376 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:47.371+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:47.448 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:47.442+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:47.604 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:47.602+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:47.644 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:47.640+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:47.988 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:47.985+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:48.157 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:48.155+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:48.426 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:48.422+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:48.452 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:48.447+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:48.572 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:48.567+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:48.697 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:48.692+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:49.040 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:49.036+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:49.208 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:49.204+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:49.392 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:49.388+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:49.504 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:49.501+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:49.541 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:49.532+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:49.702 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:49.697+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:49.990 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:19:11.049 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:50.015 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:19:11.074 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:50.061 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:19:11.119 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:50.063 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:19:11.121 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:50.068 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:50.062+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:50.076 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:19:11.111 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:50.081 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:19:11.117 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:50.111 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:19:11.171 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:50.164 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:50.159+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:50.180 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:19:11.238 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:50.217 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:19:11.251 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:50.371 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:50.367+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:50.497 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:50.493+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:50.577 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:50.574+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:50.660 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:50.657+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:51.115 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:51.110+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:51.150 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:51.146+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:51.356 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:51.353+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:51.483 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:51.481+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:51.573 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:51.558+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:51.715 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:51.711+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:52.093 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:52.089+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:52.197 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:52.193+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:52.403 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:52.399+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:52.449 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:52.444+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:52.589 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:52.586+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:52.741 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:52.729+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:53.124 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:53.120+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:53.161 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:53.157+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:53.399 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:53.396+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:53.490 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:53.483+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:53.640 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:53.635+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:53.713 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:53.708+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:54.138 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:54.135+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:54.180 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:54.176+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:54.445 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:54.440+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:54.478 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:54.473+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:54.600 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:54.596+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:54.752 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:54.748+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:54.988 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:24:54.985+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e1004 v1004) 2019-12-09T22:24:55.129 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:55.125+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:55.152 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:55.146+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:55.180 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:19:16.237 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:55.197 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:19:16.245 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:55.200 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:19:16.257 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:55.205 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:19:16.241 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:55.206 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:19:16.265 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:55.217 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:19:16.250 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:55.218 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:19:16.278 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:55.238 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:19:16.296 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:55.289 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:19:16.326 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:24:55.465 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:55.461+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:55.483 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:55.477+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:55.579 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:55.576+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:55.767 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:55.765+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:56.164 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:56.161+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:56.167 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:56.164+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:56.434 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:56.430+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:56.442 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:56.439+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:56.569 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:56.565+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:56.762 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:56.757+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:57.211 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:57.207+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:57.219 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:57.215+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:57.406 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:57.402+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:57.417 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:57.414+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:57.538 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:57.535+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:57.715 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:57.712+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:58.193 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:58.191+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:58.248 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:58.245+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:58.400 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:58.396+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:58.444 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:58.440+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:58.576 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:58.572+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:58.726 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:58.721+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:59.146 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:24:59.144+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:24:59.291 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:24:59.288+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:24:59.406 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:24:59.402+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:24:59.429 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:24:59.425+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:24:59.529 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:24:59.527+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:24:59.721 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:24:59.717+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:24:59.999 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:24:59.997+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e1004 v1004) 2019-12-09T22:25:00.193 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:25:00.191+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:25:00.305 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:25:00.301+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:25:00.386 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:25:00.382+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:25:00.444 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:25:00.440+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:25:00.500 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:25:00.495+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:25:00.763 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:25:00.758+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:25:01.200 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:25:01.196+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:25:01.315 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:25:01.312+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:25:01.414 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:25:01.410+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:25:01.420 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:25:01.416+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:25:01.515 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:25:01.511+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:25:01.723 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:25:01.718+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:25:02.214 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:25:02.210+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:25:02.296 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:25:02.291+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:25:02.453 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:25:02.447+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:25:02.453 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:25:02.448+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:25:02.505 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:25:02.499+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:25:02.730 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:25:02.725+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:25:03.171 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:25:03.167+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:25:03.322 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:25:03.317+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:25:03.425 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:25:03.420+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:25:03.489 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:25:03.482+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:25:03.519 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:25:03.515+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:25:03.759 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:25:03.756+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:25:04.202 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:25:04.199+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:25:04.369 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:25:04.364+0000 1694f700 -1 osd.1 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:38.043743+0000 front 2019-12-09T22:23:37.967622+0000 (oldest deadline 2019-12-09T22:24:23.194234+0000) 2019-12-09T22:25:04.466 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:25:04.462+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:25:04.498 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:25:04.494+0000 1694f700 -1 osd.5 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.769869+0000 front 2019-12-09T22:23:41.812194+0000 (oldest deadline 2019-12-09T22:24:26.452359+0000) 2019-12-09T22:25:04.557 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:25:04.550+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:25:04.767 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:25:04.763+0000 1694f700 -1 osd.7 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:37.602413+0000 front 2019-12-09T22:23:37.607612+0000 (oldest deadline 2019-12-09T22:24:22.272145+0000) 2019-12-09T22:25:05.060 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:25:05.055+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e1004 v1004) 2019-12-09T22:25:05.256 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:25:05.251+0000 1694f700 -1 osd.3 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:40.028066+0000 front 2019-12-09T22:23:40.059867+0000 (oldest deadline 2019-12-09T22:24:24.977537+0000) 2019-12-09T22:25:05.513 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:25:05.511+0000 1694f700 -1 osd.4 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:39.296304+0000 front 2019-12-09T22:23:39.065500+0000 (oldest deadline 2019-12-09T22:24:21.944825+0000) 2019-12-09T22:25:05.674 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:25:05.595+0000 1694f700 -1 osd.2 1004 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:23:41.598129+0000 front 2019-12-09T22:23:41.606301+0000 (oldest deadline 2019-12-09T22:24:25.645573+0000) 2019-12-09T22:26:53.545 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:26:53.541+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:26:54.384 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:26:54.379+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:26:54.490 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:26:54.488+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:26:54.536 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:26:54.532+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:26:55.133 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:26:55.129+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:26:55.392 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:26:55.385+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:26:55.461 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:26:55.456+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:26:55.499 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:26:55.496+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:26:56.199 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:26:56.180+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:26:56.365 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:26:56.362+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:26:56.463 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:26:56.459+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:26:56.514 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:26:56.510+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:26:57.146 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:26:57.142+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:26:57.375 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:26:57.371+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:26:57.422 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:26:57.417+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:26:57.565 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:26:57.559+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:26:57.701 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:26:57.695+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:26:58.149 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:26:58.141+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:26:58.420 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:26:58.416+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:26:58.470 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:26:58.463+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:26:58.560 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:26:58.555+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:26:58.663 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:26:58.660+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:26:59.177 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:26:59.171+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:26:59.449 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:26:59.446+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:26:59.522 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:26:59.518+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:26:59.554 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:26:59.536+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:26:59.670 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:26:59.665+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:00.137 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:00.132+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:00.410 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:00.406+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:00.489 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:00.486+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:00.557 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:00.555+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:00.667 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:00.663+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:01.121 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:01.118+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:01.422 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:01.418+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:01.462 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:01.458+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:01.601 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:01.597+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:01.667 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:01.665+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:02.165 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:02.161+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:02.430 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:02.426+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:02.443 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:02.438+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:02.648 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:02.645+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:02.711 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:02.707+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:03.173 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:03.169+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:03.398 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:03.394+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:03.449 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:03.445+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:03.631 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:03.627+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:03.731 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:03.728+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:04.193 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:04.190+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:04.429 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:04.419+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:04.472 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:04.468+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:04.659 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:04.655+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:04.690 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:04.686+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:05.197 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:05.193+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:05.427 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:05.423+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:05.512 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:05.507+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:05.646 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:05.642+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:05.674 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:05.668+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:06.171 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:06.160+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:06.445 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:06.440+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:06.476 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:06.471+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:06.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:06.671+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:06.695 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:06.680+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:07.174 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:07.171+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:07.426 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:07.422+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:07.446 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:07.442+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:07.677 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:07.671+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:07.709 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:07.705+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:08.136 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:08.133+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:08.451 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:08.443+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:08.480 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:08.473+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:08.660 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:08.656+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:08.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:08.673+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:09.112 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:09.108+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:09.443 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:09.440+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:09.453 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:09.449+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:09.668 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:09.662+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:09.682 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:09.679+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:10.112 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:10.108+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:10.405 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:10.400+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:10.423 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:10.420+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:10.650 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:10.645+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:10.695 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:10.691+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:11.149 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:11.143+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:11.429 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:11.425+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:11.461 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:11.458+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:11.683 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:11.680+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:11.704 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:11.699+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:12.181 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:12.172+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:12.428 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:12.424+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:12.437 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:12.433+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:12.720 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:12.714+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:12.749 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:12.743+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:13.142 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:13.139+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:13.414 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:13.410+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:13.473 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:13.467+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:13.716 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:13.707+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:13.780 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:13.777+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:14.163 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:14.159+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:14.403 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:14.400+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:14.515 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:14.512+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:14.694 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:14.686+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:14.822 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:14.818+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:15.143 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:15.139+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:15.356 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:15.353+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:15.566 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:15.563+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:15.727 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:15.723+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:15.804 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:15.800+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:16.134 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:16.130+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:16.380 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:16.377+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:16.527 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:16.524+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:16.771 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:16.767+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:16.853 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:16.850+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:17.191 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:17.187+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:17.412 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:17.409+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:17.503 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:17.498+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:17.785 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:17.780+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:17.869 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:17.863+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:18.157 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:18.154+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:18.431 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:18.428+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:18.552 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:18.548+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:18.753 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:18.748+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:18.855 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:18.851+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:19.140 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:19.137+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:19.435 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:19.432+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:19.563 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:19.557+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:19.728 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:19.723+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:19.911 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:19.907+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:20.196 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:20.192+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:20.447 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:20.443+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:20.582 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:20.577+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:20.716 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:20.710+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:20.910 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:20.907+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:21.241 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:21.237+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:21.410 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:21.402+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:21.566 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:21.560+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:21.704 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:21.701+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:21.893 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:21.884+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:22.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:22.205+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:22.402 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:22.397+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:22.604 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:22.597+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:22.675 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:22.671+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:22.903 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:22.898+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:23.209 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:23.199+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:23.420 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:23.415+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:23.593 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:23.590+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:23.687 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:23.683+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:23.895 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:23.890+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:24.237 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:24.231+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:24.402 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:24.397+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:24.642 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:24.638+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:24.706 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:24.697+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:24.891 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:24.885+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:25.208 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:25.204+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:25.361 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:25.356+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:25.413 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:27:25.410+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e1012 v1012) 2019-12-09T22:27:25.640 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:25.636+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:25.700 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:25.678+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:25.863 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:25.859+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:26.210 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:26.208+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:26.319 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:26.315+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:26.622 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:26.619+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:26.673 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:26.668+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:26.862 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:26.858+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:27.224 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:27.219+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:27.276 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:27.271+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:27.676 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:27.671+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:27.715 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:27.711+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:27.870 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:27.867+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:28.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:28.259+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:28.271 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:28.268+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:28.677 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:28.672+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:28.714 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:28.707+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:28.839 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:28.835+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:29.297 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:29.291+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:29.311 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:29.307+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:29.694 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:29.690+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:29.738 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:29.734+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:29.898 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:29.884+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:30.278 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:30.274+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:30.344 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:30.339+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:30.434 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:27:30.431+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e1012 v1012) 2019-12-09T22:27:30.689 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:30.686+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:30.708 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:30.704+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:30.891 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:30.887+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:31.305 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:31.301+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:31.321 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:31.316+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:31.668 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:31.663+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:31.727 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:31.724+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:31.857 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:31.849+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:32.343 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:32.338+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:32.365 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:32.362+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:32.697 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:32.691+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:32.706 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:32.697+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:32.816 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:32.811+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:33.357 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:33.353+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:33.416 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:33.413+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:33.661 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:33.658+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:33.697 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:33.693+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:33.803 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:33.797+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:34.369 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:34.364+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:34.449 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:34.445+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:34.633 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:27:34.619+0000 1694f700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:10.892859+0000 front 2019-12-09T22:26:11.284102+0000 (oldest deadline 2019-12-09T22:26:53.702836+0000) 2019-12-09T22:27:34.686 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:34.680+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:27:34.849 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:27:34.846+0000 1694f700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.154147+0000 front 2019-12-09T22:26:09.152193+0000 (oldest deadline 2019-12-09T22:26:54.360358+0000) 2019-12-09T22:27:35.240 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:27:35.235+0000 1694f700 -1 osd.1 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.506380+0000 front 2019-12-09T22:26:11.517541+0000 (oldest deadline 2019-12-09T22:27:34.436664+0000) 2019-12-09T22:27:35.385 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:27:35.375+0000 1694f700 -1 osd.3 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:09.111966+0000 front 2019-12-09T22:26:08.782874+0000 (oldest deadline 2019-12-09T22:26:52.848652+0000) 2019-12-09T22:27:35.433 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:27:35.426+0000 1694f700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.424233+0000 front 2019-12-09T22:26:11.461406+0000 (oldest deadline 2019-12-09T22:26:54.892721+0000) 2019-12-09T22:27:35.492 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:27:35.488+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e1012 v1012) 2019-12-09T22:27:35.712 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:27:35.707+0000 1694f700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:26:11.688150+0000 front 2019-12-09T22:26:11.688953+0000 (oldest deadline 2019-12-09T22:26:56.961148+0000) 2019-12-09T22:28:20.491 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:28:20.395+0000 35f8f700 -1 osd.3 1016 build_incremental_map_msg missing incremental map 1016 2019-12-09T22:28:20.672 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:28:20.456+0000 36790700 -1 osd.3 1016 build_incremental_map_msg missing incremental map 1016 2019-12-09T22:28:20.690 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:28:20.492+0000 32788700 -1 osd.3 1016 build_incremental_map_msg missing incremental map 1016 2019-12-09T22:28:20.785 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:28:20.509+0000 35f8f700 -1 osd.3 1016 build_incremental_map_msg missing incremental map 1016 2019-12-09T22:28:20.871 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:28:20.568+0000 36790700 -1 osd.3 1016 build_incremental_map_msg missing incremental map 1016 2019-12-09T22:28:55.932 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:23:16.990 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:28:55.938 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:23:16.997 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:28:55.948 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:23:17.007 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:28:55.954 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:23:17.014 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:28:55.955 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:23:16.992 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:28:55.962 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:23:16.998 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:28:56.239 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:23:17.299 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:28:56.289 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:23:17.345 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:28:56.362 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:23:17.398 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:29:24.153 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:24.149+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:25.167 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:25.164+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:26.221 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:26.215+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:27.259 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:27.255+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:27.328 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:27.324+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:27.582 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:27.578+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:27.788 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:27.784+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:27.863 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:27.860+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:28.282 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:28.279+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:28.373 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:28.366+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:28.568 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:28.564+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:28.746 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:28.741+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:28.829 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:28.826+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:28.932 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:28.927+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:29.246 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:29.240+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:29.368 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:29.365+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:29.596 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:29.591+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:29.751 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:29.747+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:29.873 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:29.869+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:29.935 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:29.931+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:30.198 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:30.194+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:30.385 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:30.382+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:30.645 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:30.641+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:30.787 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:30.783+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:30.862 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:30.858+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:30.983 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:30.977+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:31.157 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:31.151+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:31.383 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:31.380+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:31.613 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:31.608+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:31.821 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:31.816+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:31.877 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:31.872+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:31.966 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:31.958+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:32.144 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:32.138+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:32.372 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:32.368+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:32.580 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:32.576+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:32.844 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:32.839+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:32.849 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:32.845+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:32.938 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:32.934+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:33.122 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:33.117+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:33.352 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:33.348+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:33.592 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:33.590+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:33.815 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:33.810+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:33.850 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:33.846+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:33.923 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:33.917+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:34.107 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:34.103+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:34.332 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:34.328+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:34.563 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:34.559+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:34.773 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:34.770+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:34.841 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:34.837+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:34.959 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:34.955+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:35.074 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:35.069+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:35.345 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:35.341+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:35.583 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:35.578+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:35.737 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:35.731+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:35.873 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:35.870+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:35.984 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:35.980+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:36.031 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:36.025+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:36.330 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:36.323+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:36.560 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:36.555+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:36.719 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:36.714+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:36.915 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:36.910+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:36.988 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:36.982+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:36.999 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:36.993+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:37.370 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:37.366+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:37.609 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:37.603+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:37.744 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:37.739+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:37.896 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:37.892+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:38.003 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:37.999+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:38.032 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:38.029+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:38.352 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:38.348+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:38.644 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:38.640+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:38.729 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:38.725+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:38.944 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:38.941+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:38.979 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:38.974+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:38.987 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:38.982+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:39.360 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:39.356+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:39.613 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:39.610+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:39.747 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:39.743+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:39.940 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:39.937+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:39.998 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:39.993+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:40.029 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:40.024+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:40.358 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:40.355+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:40.644 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:40.635+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:40.712 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:40.707+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:40.929 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:40.913+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:41.020 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:41.016+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:41.036 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:41.032+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:41.397 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:41.393+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:41.615 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:41.610+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:41.673 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:41.668+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:41.943 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:41.939+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:41.995 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:41.991+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:42.038 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:42.035+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:42.361 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:42.357+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:42.651 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:42.647+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:42.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:42.703+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:42.942 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:42.937+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:42.978 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:42.974+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:43.079 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:43.074+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:43.342 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:43.339+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:43.623 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:43.619+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:43.680 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:43.675+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:43.971 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:43.962+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:43.977 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:43.970+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:44.033 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:44.028+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:44.344 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:44.337+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:44.580 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:44.577+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:44.685 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:44.679+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:44.935 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:44.932+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:44.988 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:44.985+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:45.057 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:45.053+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:45.362 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:45.358+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:45.612 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:45.608+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:45.695 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:45.690+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:45.933 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:45.930+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:45.969 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:45.966+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:46.026 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:46.022+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:46.395 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:46.391+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:46.611 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:46.607+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:46.708 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:46.692+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:46.904 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:46.898+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:47.008 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:47.003+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:47.031 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:47.017+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:47.365 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:47.361+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:47.648 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:47.642+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:47.672 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:47.668+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:47.868 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:47.863+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:47.985 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:47.982+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:48.045 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:48.041+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:48.413 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:48.408+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:48.645 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:48.641+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:48.672 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:48.665+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:48.839 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:48.832+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:48.976 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:48.971+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:49.067 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:49.061+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:49.442 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:49.439+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:49.622 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:49.618+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:49.663 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:49.658+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:49.875 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:49.871+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:49.968 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:49.955+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:50.058 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:50.053+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:50.422 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:50.417+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:50.649 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:50.645+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:50.660 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:50.656+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:50.904 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:50.899+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:50.981 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:50.977+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:51.087 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:51.082+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:51.436 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:51.432+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:51.633 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:51.629+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:51.657 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:51.654+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:51.886 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:51.883+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:51.946 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:51.941+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:52.081 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:52.078+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:52.461 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:52.457+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:52.667 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:52.663+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:52.682 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:52.678+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:52.857 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:52.853+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:52.980 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:52.973+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:53.043 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:53.037+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:53.438 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:53.434+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:53.641 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:53.634+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:53.666 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:53.662+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:53.836 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:53.833+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:54.007 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:54.003+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:54.013 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:54.009+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:54.400 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:54.395+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:54.593 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:54.589+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:54.645 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:54.641+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:54.859 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:54.855+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:54.972 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:54.967+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:55.043 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:55.039+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:55.406 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:55.402+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:55.639 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:55.636+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:55.640 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:55.637+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:55.853 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:55.848+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:56.022 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:56.019+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:56.052 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:56.049+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:56.395 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:56.391+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:56.658 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:56.653+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:56.663 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:56.658+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:56.844 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:56.840+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:57.018 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:57.014+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:57.072 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:57.068+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:57.425 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:57.420+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:57.610 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:57.607+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:57.707 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:57.703+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:57.823 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:57.820+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:58.041 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:58.037+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:58.101 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:58.099+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:58.438 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:58.434+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:58.618 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:58.614+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:58.743 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:58.739+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:58.873 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:58.869+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:29:59.039 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:29:59.033+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:29:59.114 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:29:59.110+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:29:59.457 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:29:59.454+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:29:59.601 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:29:59.573+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:29:59.716 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:29:59.713+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:29:59.902 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:29:59.898+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:30:00.021 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:30:00.009+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:30:00.130 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:30:00.127+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:30:00.502 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:30:00.497+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:30:00.622 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:30:00.619+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:30:00.744 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:30:00.737+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:30:00.918 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:30:00.915+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:30:00.973 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:30:00.970+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e1019 v1019) 2019-12-09T22:30:01.068 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:30:01.064+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:30:01.083 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:30:01.080+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:30:01.486 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:30:01.482+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:30:01.604 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:30:01.601+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:30:01.711 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:30:01.707+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:30:01.925 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:30:01.922+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:30:02.040 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:30:02.037+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:30:02.065 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:30:02.062+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:30:02.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:30:02.453+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:30:02.629 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:30:02.622+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:30:02.744 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:30:02.740+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:30:02.961 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:30:02.952+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:30:03.020 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:30:03.016+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:30:03.058 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:30:03.054+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:30:03.427 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:30:03.423+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:30:03.607 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:30:03.604+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:30:03.775 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:30:03.772+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:30:03.975 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:30:03.972+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:30:03.994 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:30:03.992+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:30:04.067 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:30:04.062+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:30:04.449 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:30:04.441+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:30:04.593 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:30:04.590+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:30:04.768 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:30:04.764+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:30:04.948 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:30:04.944+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:30:05.008 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:30:05.005+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:30:05.029 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:30:05.021+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:30:05.456 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:30:05.447+0000 1694f700 -1 osd.7 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.228630+0000 front 2019-12-09T22:28:42.226960+0000 (oldest deadline 2019-12-09T22:29:26.525068+0000) 2019-12-09T22:30:05.609 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:30:05.605+0000 1694f700 -1 osd.1 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.514141+0000 front 2019-12-09T22:28:41.395827+0000 (oldest deadline 2019-12-09T22:29:27.250776+0000) 2019-12-09T22:30:05.722 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:30:05.718+0000 1694f700 -1 osd.5 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:41.808430+0000 front 2019-12-09T22:28:41.782223+0000 (oldest deadline 2019-12-09T22:29:27.062659+0000) 2019-12-09T22:30:05.942 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:30:05.939+0000 1694f700 -1 osd.3 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.294232+0000 front 2019-12-09T22:28:42.376980+0000 (oldest deadline 2019-12-09T22:29:23.935076+0000) 2019-12-09T22:30:05.975 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:30:05.972+0000 1694f700 -1 osd.2 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:42.032315+0000 front 2019-12-09T22:28:42.058676+0000 (oldest deadline 2019-12-09T22:29:27.907660+0000) 2019-12-09T22:30:06.008 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:30:06.004+0000 1694f700 -1 osd.4 1019 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:28:43.431438+0000 front 2019-12-09T22:28:43.487134+0000 (oldest deadline 2019-12-09T22:29:27.832049+0000) 2019-12-09T22:30:06.041 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:30:06.038+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 43sec e1019 v1019) 2019-12-09T22:30:36.462 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:30:36.460+0000 1694f700 -1 osd.5 1021 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:133192 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 5419134048 gen 77] snapc 0=[] ondisk+write+known_if_redirected e1020) 2019-12-09T22:30:54.016 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:30:53.975+0000 36f91700 -1 osd.0 1024 build_incremental_map_msg missing incremental map 1024 2019-12-09T22:30:54.108 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:30:54.046+0000 32788700 -1 osd.0 1024 build_incremental_map_msg missing incremental map 1024 2019-12-09T22:30:54.415 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:30:54.288+0000 36790700 -1 osd.0 1024 build_incremental_map_msg missing incremental map 1024 2019-12-09T22:30:54.720 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:30:54.707+0000 31f87700 -1 osd.0 1025 build_incremental_map_msg missing incremental map 1025 2019-12-09T22:30:54.751 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:30:54.736+0000 31f87700 -1 osd.0 1025 build_incremental_map_msg missing incremental map 1025 2019-12-09T22:30:54.854 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:30:54.800+0000 3378a700 -1 osd.0 1025 build_incremental_map_msg missing incremental map 1025 2019-12-09T22:30:55.137 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:30:55.119+0000 3578e700 -1 osd.0 1025 build_incremental_map_msg missing incremental map 1025 2019-12-09T22:30:55.142 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:30:55.132+0000 3578e700 -1 osd.0 1025 build_incremental_map_msg missing incremental map 1025 2019-12-09T22:30:57.829 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:30:57.823+0000 34f8d700 -1 osd.0 1026 build_incremental_map_msg missing incremental map 1024 2019-12-09T22:30:57.830 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:30:57.824+0000 34f8d700 -1 osd.0 1026 build_incremental_map_msg missing incremental map 1025 2019-12-09T22:30:57.915 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:30:57.907+0000 38f95700 -1 osd.0 1026 build_incremental_map_msg missing incremental map 1024 2019-12-09T22:30:57.916 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:30:57.907+0000 38f95700 -1 osd.0 1026 build_incremental_map_msg missing incremental map 1025 2019-12-09T22:31:41.663 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:26:02.723 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:31:41.670 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:26:02.729 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:31:41.715 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:26:02.775 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:31:41.738 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:26:02.797 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:31:41.741 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:26:02.778 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:31:41.745 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:26:02.781 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:31:41.923 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:26:02.959 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:31:41.949 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:26:03.008 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:31:42.001 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:26:03.060 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:31:56.312 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:31:56.306+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:31:56.865 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:31:56.860+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:31:57.350 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:31:57.343+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:31:57.911 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:31:57.907+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:31:58.308 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:31:58.303+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:31:58.612 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:31:58.609+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:31:58.862 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:31:58.858+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:31:58.865 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:31:58.862+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:31:59.354 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:31:59.350+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:31:59.579 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:31:59.574+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:31:59.855 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:31:59.847+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:31:59.894 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:31:59.891+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:31:59.941 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:31:59.936+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:00.077 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:00.074+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:00.386 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:00.382+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:00.541 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:00.538+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:00.858 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:00.853+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:00.883 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:00.879+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:00.992 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:00.987+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:01.049 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:01.040+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:01.445 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:01.432+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:01.556 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:01.552+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:01.841 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:01.838+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:01.875 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:01.872+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:01.969 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:01.964+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:02.025 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:02.022+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:02.481 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:02.476+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:02.556 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:02.552+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:02.865 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:02.860+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:02.891 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:02.887+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:02.983 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:02.980+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:03.010 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:03.005+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:03.440 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:03.436+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:03.534 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:03.530+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:03.848 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:03.836+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:03.876 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:03.870+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:03.966 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:03.961+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:04.024 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:04.021+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:04.467 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:04.463+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:04.583 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:04.579+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:04.834 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:04.831+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:04.836 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:04.832+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:05.002 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:04.999+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:05.004 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:05.001+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:05.446 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:05.443+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:05.589 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:05.583+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:05.813 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:05.808+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:05.851 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:05.847+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:05.980 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:05.976+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:06.045 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:06.040+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:06.485 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:06.482+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:06.620 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:06.616+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:06.845 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:06.842+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:06.885 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:06.881+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:07.003 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:06.999+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:07.005 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:06.999+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:07.507 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:07.502+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:07.584 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:07.580+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:07.811 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:07.808+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:07.934 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:07.928+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:07.962 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:07.959+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:08.053 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:08.048+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:08.498 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:08.494+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:08.573 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:08.567+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:08.806 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:08.802+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:08.920 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:08.916+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:08.963 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:08.959+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:09.054 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:09.050+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:09.473 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:09.469+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:09.571 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:09.567+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:09.771 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:09.764+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:09.924 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:09.921+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:10.011 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:10.006+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:10.017 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:10.013+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:10.508 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:10.504+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:10.547 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:10.543+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:10.741 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:10.736+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:10.946 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:10.943+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:11.054 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:11.050+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:11.063 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:11.059+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:11.546 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:11.532+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:11.547 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:11.543+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:11.774 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:11.770+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:11.920 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:11.917+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:12.016 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:12.012+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:12.018 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:12.014+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:12.537 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:12.534+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:12.547 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:12.540+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:12.762 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:12.758+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:12.950 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:12.947+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:13.013 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:13.010+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:13.029 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:13.026+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:13.500 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:13.497+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:13.559 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:13.555+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:13.767 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:13.764+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:14.001 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:13.998+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:14.014 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:14.010+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:14.069 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:14.060+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:14.459 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:14.454+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:14.533 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:14.528+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:14.727 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:14.723+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:15.007 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:15.002+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:15.043 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:15.032+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:15.044 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:15.040+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:15.466 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:15.462+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:15.550 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:15.532+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:15.699 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:15.694+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:15.992 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:15.990+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:16.020 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:16.016+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:16.095 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:16.091+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:16.479 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:16.476+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:16.579 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:16.573+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:16.667 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:16.663+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:16.979 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:16.976+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:17.065 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:17.056+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:17.067 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:17.064+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:17.441 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:17.437+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:17.563 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:17.559+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:17.651 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:17.648+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:18.008 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:18.003+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:18.073 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:18.068+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:18.100 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:18.095+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:18.486 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:18.483+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:18.573 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:18.568+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:18.678 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:18.675+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:19.032 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:19.026+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:19.078 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:19.075+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:19.080 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:19.076+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:19.503 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:19.500+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:19.576 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:19.572+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:19.652 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:19.649+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:20.024 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:20.021+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:20.071 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:20.067+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:20.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:20.127+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:20.483 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:20.480+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:20.581 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:20.574+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:20.695 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:20.691+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:20.994 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:20.991+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:21.070 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:21.066+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:21.105 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:21.101+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:21.486 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:21.483+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:21.598 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:21.594+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:21.745 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:21.742+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:21.948 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:21.944+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:22.044 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:22.041+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:22.132 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:22.125+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:22.473 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:22.470+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:22.647 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:22.644+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:22.790 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:22.787+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:22.904 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:22.900+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:23.023 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:23.020+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:23.095 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:23.092+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:23.480 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:23.475+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:23.614 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:23.611+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:23.828 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:23.824+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:23.896 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:23.892+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:24.003 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:23.999+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:24.107 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:24.103+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:24.492 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:24.486+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:24.662 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:24.659+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:24.868 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:24.865+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:24.894 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:24.891+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:25.050 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:25.047+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:25.082 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:25.078+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:25.497 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:25.493+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:25.652 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:25.648+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:25.880 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:25.877+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:25.894 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:25.890+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:26.035 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:26.028+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:26.124 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:26.120+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:26.493 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:26.489+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:26.658 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:26.654+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:26.896 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:26.892+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:26.920 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:26.916+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:27.047 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:27.043+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:27.177 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:27.173+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:27.447 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:27.443+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:27.655 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:27.652+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:27.862 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:27.860+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:27.890 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:27.887+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:28.047 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:28.043+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:28.207 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:28.204+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:28.496 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:28.493+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:28.642 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:28.640+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:28.878 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:28.871+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:28.933 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:28.930+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:29.080 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:29.076+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:29.198 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:29.194+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:29.466 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:29.463+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:29.675 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:29.672+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:29.908 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:29.905+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:29.916 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:29.913+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:30.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:30.054+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:30.225 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:30.221+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:30.509 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:30.505+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:30.652 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:30.648+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:30.911 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:30.907+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:30.967 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:30.963+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:31.096 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:31.093+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:31.183 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:31.178+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:31.491 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:31.487+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:31.682 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:31.678+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:31.691 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:32:31.689+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e1027 v1027) 2019-12-09T22:32:31.913 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:31.910+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:31.971 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:31.968+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:32.116 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:32.107+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:32.227 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:32.223+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:32.479 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:32.475+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:32.668 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:32.665+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:32.893 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:32.890+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:32.939 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:32.937+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:33.075 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:33.071+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:33.187 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:33.183+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:33.485 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:33.482+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:33.695 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:33.691+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:33.892 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:33.888+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:33.926 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:33.923+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:34.068 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:34.065+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:34.240 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:34.236+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:34.470 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:34.465+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:34.686 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:34.682+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:34.921 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:34.918+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:34.942 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:34.939+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:35.026 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:35.023+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:35.286 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:35.282+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:35.497 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:35.493+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:35.668 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:35.657+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:35.937 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:35.934+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:35.996 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:35.985+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:36.059 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:36.055+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:36.321 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:36.318+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:36.496 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:36.486+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:36.676 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:36.670+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:36.704 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:32:36.703+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e1027 v1027) 2019-12-09T22:32:36.944 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:36.941+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:37.001 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:36.999+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:37.091 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:37.087+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:37.288 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:37.284+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:37.479 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:37.475+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:37.699 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:37.695+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:37.958 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:37.954+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:38.017 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:38.012+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:38.117 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:38.113+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:38.255 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:38.251+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:38.446 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:38.441+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:38.737 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:38.734+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:38.921 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:38.915+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:39.050 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:39.046+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:39.168 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:39.163+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:39.254 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:39.249+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:39.497 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:39.493+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:39.712 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:39.706+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:39.925 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:39.920+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:40.024 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:40.019+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:40.174 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:40.170+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:40.244 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:40.240+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:40.537 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:40.532+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:40.700 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:40.691+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:40.912 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:40.907+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:32:41.023 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:32:41.017+0000 1694f700 -1 osd.1 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.633995+0000 front 2019-12-09T22:31:14.674424+0000 (oldest deadline 2019-12-09T22:31:59.823260+0000) 2019-12-09T22:32:41.156 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:32:41.152+0000 1694f700 -1 osd.5 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109422+0000 front 2019-12-09T22:31:14.818729+0000 (oldest deadline 2019-12-09T22:31:56.435629+0000) 2019-12-09T22:32:41.288 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:32:41.283+0000 1694f700 -1 osd.4 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:14.683127+0000 front 2019-12-09T22:31:15.697834+0000 (oldest deadline 2019-12-09T22:31:59.277612+0000) 2019-12-09T22:32:41.534 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:32:41.529+0000 1694f700 -1 osd.3 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:15.109218+0000 front 2019-12-09T22:31:15.055586+0000 (oldest deadline 2019-12-09T22:31:55.967865+0000) 2019-12-09T22:32:41.674 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:32:41.671+0000 1694f700 -1 osd.7 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.769327+0000 front 2019-12-09T22:31:12.481129+0000 (oldest deadline 2019-12-09T22:31:57.763922+0000) 2019-12-09T22:32:41.793 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:32:41.787+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e1027 v1027) 2019-12-09T22:32:41.962 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:32:41.957+0000 1694f700 -1 osd.2 1027 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:31:12.545755+0000 front 2019-12-09T22:31:12.544723+0000 (oldest deadline 2019-12-09T22:31:57.811050+0000) 2019-12-09T22:33:04.025 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:27:25.084 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:04.031 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:27:25.090 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:04.042 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:27:25.101 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:04.045 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:27:25.104 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:04.068 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:27:25.104 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:04.095 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:27:25.132 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:04.141 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:27:25.200 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:04.176 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:27:25.235 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:04.297 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:27:25.333 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:12.044 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:27:33.102 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:12.097 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:27:33.157 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:12.105 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:27:33.164 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:12.108 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:27:33.168 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:12.129 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:27:33.187 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:12.131 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:27:33.189 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:12.136 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:27:33.173 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:12.143 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:27:33.179 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:12.181 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:27:33.217 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:33:27.160 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:33:27.137+0000 3578e700 -1 osd.0 1032 build_incremental_map_msg missing incremental map 1032 2019-12-09T22:33:27.599 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:33:27.568+0000 31786700 -1 osd.0 1032 build_incremental_map_msg missing incremental map 1032 2019-12-09T22:33:28.277 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:33:28.074+0000 3578e700 -1 osd.0 1033 build_incremental_map_msg missing incremental map 1033 2019-12-09T22:33:28.349 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:33:28.166+0000 31f87700 -1 osd.0 1033 build_incremental_map_msg missing incremental map 1033 2019-12-09T22:33:28.785 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:33:28.639+0000 34f8d700 -1 osd.0 1033 build_incremental_map_msg missing incremental map 1033 2019-12-09T22:33:29.544 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:33:29.349+0000 34f8d700 -1 osd.0 1034 build_incremental_map_msg missing incremental map 1032 2019-12-09T22:33:29.620 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:33:29.350+0000 34f8d700 -1 osd.0 1034 build_incremental_map_msg missing incremental map 1033 2019-12-09T22:33:29.621 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:33:29.352+0000 34f8d700 -1 osd.0 1034 build_incremental_map_msg missing incremental map 1032 2019-12-09T22:33:29.621 INFO:tasks.ceph.osd.0.smithi146.stderr:2019-12-09T22:33:29.352+0000 34f8d700 -1 osd.0 1034 build_incremental_map_msg missing incremental map 1033 2019-12-09T22:34:29.977 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:29.973+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:30.530 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:30.526+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:30.935 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:30.930+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:31.342 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:31.338+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:31.346 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:31.341+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:31.557 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:31.552+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:31.988 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:31.984+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:32.333 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:32.330+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:32.354 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:32.350+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:32.594 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:32.591+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:32.660 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:32.657+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:32.994 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:32.992+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:33.183 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:33.180+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:33.367 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:33.362+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:33.383 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:33.379+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:33.569 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:33.565+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:33.633 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:33.630+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:33.995 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:33.991+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:34.187 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:34.184+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:34.349 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:34.344+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:34.385 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:34.382+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:34.622 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:34.618+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:34.667 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:34.663+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:35.046 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:35.042+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:35.169 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:35.165+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:35.352 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:35.348+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:35.370 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:35.366+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:35.636 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:35.632+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:35.645 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:35.641+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:36.075 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:36.071+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:36.124 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:36.121+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:36.341 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:36.335+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:36.352 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:36.347+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:36.624 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:36.619+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:36.633 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:36.630+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:37.083 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:37.079+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:37.132 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:37.129+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:37.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:37.332+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:37.383 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:37.380+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:37.627 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:37.623+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:37.651 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:37.647+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:38.045 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:38.041+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:38.169 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:38.166+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:38.347 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:38.342+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:38.378 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:38.375+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:38.634 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:38.630+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:38.661 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:38.657+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:39.034 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:39.030+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:39.177 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:39.172+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:39.395 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:39.390+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:39.416 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:39.412+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:39.619 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:39.608+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:39.666 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:39.663+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:40.038 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:40.034+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:40.203 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:40.200+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:40.382 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:40.379+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:40.400 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:40.396+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:40.586 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:40.582+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:40.625 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:40.620+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:41.004 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:41.000+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:41.160 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:41.156+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:41.378 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:41.375+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:41.439 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:41.435+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:41.598 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:41.595+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:41.602 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:41.597+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:41.980 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:41.976+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:42.193 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:42.186+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:42.392 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:42.388+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:42.482 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:42.478+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:42.636 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:42.633+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:42.648 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:42.643+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:42.969 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:42.965+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:43.171 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:43.168+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:43.432 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:43.428+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:43.520 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:43.516+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:43.677 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:43.673+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:43.689 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:43.685+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:43.962 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:43.959+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:44.135 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:44.131+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:44.475 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:44.472+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:44.563 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:44.559+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:44.672 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:44.669+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:44.720 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:44.714+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:44.983 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:44.979+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:45.157 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:45.153+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:45.441 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:45.437+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:45.557 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:45.552+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:45.677 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:45.672+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:45.717 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:45.713+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:46.020 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:46.016+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:46.132 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:46.127+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:46.403 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:46.399+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:46.574 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:46.570+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:46.641 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:46.637+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:46.695 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:46.690+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:47.049 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:47.045+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:47.106 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:47.101+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:47.418 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:47.413+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:47.592 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:47.587+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:47.636 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:47.633+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:47.729 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:47.724+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:48.063 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:48.059+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:48.149 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:48.141+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:48.404 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:48.400+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:48.586 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:48.582+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:48.672 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:48.666+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:48.779 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:48.774+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:49.075 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:49.072+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:49.186 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:49.181+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:49.443 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:49.439+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:49.545 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:49.541+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:49.668 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:49.664+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:49.735 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:49.730+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:50.087 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:50.084+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:50.148 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:50.143+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:50.497 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:50.481+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:50.543 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:50.539+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:50.711 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:50.707+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:50.764 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:50.758+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:51.100 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:51.095+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:51.197 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:51.193+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:51.511 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:51.507+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:51.529 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:51.524+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:51.761 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:51.758+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:51.765 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:51.761+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:52.114 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:52.109+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:52.240 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:52.235+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:52.540 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:52.536+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:52.562 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:52.557+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:52.761 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:52.757+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:52.815 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:52.810+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:53.077 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:53.071+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:53.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:53.259+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:53.530 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:53.527+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:53.598 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:53.594+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:53.750 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:53.746+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:53.815 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:53.810+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:54.052 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:54.049+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:54.264 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:54.259+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:54.538 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:54.535+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:54.613 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:54.609+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:54.763 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:54.759+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:54.815 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:54.811+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:55.037 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:55.033+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:55.285 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:55.281+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:55.521 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:55.518+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:55.628 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:55.623+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:55.732 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:55.727+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:55.869 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:55.864+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:56.041 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:56.036+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:56.304 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:56.300+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:56.549 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:56.546+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:56.614 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:56.611+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:56.744 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:56.740+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:56.880 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:56.876+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:57.049 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:57.046+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:57.311 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:57.307+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:57.522 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:57.518+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:57.603 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:57.598+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:57.745 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:57.741+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:57.885 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:57.881+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:58.012 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:58.009+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:58.282 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:58.278+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:58.497 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:58.492+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:58.562 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:58.558+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:58.703 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:58.698+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:58.900 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:58.896+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:34:59.028 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:34:59.024+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:34:59.294 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:34:59.289+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:34:59.531 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:34:59.527+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:34:59.532 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:34:59.529+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:34:59.731 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:34:59.726+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:34:59.914 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:34:59.910+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:00.058 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:00.053+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:00.329 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:00.323+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:00.531 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:00.527+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:00.569 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:35:00.564+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:35:00.728 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:35:00.725+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:35:00.960 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:35:00.955+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:01.102 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:01.097+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:01.368 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:01.365+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:01.561 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:01.557+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:01.599 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:35:01.594+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:35:01.763 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:35:01.760+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:35:01.925 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:35:01.921+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:02.115 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:02.111+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:02.301 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:35:02.295+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e1035 v1035) 2019-12-09T22:35:02.348 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:02.343+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:02.548 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:02.544+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:02.577 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:35:02.572+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:35:02.819 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:35:02.815+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:35:02.892 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:35:02.887+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:03.162 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:03.159+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:03.382 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:03.376+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:03.552 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:03.548+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:03.587 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:35:03.583+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:35:03.785 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:35:03.780+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:35:03.858 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:35:03.854+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:04.213 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:04.209+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:04.336 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:04.332+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:04.525 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:04.520+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:04.547 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:35:04.541+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:35:04.789 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:35:04.785+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:35:04.870 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:35:04.866+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:05.267 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:05.263+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:05.380 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:05.375+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:05.511 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:35:05.506+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:35:05.518 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:05.515+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:05.812 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:35:05.808+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:35:05.848 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:35:05.844+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:06.241 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:06.236+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:06.413 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:06.408+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:06.511 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:06.507+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:06.543 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:35:06.538+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:35:06.811 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:35:06.808+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:35:06.834 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:35:06.830+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:07.277 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:07.273+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:07.310 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:35:07.307+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e1035 v1035) 2019-12-09T22:35:07.449 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:07.445+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:07.466 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:07.462+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:07.569 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:35:07.565+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:35:07.777 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:35:07.770+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:35:07.825 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:35:07.821+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:08.314 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:08.310+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:08.448 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:08.444+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:08.451 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:08.448+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:08.571 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:35:08.568+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:35:08.798 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:35:08.794+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:35:08.810 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:35:08.806+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:09.277 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:09.273+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:09.459 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:09.456+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:09.486 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:09.481+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:09.614 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:35:09.610+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:35:09.807 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:35:09.800+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:35:09.832 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:35:09.827+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:10.298 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:10.293+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:10.473 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:10.469+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:10.488 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:10.483+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:10.612 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:35:10.608+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:35:10.767 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:35:10.763+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:35:10.873 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:35:10.871+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:11.283 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:11.279+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:11.474 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:11.470+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:11.485 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:11.480+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:11.581 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:35:11.578+0000 1694f700 -1 osd.1 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:47.424216+0000 front 2019-12-09T22:33:47.435400+0000 (oldest deadline 2019-12-09T22:34:30.900672+0000) 2019-12-09T22:35:11.784 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:35:11.781+0000 1694f700 -1 osd.5 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:45.552962+0000 front 2019-12-09T22:33:45.543280+0000 (oldest deadline 2019-12-09T22:34:29.605062+0000) 2019-12-09T22:35:11.917 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:35:11.914+0000 1694f700 -1 osd.2 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:46.438226+0000 front 2019-12-09T22:33:46.440418+0000 (oldest deadline 2019-12-09T22:34:32.275081+0000) 2019-12-09T22:35:12.323 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:35:12.318+0000 1694f700 -1 osd.7 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.353213+0000 front 2019-12-09T22:33:48.422623+0000 (oldest deadline 2019-12-09T22:34:29.961001+0000) 2019-12-09T22:35:12.373 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:35:12.369+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 42sec e1035 v1035) 2019-12-09T22:35:12.458 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:12.453+0000 1694f700 -1 osd.3 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:48.797835+0000 front 2019-12-09T22:33:48.886910+0000 (oldest deadline 2019-12-09T22:34:32.242288+0000) 2019-12-09T22:35:12.501 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:35:12.497+0000 1694f700 -1 osd.4 1035 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:33:44.829333+0000 front 2019-12-09T22:33:44.918671+0000 (oldest deadline 2019-12-09T22:34:30.692012+0000) 2019-12-09T22:35:56.276 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:56.063+0000 35f8f700 -1 osd.3 1039 build_incremental_map_msg missing incremental map 1039 2019-12-09T22:35:56.359 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:56.092+0000 35f8f700 -1 osd.3 1039 build_incremental_map_msg missing incremental map 1039 2019-12-09T22:35:56.365 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:56.113+0000 32788700 -1 osd.3 1039 build_incremental_map_msg missing incremental map 1039 2019-12-09T22:35:56.406 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:35:56.217+0000 36790700 -1 osd.3 1039 build_incremental_map_msg missing incremental map 1039 2019-12-09T22:37:00.247 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:00.243+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:00.659 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:00.655+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:01.224 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:01.221+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:01.675 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:01.671+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:02.124 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:02.119+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:02.218 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:02.212+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:02.636 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:02.629+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:03.149 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:03.143+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:03.200 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:03.191+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:03.219 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:03.215+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:03.608 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:03.603+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:04.164 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:04.154+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:04.224 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:04.219+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:04.233 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:04.228+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:04.253 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:04.248+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:04.600 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:04.596+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:05.151 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:05.147+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:05.200 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:05.195+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:05.212 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:05.203+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:05.303 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:05.298+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:05.649 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:05.644+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:06.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:06.132+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:06.174 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:06.170+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:06.199 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:06.195+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:06.278 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:06.274+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:06.675 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:06.669+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:07.138 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:07.134+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:07.178 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:07.174+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:07.220 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:07.213+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:07.299 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:07.295+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:07.629 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:07.623+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:08.111 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:08.107+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:08.179 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:08.173+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:08.216 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:08.211+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:08.285 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:08.278+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:08.599 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:08.594+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:09.115 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:09.110+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:09.138 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:09.133+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:09.229 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:09.225+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:09.309 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:09.305+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:09.619 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:09.613+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:10.109 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:10.103+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:10.119 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:10.115+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:10.188 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:10.185+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:10.287 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:10.284+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:10.665 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:10.660+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:11.088 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:11.083+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:11.141 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:11.136+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:11.215 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:11.212+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:11.338 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:11.334+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:11.642 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:11.638+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:12.111 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:12.107+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:12.139 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:12.135+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:12.209 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:12.204+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:12.306 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:12.302+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:12.674 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:12.669+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:13.133 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:13.129+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:13.134 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:13.130+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:13.239 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:13.235+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:13.352 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:13.348+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:13.721 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:13.716+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:14.135 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:14.131+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:14.165 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:14.161+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:14.195 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:14.191+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:14.332 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:14.329+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:14.739 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:14.733+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:15.147 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:15.142+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:15.187 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:15.182+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:15.211 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:15.207+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:15.312 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:15.308+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:15.772 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:15.768+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:15.814 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:15.808+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:16.117 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:16.114+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:16.194 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:16.190+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:16.215 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:16.211+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:16.284 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:16.280+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:16.771 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:16.767+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:16.822 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:16.818+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:17.130 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:17.127+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:17.155 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:17.151+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:17.232 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:17.228+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:17.263 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:17.260+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:17.759 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:17.755+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:17.801 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:31:38.860 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:37:17.810 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:31:38.869 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:37:17.819 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:31:38.876 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:37:17.825 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:31:38.880 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:37:17.833 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:31:38.863 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:37:17.839 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:31:38.872 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:37:17.847 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:17.844+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:18.046 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:31:39.105 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:37:18.079 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:31:39.138 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:37:18.130 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:18.127+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:18.173 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:31:39.209 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:37:18.180 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:18.174+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:18.277 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:18.274+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:18.284 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:18.282+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:18.795 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:18.791+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:18.810 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:18.806+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:19.091 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:19.087+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:19.163 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:19.160+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:19.272 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:19.269+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:19.273 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:19.271+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:19.769 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:19.766+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:19.818 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:19.815+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:20.109 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:20.107+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:20.166 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:20.162+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:20.270 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:20.267+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:20.315 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:20.312+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:20.756 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:20.752+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:20.788 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:20.784+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:21.151 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:21.148+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:21.166 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:21.163+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:21.281 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:21.274+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:21.281 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:21.274+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:21.720 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:21.715+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:21.797 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:21.793+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:22.130 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:22.127+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:22.177 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:22.173+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:22.273 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:22.268+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:22.290 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:22.285+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:22.765 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:22.761+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:22.819 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:22.816+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:23.134 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:23.130+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:23.187 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:23.183+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:23.259 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:23.255+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:23.317 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:23.313+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:23.721 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:23.718+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:23.776 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:23.772+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:24.153 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:24.150+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:24.233 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:24.230+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:24.240 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:24.236+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:24.307 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:24.303+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:24.704 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:24.701+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:24.787 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:24.784+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:25.197 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:25.194+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:25.237 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:25.234+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:25.299 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:25.289+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:25.306 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:25.303+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:25.665 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:25.660+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:25.818 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:25.809+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:26.230 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:26.227+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:26.241 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:26.236+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:26.263 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:26.257+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:26.298 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:26.290+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:26.661 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:26.656+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:26.805 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:26.797+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:27.219 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:27.216+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:27.273 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:27.269+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:27.283 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:27.273+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:27.284 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:27.270+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:27.672 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:27.665+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:27.767 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:27.761+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:28.240 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:28.235+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:28.273 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:28.267+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:28.281 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:28.274+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:28.322 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:28.319+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:28.663 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:28.658+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:28.794 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:28.786+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:29.273 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:29.255+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:29.292 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:29.287+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:29.297 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:37:29.293+0000 1694f700 -1 osd.2 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.487794+0000 front 2019-12-09T22:36:17.440861+0000 (oldest deadline 2019-12-09T22:36:59.569918+0000) 2019-12-09T22:37:29.344 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:29.340+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:29.689 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:29.685+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:29.843 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:29.839+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:30.278 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:30.274+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:30.329 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:30.324+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:30.398 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:30.393+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:30.666 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:30.659+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:30.831 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:30.826+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:31.248 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:31.243+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:31.285 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:31.281+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:31.372 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:31.367+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:31.678 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:31.675+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:31.802 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:31.797+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:32.273 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:32.269+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:32.296 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:32.293+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:32.362 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:32.358+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:32.706 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:32.703+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:32.760 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:37:32.756+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e1042 v1042) 2019-12-09T22:37:32.806 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:32.763+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:33.281 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:33.277+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:33.343 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:33.340+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:33.413 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:33.410+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:33.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:33.704+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:33.734 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:33.729+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:34.288 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:34.276+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:34.362 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:34.359+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:34.393 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:34.386+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:34.711 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:34.706+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:34.712 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:34.707+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:35.332 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:35.326+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:35.385 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:35.376+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:35.403 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:35.396+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:35.721 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:35.715+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:35.739 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:35.734+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:36.294 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:36.289+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:36.359 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:36.355+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:36.409 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:36.404+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:36.757 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:36.749+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:36.775 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:36.769+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:37.303 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:37.298+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:37.329 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:37.324+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:37.437 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:37.431+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:37.761 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:37.756+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:37.772 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:37:37.770+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e1042 v1042) 2019-12-09T22:37:37.779 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:37.774+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:38.321 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:38.317+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:38.336 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:38.333+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:38.475 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:38.470+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:38.716 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:38.713+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:38.767 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:38.764+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:39.322 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:39.319+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:39.381 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:39.377+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:39.504 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:39.501+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:39.711 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:39.707+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:39.749 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:39.746+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:40.353 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:40.346+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:40.354 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:40.346+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:40.499 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:40.494+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:40.733 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:40.728+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:40.752 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:40.749+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:41.383 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:41.368+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:41.389 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:41.385+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:41.553 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:41.547+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:41.729 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:41.722+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:41.786 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:41.781+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:42.364 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:37:42.354+0000 1694f700 -1 osd.4 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.760150+0000 front 2019-12-09T22:36:17.985731+0000 (oldest deadline 2019-12-09T22:37:01.472251+0000) 2019-12-09T22:37:42.424 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:37:42.419+0000 1694f700 -1 osd.5 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.026323+0000 front 2019-12-09T22:36:18.055437+0000 (oldest deadline 2019-12-09T22:37:03.288201+0000) 2019-12-09T22:37:42.550 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:37:42.545+0000 1694f700 -1 osd.7 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:17.919277+0000 front 2019-12-09T22:36:17.969052+0000 (oldest deadline 2019-12-09T22:37:03.095627+0000) 2019-12-09T22:37:42.682 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:37:42.678+0000 1694f700 -1 osd.3 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:16.502384+0000 front 2019-12-09T22:36:16.495540+0000 (oldest deadline 2019-12-09T22:36:59.846303+0000) 2019-12-09T22:37:42.811 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:37:42.808+0000 1694f700 -1 osd.1 1042 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:36:18.714492+0000 front 2019-12-09T22:36:18.759659+0000 (oldest deadline 2019-12-09T22:37:15.180102+0000) 2019-12-09T22:37:42.835 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:37:42.831+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e1042 v1042) 2019-12-09T22:38:26.989 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:38:26.981+0000 37792700 -1 osd.4 1046 build_incremental_map_msg missing incremental map 1046 2019-12-09T22:38:26.990 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:38:26.983+0000 37792700 -1 osd.4 1046 build_incremental_map_msg missing incremental map 1046 2019-12-09T22:38:27.039 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:38:27.025+0000 30f85700 -1 osd.4 1046 build_incremental_map_msg missing incremental map 1046 2019-12-09T22:38:27.481 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:38:27.338+0000 3478c700 -1 osd.4 1046 build_incremental_map_msg missing incremental map 1046 2019-12-09T22:39:31.061 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:31.057+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:31.703 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:31.700+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:32.045 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:32.042+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:32.716 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:32.709+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:33.028 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:33.025+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:33.077 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:33.073+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:33.124 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:33.120+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:33.709 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:33.705+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:33.952 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:33.949+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:34.036 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:34.031+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:34.097 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:34.092+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:34.110 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:34.107+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:34.685 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:34.682+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:34.842 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:34.839+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:34.995 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:34.993+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:35.014 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:35.010+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:35.100 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:35.097+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:35.160 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:35.156+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:35.666 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:35.662+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:35.803 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:35.800+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:35.984 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:35.981+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:36.032 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:36.027+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:36.082 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:36.079+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:36.173 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:36.168+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:36.666 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:36.663+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:36.762 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:36.759+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:36.946 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:36.942+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:37.053 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:37.049+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:37.060 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:37.057+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:37.146 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:37.142+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:37.625 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:37.621+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:37.744 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:37.738+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:37.928 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:37.924+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:38.037 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:38.031+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:38.037 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:38.031+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:38.109 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:38.102+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:38.645 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:38.642+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:38.779 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:38.776+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:38.975 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:38.972+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:38.999 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:38.995+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:39.046 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:39.042+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:39.132 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:39.128+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:39.631 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:39.627+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:39.761 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:39.757+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:39.997 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:39.993+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:40.013 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:40.007+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:40.065 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:40.061+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:40.090 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:40.085+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:40.654 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:40.652+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:40.768 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:40.765+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:41.005 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:41.001+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:41.024 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:41.021+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:41.073 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:41.067+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:41.104 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:41.096+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:41.700 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:41.695+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:41.815 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:41.812+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:41.962 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:41.958+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:42.051 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:42.045+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:42.060 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:42.057+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:42.061 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:42.057+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:42.656 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:42.651+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:42.843 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:42.840+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:42.948 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:42.944+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:43.014 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:43.007+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:43.068 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:43.064+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:43.106 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:43.102+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:43.616 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:43.612+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:43.837 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:43.833+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:43.943 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:43.939+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:44.055 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:44.051+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:44.093 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:44.087+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:44.103 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:44.099+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:44.614 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:44.609+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:44.874 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:44.871+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:44.904 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:44.900+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:45.026 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:45.023+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:45.087 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:45.083+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:45.104 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:39:45.100+0000 1694f700 -1 osd.4 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.844242+0000 front 2019-12-09T22:38:47.839148+0000 (oldest deadline 2019-12-09T22:39:33.098370+0000) 2019-12-09T22:39:45.646 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:45.641+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:45.871 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:45.867+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:45.896 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:45.892+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:45.993 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:45.988+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:46.087 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:46.083+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:46.613 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:46.608+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:46.881 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:46.877+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:46.892 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:46.888+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:46.989 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:46.984+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:47.137 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:47.131+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:47.614 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:47.611+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:47.839 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:47.835+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:47.930 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:47.927+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:47.997 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:47.993+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:48.097 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:48.092+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:48.617 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:48.614+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:48.878 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:48.874+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:48.888 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:48.885+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:48.967 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:48.964+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:49.131 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:49.127+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:49.653 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:49.649+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:49.891 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:49.888+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:49.897 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:49.894+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:49.935 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:49.931+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:50.119 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:50.115+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:50.697 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:50.690+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:50.869 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:50.865+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:50.876 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:50.871+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:50.915 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:50.910+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:51.152 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:51.148+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:51.746 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:51.741+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:51.853 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:51.841+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:51.914 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:51.909+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:51.932 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:51.928+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:52.142 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:52.137+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:52.743 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:52.738+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:52.874 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:52.870+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:52.879 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:52.875+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:52.940 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:52.936+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:53.117 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:53.114+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:53.758 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:53.754+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:53.838 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:53.834+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:53.923 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:53.918+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:53.951 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:53.948+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:54.097 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:54.093+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:54.722 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:54.718+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:54.844 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:54.839+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:54.879 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:54.874+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:54.936 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:54.932+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:55.093 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:55.087+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:55.741 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:55.737+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:55.876 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:55.870+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:55.884 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:55.881+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:55.992 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:55.984+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:56.073 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:56.070+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:56.706 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:56.703+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:56.858 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:56.855+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:56.862 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:56.859+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:56.999 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:56.996+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:57.099 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:57.092+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:57.707 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:57.704+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:57.912 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:57.908+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:57.917 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:57.913+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:57.961 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:57.957+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:58.106 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:58.102+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:58.748 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:58.743+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:58.873 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:58.868+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:58.892 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:58.888+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:39:58.940 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:58.936+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:59.094 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:39:59.090+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:39:59.784 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:39:59.780+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:39:59.902 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:39:59.898+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:39:59.932 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:39:59.919+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:39:59.932 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:39:59.923+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:00.119 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:00.114+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:00.750 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:00.746+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:00.878 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:00.874+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:00.905 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:00.902+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:00.947 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:00.943+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:01.088 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:01.085+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:01.801 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:01.796+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:01.898 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:01.895+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:01.926 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:01.922+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:01.981 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:01.979+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:02.132 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:02.128+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:02.769 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:02.765+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:02.902 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:02.892+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:02.917 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:02.912+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:03.024 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:03.020+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:03.191 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:03.185+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:03.380 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:40:03.376+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e1050 v1050) 2019-12-09T22:40:03.808 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:03.803+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:03.855 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:03.851+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:03.892 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:03.887+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:03.981 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:03.977+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:04.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:04.221+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:04.829 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:04.825+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:04.857 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:04.853+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:04.905 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:04.902+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:05.033 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:05.023+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:05.270 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:05.266+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:05.817 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:05.813+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:05.884 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:05.879+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:05.946 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:05.942+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:06.028 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:06.022+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:06.244 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:06.241+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:06.824 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:06.812+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:06.916 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:06.910+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:06.973 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:06.968+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:07.074 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:07.069+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:07.234 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:07.230+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:07.771 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:07.767+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:07.912 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:07.908+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:07.981 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:07.977+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:08.101 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:08.096+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:08.208 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:08.205+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:08.403 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:40:08.399+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e1050 v1050) 2019-12-09T22:40:08.749 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:08.745+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:08.939 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:08.935+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:09.003 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:08.999+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:09.123 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:09.119+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:09.221 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:09.218+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:09.758 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:09.752+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:09.944 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:09.939+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:10.039 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:10.035+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:10.127 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:10.120+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:10.226 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:10.222+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:10.783 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:10.780+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:10.925 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:10.921+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:11.019 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:11.015+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:11.160 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:11.156+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:11.199 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:11.196+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:11.810 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:11.805+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:11.971 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:11.967+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:11.997 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:11.993+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:12.131 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:12.125+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:12.191 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:12.187+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:12.771 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:40:12.766+0000 1694f700 -1 osd.1 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:48.704785+0000 front 2019-12-09T22:38:48.711044+0000 (oldest deadline 2019-12-09T22:39:31.450024+0000) 2019-12-09T22:40:12.956 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:40:12.951+0000 1694f700 -1 osd.2 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.587208+0000 front 2019-12-09T22:38:49.850493+0000 (oldest deadline 2019-12-09T22:39:34.820623+0000) 2019-12-09T22:40:12.984 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:40:12.980+0000 1694f700 -1 osd.5 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:44.888537+0000 front 2019-12-09T22:38:44.949237+0000 (oldest deadline 2019-12-09T22:39:30.697977+0000) 2019-12-09T22:40:13.153 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:40:13.148+0000 1694f700 -1 osd.7 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:47.344359+0000 front 2019-12-09T22:38:47.357580+0000 (oldest deadline 2019-12-09T22:39:32.625856+0000) 2019-12-09T22:40:13.179 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:40:13.175+0000 1694f700 -1 osd.3 1050 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:38:49.565626+0000 front 2019-12-09T22:38:49.930782+0000 (oldest deadline 2019-12-09T22:39:33.031591+0000) 2019-12-09T22:40:13.472 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:40:13.465+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 44sec e1050 v1050) 2019-12-09T22:41:13.774 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:35:34.833 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:13.779 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:35:34.838 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:13.789 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:35:34.848 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:13.795 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:35:34.854 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:13.806 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:35:34.842 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:13.830 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:35:34.867 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:14.047 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:35:35.106 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:14.125 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:35:35.184 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:14.284 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:35:35.320 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:33.779 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:35:54.838 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:33.796 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:35:54.855 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:33.826 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:35:54.885 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:33.831 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:35:54.891 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:33.834 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:35:54.871 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:33.836 INFO:tasks.ceph.mon.a.smithi146.stderr:==00:11:35:54.896 9588== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:33.841 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:35:54.878 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:33.864 INFO:tasks.ceph.mon.c.smithi146.stderr:==00:11:35:54.923 9589== Warning: unimplemented fcntl command: 1036 2019-12-09T22:41:33.873 INFO:tasks.ceph.mon.b.smithi194.stderr:==00:11:35:54.910 8828== Warning: unimplemented fcntl command: 1036 2019-12-09T22:42:02.828 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:02.824+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:03.869 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:03.866+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:03.948 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:03.944+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:04.225 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:04.222+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:04.853 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:04.849+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:04.854 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:04.849+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:04.999 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:04.995+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:05.274 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:05.268+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:05.511 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:05.506+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:05.818 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:05.813+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:05.901 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:05.898+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:05.961 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:05.958+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:06.245 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:06.241+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:06.512 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:06.508+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:06.808 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:06.803+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:06.866 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:06.861+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:06.866 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:06.860+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:06.970 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:06.966+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:07.232 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:07.227+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:07.476 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:07.472+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:07.825 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:07.821+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:07.828 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:07.824+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:07.836 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:07.832+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:07.944 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:07.939+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:08.196 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:08.191+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:08.470 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:08.466+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:08.797 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:08.795+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:08.818 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:08.815+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:08.825 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:08.821+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:08.927 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:08.924+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:09.175 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:09.168+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:09.436 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:09.431+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:09.814 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:09.809+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:09.833 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:09.829+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:09.861 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:09.853+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:09.926 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:09.920+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:10.141 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:10.136+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:10.445 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:10.438+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:10.818 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:10.814+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:10.836 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:10.832+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:10.865 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:10.860+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:10.978 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:10.973+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:11.118 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:11.114+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:11.425 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:11.421+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:11.815 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:11.811+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:11.843 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:11.839+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:11.915 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:11.910+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:12.011 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:12.007+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:12.081 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:12.077+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:12.439 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:12.436+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:12.780 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:12.777+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:12.821 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:12.817+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:12.965 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:12.961+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:13.039 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:13.035+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:13.060 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:13.057+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:13.424 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:13.420+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:13.830 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:13.826+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:13.841 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:13.838+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:13.937 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:13.933+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:13.997 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:13.993+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:14.022 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:14.018+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:14.422 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:14.418+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:14.858 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:14.853+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:14.869 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:14.865+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:14.925 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:14.916+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:15.000 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:14.995+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:15.012 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:15.008+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:15.476 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:15.471+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:15.849 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:15.845+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:15.897 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:15.893+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:15.972 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:15.967+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:15.980 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:15.975+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:15.990 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:15.986+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:16.482 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:16.477+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:16.859 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:16.849+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:16.896 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:16.892+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:16.971 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:16.966+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:16.985 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:16.981+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:16.991 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:16.986+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:17.452 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:17.448+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:17.859 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:17.856+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:17.884 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:17.881+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:17.943 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:17.937+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:17.984 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:17.980+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:18.038 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:18.034+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:18.496 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:18.492+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:18.858 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:18.855+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:18.875 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:18.871+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:18.955 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:18.951+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:19.015 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:19.011+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:19.023 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:19.019+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:19.466 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:19.462+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:19.840 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:19.836+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:19.913 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:19.910+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:19.918 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:19.914+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:19.969 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:19.965+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:20.021 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:20.018+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:20.479 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:20.475+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:20.879 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:20.875+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:20.890 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:20.885+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:20.939 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:20.935+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:21.024 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:21.019+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:21.025 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:21.020+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:21.530 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:21.526+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:21.910 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:21.905+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:21.916 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:21.912+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:21.933 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:21.926+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:22.014 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:22.009+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:22.024 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:22.020+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:22.532 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:22.529+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:22.877 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:22.873+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:22.913 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:22.909+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:22.953 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:22.948+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:23.013 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:23.009+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:23.022 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:23.019+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:23.539 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:23.535+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:23.846 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:23.842+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:23.936 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:23.933+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:23.967 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:23.961+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:23.998 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:23.994+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:24.051 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:24.048+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:24.498 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:24.494+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:24.858 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:24.854+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:24.894 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:24.891+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:24.951 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:24.945+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:24.971 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:24.967+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:25.066 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:25.062+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:25.525 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:25.522+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:25.885 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:25.881+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:25.886 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:25.882+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:25.940 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:25.935+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:25.968 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:25.963+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:26.075 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:26.071+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:26.478 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:26.475+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:26.850 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:26.846+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:26.931 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:26.925+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:26.931 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:26.927+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:26.969 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:26.964+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:27.068 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:27.063+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:27.501 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:27.496+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:27.813 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:27.808+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:27.932 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:27.927+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:27.938 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:27.935+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:27.956 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:27.952+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:28.098 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:28.094+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:28.465 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:28.462+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:28.800 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:28.795+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:28.942 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:28.938+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:28.972 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:28.965+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:28.981 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:28.976+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:29.066 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:29.060+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:29.447 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:29.443+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:29.812 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:29.808+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:29.909 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:29.897+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:29.964 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:29.960+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:29.972 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:29.968+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:30.117 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:30.108+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:30.460 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:30.456+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:30.836 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:30.829+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:30.895 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:30.891+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:30.926 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:30.922+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:30.973 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:30.969+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:31.092 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:31.087+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:31.497 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:31.493+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:31.873 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:31.869+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:31.922 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:31.917+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:31.937 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:31.932+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:31.947 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:31.943+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:32.128 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:32.124+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:32.537 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:32.531+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:32.887 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:32.883+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:32.900 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:32.893+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:32.957 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:32.953+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:32.997 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:32.989+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:33.133 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:33.130+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:33.537 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:33.532+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:33.886 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:33.883+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:33.933 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:33.928+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:33.953 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:33.947+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:33.959 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:33.954+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:34.140 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:34.137+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:34.563 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:34.558+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:34.905 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:34.901+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:34.926 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:34.923+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:34.986 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:34.981+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:34.996 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:34.994+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:35.167 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:35.164+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:35.580 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:35.576+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:35.931 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:35.929+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:35.956 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:35.953+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:35.958 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:35.955+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:36.003 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:35.994+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:36.164 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:36.160+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:36.625 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:36.621+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:36.919 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:36.915+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:36.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:36.921+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:36.950 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:36.946+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:36.962 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:36.959+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:37.180 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:37.175+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:37.585 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:37.581+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:37.886 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:37.883+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:37.921 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:37.918+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:37.962 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:37.958+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:38.001 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:37.997+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:38.160 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:38.154+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:38.622 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:38.618+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:38.896 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:38.892+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:38.915 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:42:38.913+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e1057 v1057) 2019-12-09T22:42:38.928 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:38.919+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:38.956 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:38.952+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:38.997 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:38.993+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:39.209 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:39.206+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:39.660 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:39.656+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:39.879 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:39.876+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:39.884 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:39.881+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:39.924 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:39.919+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:40.040 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:40.034+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:40.233 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:40.230+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:40.633 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:40.629+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:40.842 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:40.837+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:40.915 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:40.912+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:40.960 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:40.957+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:41.033 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:41.030+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:41.274 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:41.271+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:41.629 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:41.625+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:41.885 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:41.880+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:41.925 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:41.910+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:41.985 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:41.981+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:42.006 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:42.002+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:42.281 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:42.277+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:42.596 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:42.592+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:42.866 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:42.864+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:42.886 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:42.881+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:42.947 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:42.944+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:43.052 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:43.049+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:42:43.324 INFO:tasks.ceph.osd.2.smithi146.stderr:2019-12-09T22:42:43.319+0000 1694f700 -1 osd.2 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:17.396858+0000 front 2019-12-09T22:41:17.385762+0000 (oldest deadline 2019-12-09T22:42:03.248307+0000) 2019-12-09T22:42:43.576 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:42:43.574+0000 1694f700 -1 osd.5 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.378341+0000 front 2019-12-09T22:41:21.421804+0000 (oldest deadline 2019-12-09T22:42:04.976663+0000) 2019-12-09T22:42:43.901 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:42:43.891+0000 1694f700 -1 osd.3 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:20.721095+0000 front 2019-12-09T22:41:20.883757+0000 (oldest deadline 2019-12-09T22:42:06.564190+0000) 2019-12-09T22:42:43.913 INFO:tasks.ceph.osd.7.smithi194.stderr:2019-12-09T22:42:43.907+0000 1694f700 -1 osd.7 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:18.192581+0000 front 2019-12-09T22:41:18.140465+0000 (oldest deadline 2019-12-09T22:42:01.903426+0000) 2019-12-09T22:42:43.963 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:42:43.959+0000 1694f700 -1 osd.1 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.735565+0000 front 2019-12-09T22:41:21.605116+0000 (oldest deadline 2019-12-09T22:42:03.285990+0000) 2019-12-09T22:42:43.994 INFO:tasks.ceph.mon.a.smithi146.stderr:2019-12-09T22:42:43.990+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.146:6826/10555,v1:172.21.15.146:6827/10555] for 46sec e1057 v1057) 2019-12-09T22:42:44.101 INFO:tasks.ceph.osd.4.smithi194.stderr:2019-12-09T22:42:44.098+0000 1694f700 -1 osd.4 1057 heartbeat_check: no reply from 172.21.15.146:6830 osd.0 since back 2019-12-09T22:41:21.447013+0000 front 2019-12-09T22:41:21.307434+0000 (oldest deadline 2019-12-09T22:42:04.112465+0000) 2019-12-09T22:43:14.485 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:43:14.480+0000 1694f700 -1 osd.1 1059 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:134399 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 821690848 gen 269] snapc 0=[] ondisk+write+known_if_redirected e1058) 2019-12-09T22:43:14.574 INFO:tasks.ceph.osd.5.smithi194.stderr:2019-12-09T22:43:14.567+0000 1694f700 -1 osd.5 1059 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:134400 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 5419134048 gen 88] snapc 0=[] ondisk+write+known_if_redirected e1058) 2019-12-09T22:43:15.756 INFO:tasks.ceph.osd.1.smithi146.stderr:2019-12-09T22:43:15.692+0000 1694f700 -1 osd.1 1060 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4376.0:134399 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 821690848 gen 269] snapc 0=[] ondisk+write+known_if_redirected e1058) 2019-12-09T22:43:31.993 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:43:31.817+0000 32788700 -1 osd.3 1061 build_incremental_map_msg missing incremental map 1061 2019-12-09T22:43:32.030 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:43:31.825+0000 31f87700 -1 osd.3 1061 build_incremental_map_msg missing incremental map 1061 2019-12-09T22:43:32.077 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:43:31.838+0000 36f91700 -1 osd.3 1061 build_incremental_map_msg missing incremental map 1061 2019-12-09T22:43:32.157 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:43:31.897+0000 31f87700 -1 osd.3 1061 build_incremental_map_msg missing incremental map 1061 2019-12-09T22:43:32.166 INFO:tasks.ceph.osd.3.smithi146.stderr:2019-12-09T22:43:31.925+0000 32788700 -1 osd.3 1061 build_incremental_map_msg missing incremental map 1061 2019-12-09T22:43:46.129 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-12-09T22:43:46.129 DEBUG:teuthology.task.console_log:Killing console logger for smithi194 2019-12-09T22:43:46.130 DEBUG:teuthology.task.console_log:Killing console logger for smithi146 2019-12-09T22:43:46.130 DEBUG:teuthology.task.console_log:Killing console logger for smithi194 2019-12-09T22:43:46.131 DEBUG:teuthology.task.console_log:Killing console logger for smithi146 2019-12-09T22:43:46.131 DEBUG:teuthology.exit:Finished running handlers